2023-10-14T16:36:00.798 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T16:36:00.799 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --verbose --archive /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843 --name yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi --description smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/libcephfs_interface_tests}} -- /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/orig.config.yaml 2023-10-14T16:36:00.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T16:36:00.933 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843 branch: quincy-release description: smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/libcephfs_interface_tests}} email: null first_in_suite: false job_id: '7427843' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 2 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 10 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: quincy-release ceph: conf: client: debug client: 20 debug ms: 1 mds: debug mds: 20 debug ms: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: quincy-release sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mds.a - mgr.x - osd.0 - osd.1 - - mon.b - mds.b - mon.c - mgr.y - osd.2 - osd.3 - - client.0 seed: 7103 sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 sleep_before_teardown: 0 subset: 111/120000 suite: smoke suite_branch: quincy-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 targets: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD2V1pydE/Nblj3F4zQzonPePLslsJxTqHZe77IvppnxXBBQTRtAw4C/kCVRrQ5GV1qjj48Pi6CWkzVdTuZmKxE= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNaUt6XRwPyW83NOO/DkbIe/LUU6Y2Cn96Nv3CIAiYNCssmdJz9Js0dvmPROFs6P2o6JmTgg2g2gCpslr8k39SI= smithi158.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwgx9MI7rNF66HyQBifvvzkRYTwdRRWRfiNkc1T8eFE2sG5claga68c6UZUAR8BcwSDUK0UWyjKdviBBBruHlU= tasks: - install: cleanup: true - ceph: null - ceph-fuse: null - workunit: clients: client.0: - libcephfs/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-14_16:11:58 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T16:36:00.933 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa; will attempt to use it 2023-10-14T16:36:00.934 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks 2023-10-14T16:36:00.935 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T16:36:00.936 INFO:teuthology.task.internal:Checking packages... 2023-10-14T16:36:00.960 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586' 2023-10-14T16:36:00.961 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T16:36:00.961 INFO:teuthology.packaging:ref: None 2023-10-14T16:36:00.961 INFO:teuthology.packaging:tag: None 2023-10-14T16:36:00.962 INFO:teuthology.packaging:branch: quincy-release 2023-10-14T16:36:00.962 INFO:teuthology.packaging:sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T16:36:00.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy-release 2023-10-14T16:36:01.133 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1415.g9d6d32bb 2023-10-14T16:36:01.133 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T16:36:01.140 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T16:36:01.140 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T16:36:01.152 INFO:teuthology.task.internal:Saving configuration 2023-10-14T16:36:01.165 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T16:36:01.170 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T16:36:01.196 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 16:30:10.585897', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD2V1pydE/Nblj3F4zQzonPePLslsJxTqHZe77IvppnxXBBQTRtAw4C/kCVRrQ5GV1qjj48Pi6CWkzVdTuZmKxE='} 2023-10-14T16:36:01.214 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 16:30:10.584614', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNaUt6XRwPyW83NOO/DkbIe/LUU6Y2Cn96Nv3CIAiYNCssmdJz9Js0dvmPROFs6P2o6JmTgg2g2gCpslr8k39SI='} 2023-10-14T16:36:01.240 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 16:30:10.583130', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwgx9MI7rNF66HyQBifvvzkRYTwdRRWRfiNkc1T8eFE2sG5claga68c6UZUAR8BcwSDUK0UWyjKdviBBBruHlU='} 2023-10-14T16:36:01.240 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T16:36:01.247 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mds.a', 'mgr.x', 'osd.0', 'osd.1'] 2023-10-14T16:36:01.247 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mon.c', 'mgr.y', 'osd.2', 'osd.3'] 2023-10-14T16:36:01.247 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['client.0'] 2023-10-14T16:36:01.248 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T16:36:01.353 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1806e10a60>, signals=[15]) 2023-10-14T16:36:01.355 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T16:36:01.361 INFO:teuthology.task.internal:Opening connections... 2023-10-14T16:36:01.361 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T16:36:01.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:36:01.435 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2023-10-14T16:36:01.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:36:01.505 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi158.front.sepia.ceph.com 2023-10-14T16:36:01.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:36:01.572 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T16:36:01.579 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-10-14T16:36:01.598 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-10-14T16:36:01.598 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-10-14T16:36:01.656 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T16:36:01.656 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.4 (Ootpa)" 2023-10-14T16:36:01.657 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2023-10-14T16:36:01.657 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2023-10-14T16:36:01.657 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.4" 2023-10-14T16:36:01.657 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-10-14T16:36:01.657 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-14T16:36:01.658 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-10-14T16:36:01.658 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-14T16:36:01.658 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T16:36:01.658 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T16:36:01.659 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T16:36:01.659 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:36:01.659 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T16:36:01.659 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-14T16:36:01.660 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T16:36:01.660 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-14T16:36:01.661 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-10-14T16:36:01.683 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-10-14T16:36:01.701 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-10-14T16:36:01.701 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-10-14T16:36:01.757 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T16:36:01.757 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8.4 (Ootpa)" 2023-10-14T16:36:01.758 INFO:teuthology.orchestra.run.smithi155.stdout:ID="rhel" 2023-10-14T16:36:01.758 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="fedora" 2023-10-14T16:36:01.758 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8.4" 2023-10-14T16:36:01.758 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2023-10-14T16:36:01.759 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-14T16:36:01.759 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-10-14T16:36:01.759 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-14T16:36:01.759 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T16:36:01.759 INFO:teuthology.orchestra.run.smithi155.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T16:36:01.760 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T16:36:01.760 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:36:01.760 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T16:36:01.760 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-14T16:36:01.760 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T16:36:01.761 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-14T16:36:01.761 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-10-14T16:36:01.783 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-10-14T16:36:01.801 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-10-14T16:36:01.801 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-10-14T16:36:01.856 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T16:36:01.857 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.4 (Ootpa)" 2023-10-14T16:36:01.857 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel" 2023-10-14T16:36:01.857 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora" 2023-10-14T16:36:01.857 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.4" 2023-10-14T16:36:01.858 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-10-14T16:36:01.858 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-14T16:36:01.858 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-10-14T16:36:01.858 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-14T16:36:01.858 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T16:36:01.859 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T16:36:01.859 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T16:36:01.859 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:36:01.859 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T16:36:01.859 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-14T16:36:01.860 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T16:36:01.860 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-14T16:36:01.860 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-10-14T16:36:01.883 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T16:36:01.892 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T16:36:01.899 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T16:36:01.899 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2023-10-14T16:36:01.902 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2023-10-14T16:36:01.904 DEBUG:teuthology.orchestra.run.smithi158:> test '!' -e /home/ubuntu/cephtest 2023-10-14T16:36:01.920 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T16:36:01.926 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T16:36:01.927 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2023-10-14T16:36:01.959 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2023-10-14T16:36:01.961 DEBUG:teuthology.orchestra.run.smithi158:> test -z $(ls -A /var/lib/ceph) 2023-10-14T16:36:01.974 INFO:teuthology.orchestra.run.smithi008.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-14T16:36:01.975 INFO:teuthology.orchestra.run.smithi155.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-14T16:36:01.977 INFO:teuthology.orchestra.run.smithi158.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-14T16:36:01.978 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T16:36:02.054 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T16:36:02.069 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-14T16:36:02.069 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-14T16:36:02.070 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T16:36:02.071 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T16:36:02.071 DEBUG:teuthology.orchestra.run.smithi158:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T16:36:02.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T16:36:02.088 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-10-14T16:36:02.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T16:36:02.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T16:36:02.090 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-14T16:36:02.090 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2023-10-14T16:36:02.143 INFO:teuthology.orchestra.run.smithi158.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-14T16:36:02.144 INFO:teuthology.task.kernel:Running kernel on smithi158: 4.18.0-305.25.1.el8_4.x86_64 2023-10-14T16:36:02.144 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum install -y kernel 2023-10-14T16:36:02.146 INFO:teuthology.orchestra.run.smithi155.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-14T16:36:02.147 INFO:teuthology.task.kernel:Running kernel on smithi155: 4.18.0-305.25.1.el8_4.x86_64 2023-10-14T16:36:02.147 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum install -y kernel 2023-10-14T16:36:02.148 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-14T16:36:02.149 INFO:teuthology.task.kernel:Running kernel on smithi008: 4.18.0-305.25.1.el8_4.x86_64 2023-10-14T16:36:02.149 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum install -y kernel 2023-10-14T16:36:03.678 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:36:03.679 INFO:teuthology.orchestra.run.smithi158.stdout:Unable to read consumer identity 2023-10-14T16:36:03.692 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:36:03.693 INFO:teuthology.orchestra.run.smithi155.stdout:Unable to read consumer identity 2023-10-14T16:36:03.705 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:36:03.705 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2023-10-14T16:36:05.085 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-10-14T16:36:05.090 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph 30 kB/s | 3.5 kB 00:00 2023-10-14T16:36:05.182 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 35 kB/s | 3.5 kB 00:00 2023-10-14T16:36:05.781 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-10-14T16:36:05.805 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-14T16:36:06.592 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-14T16:36:09.113 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-10-14T16:36:09.218 INFO:teuthology.orchestra.run.smithi158.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-14T16:36:09.815 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-14T16:36:09.815 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-14T16:36:09.816 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-14T16:36:09.954 INFO:teuthology.orchestra.run.smithi158.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-14T16:36:09.954 INFO:teuthology.orchestra.run.smithi158.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-14T16:36:09.955 INFO:teuthology.orchestra.run.smithi158.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-14T16:36:09.967 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:36:09.968 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T16:36:09.968 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:36:10.090 DEBUG:teuthology.orchestra.run.smithi155:> echo no | sudo yum reinstall kernel || true 2023-10-14T16:36:10.113 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:36:10.114 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T16:36:10.114 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:36:10.227 DEBUG:teuthology.orchestra.run.smithi158:> echo no | sudo yum reinstall kernel || true 2023-10-14T16:36:10.306 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-14T16:36:10.436 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:36:10.436 INFO:teuthology.orchestra.run.smithi155.stdout:Unable to read consumer identity 2023-10-14T16:36:10.574 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:36:10.574 INFO:teuthology.orchestra.run.smithi158.stdout:Unable to read consumer identity 2023-10-14T16:36:10.737 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:01 ago on Sat 14 Oct 2023 04:36:09 PM UTC. 2023-10-14T16:36:10.873 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:00:01 ago on Sat 14 Oct 2023 04:36:09 PM UTC. 2023-10-14T16:36:10.886 INFO:teuthology.orchestra.run.smithi155.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T16:36:10.886 INFO:teuthology.orchestra.run.smithi155.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T16:36:10.887 INFO:teuthology.orchestra.run.smithi155.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T16:36:10.918 INFO:teuthology.orchestra.run.smithi155.stderr:Error: No packages marked for reinstall. 2023-10-14T16:36:10.968 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum reinstall -y kernel || true 2023-10-14T16:36:11.011 INFO:teuthology.orchestra.run.smithi158.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T16:36:11.011 INFO:teuthology.orchestra.run.smithi158.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T16:36:11.011 INFO:teuthology.orchestra.run.smithi158.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T16:36:11.031 INFO:teuthology.orchestra.run.smithi158.stderr:Error: No packages marked for reinstall. 2023-10-14T16:36:11.038 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-14T16:36:11.038 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-14T16:36:11.038 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-14T16:36:11.081 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum reinstall -y kernel || true 2023-10-14T16:36:11.193 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:36:11.195 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T16:36:11.195 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:36:11.299 DEBUG:teuthology.orchestra.run.smithi008:> echo no | sudo yum reinstall kernel || true 2023-10-14T16:36:11.310 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:36:11.311 INFO:teuthology.orchestra.run.smithi155.stdout:Unable to read consumer identity 2023-10-14T16:36:11.425 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:36:11.426 INFO:teuthology.orchestra.run.smithi158.stdout:Unable to read consumer identity 2023-10-14T16:36:11.601 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 04:36:09 PM UTC. 2023-10-14T16:36:11.664 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:36:11.664 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2023-10-14T16:36:11.721 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 04:36:09 PM UTC. 2023-10-14T16:36:11.734 INFO:teuthology.orchestra.run.smithi155.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T16:36:11.735 INFO:teuthology.orchestra.run.smithi155.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T16:36:11.735 INFO:teuthology.orchestra.run.smithi155.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T16:36:11.751 INFO:teuthology.orchestra.run.smithi155.stderr:Error: No packages marked for reinstall. 2023-10-14T16:36:11.800 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T16:36:11.859 INFO:teuthology.orchestra.run.smithi158.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T16:36:11.860 INFO:teuthology.orchestra.run.smithi158.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T16:36:11.860 INFO:teuthology.orchestra.run.smithi158.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T16:36:11.873 INFO:teuthology.orchestra.run.smithi158.stderr:Error: No packages marked for reinstall. 2023-10-14T16:36:11.925 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:11.925 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:11.925 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:11.926 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-14T16:36:11.926 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-14T16:36:11.926 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-14T16:36:11.926 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=None, version=distro) 2023-10-14T16:36:11.927 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T16:36:11.928 DEBUG:teuthology.orchestra.run.smithi158:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T16:36:11.979 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:00:01 ago on Sat 14 Oct 2023 04:36:10 PM UTC. 2023-10-14T16:36:12.052 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:12.052 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:12.052 DEBUG:teuthology.orchestra.run.smithi155:> sudo rpm -qi grub2-tools 2023-10-14T16:36:12.054 INFO:teuthology.orchestra.run.smithi158.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:12.054 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:12.054 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:12.054 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-14T16:36:12.055 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-14T16:36:12.055 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-14T16:36:12.055 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi158.front.sepia.ceph.com, path=None, version=distro) 2023-10-14T16:36:12.055 DEBUG:teuthology.orchestra.run.smithi158:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T16:36:12.084 INFO:teuthology.orchestra.run.smithi155.stdout:Name : grub2-tools 2023-10-14T16:36:12.084 INFO:teuthology.orchestra.run.smithi155.stdout:Epoch : 1 2023-10-14T16:36:12.084 INFO:teuthology.orchestra.run.smithi155.stdout:Version : 2.02 2023-10-14T16:36:12.084 INFO:teuthology.orchestra.run.smithi155.stdout:Release : 99.el8_4.1 2023-10-14T16:36:12.085 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: x86_64 2023-10-14T16:36:12.085 INFO:teuthology.orchestra.run.smithi155.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-14T16:36:12.085 INFO:teuthology.orchestra.run.smithi155.stdout:Group : System Environment/Base 2023-10-14T16:36:12.086 INFO:teuthology.orchestra.run.smithi155.stdout:Size : 9264631 2023-10-14T16:36:12.086 INFO:teuthology.orchestra.run.smithi155.stdout:License : GPLv3+ 2023-10-14T16:36:12.086 INFO:teuthology.orchestra.run.smithi155.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-14T16:36:12.086 INFO:teuthology.orchestra.run.smithi155.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-14T16:36:12.087 INFO:teuthology.orchestra.run.smithi155.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-14T16:36:12.087 INFO:teuthology.orchestra.run.smithi155.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-14T16:36:12.087 INFO:teuthology.orchestra.run.smithi155.stdout:Relocations : (not relocatable) 2023-10-14T16:36:12.087 INFO:teuthology.orchestra.run.smithi155.stdout:Packager : Red Hat, Inc. 2023-10-14T16:36:12.088 INFO:teuthology.orchestra.run.smithi155.stdout:Vendor : Red Hat, Inc. 2023-10-14T16:36:12.088 INFO:teuthology.orchestra.run.smithi155.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T16:36:12.088 INFO:teuthology.orchestra.run.smithi155.stdout:Summary : Support tools for GRUB. 2023-10-14T16:36:12.088 INFO:teuthology.orchestra.run.smithi155.stdout:Description : 2023-10-14T16:36:12.088 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:36:12.089 INFO:teuthology.orchestra.run.smithi155.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T16:36:12.089 INFO:teuthology.orchestra.run.smithi155.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T16:36:12.089 INFO:teuthology.orchestra.run.smithi155.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T16:36:12.089 INFO:teuthology.orchestra.run.smithi155.stdout:hardware devices. 2023-10-14T16:36:12.090 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:36:12.090 INFO:teuthology.orchestra.run.smithi155.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T16:36:12.091 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T16:36:12.091 INFO:teuthology.task.kernel:Updating grub on smithi155 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:12.092 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T16:36:12.123 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T16:36:12.123 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T16:36:12.124 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T16:36:12.145 INFO:teuthology.orchestra.run.smithi008.stderr:Error: No packages marked for reinstall. 2023-10-14T16:36:12.182 INFO:teuthology.orchestra.run.smithi158.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:12.183 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:12.183 DEBUG:teuthology.orchestra.run.smithi158:> sudo rpm -qi grub2-tools 2023-10-14T16:36:12.196 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum reinstall -y kernel || true 2023-10-14T16:36:12.210 INFO:teuthology.orchestra.run.smithi158.stdout:Name : grub2-tools 2023-10-14T16:36:12.211 INFO:teuthology.orchestra.run.smithi158.stdout:Epoch : 1 2023-10-14T16:36:12.211 INFO:teuthology.orchestra.run.smithi158.stdout:Version : 2.02 2023-10-14T16:36:12.211 INFO:teuthology.orchestra.run.smithi158.stdout:Release : 99.el8_4.1 2023-10-14T16:36:12.211 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: x86_64 2023-10-14T16:36:12.212 INFO:teuthology.orchestra.run.smithi158.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-14T16:36:12.212 INFO:teuthology.orchestra.run.smithi158.stdout:Group : System Environment/Base 2023-10-14T16:36:12.212 INFO:teuthology.orchestra.run.smithi158.stdout:Size : 9264631 2023-10-14T16:36:12.212 INFO:teuthology.orchestra.run.smithi158.stdout:License : GPLv3+ 2023-10-14T16:36:12.212 INFO:teuthology.orchestra.run.smithi158.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-14T16:36:12.213 INFO:teuthology.orchestra.run.smithi158.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-14T16:36:12.213 INFO:teuthology.orchestra.run.smithi158.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-14T16:36:12.213 INFO:teuthology.orchestra.run.smithi158.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-14T16:36:12.213 INFO:teuthology.orchestra.run.smithi158.stdout:Relocations : (not relocatable) 2023-10-14T16:36:12.213 INFO:teuthology.orchestra.run.smithi158.stdout:Packager : Red Hat, Inc. 2023-10-14T16:36:12.214 INFO:teuthology.orchestra.run.smithi158.stdout:Vendor : Red Hat, Inc. 2023-10-14T16:36:12.214 INFO:teuthology.orchestra.run.smithi158.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T16:36:12.214 INFO:teuthology.orchestra.run.smithi158.stdout:Summary : Support tools for GRUB. 2023-10-14T16:36:12.214 INFO:teuthology.orchestra.run.smithi158.stdout:Description : 2023-10-14T16:36:12.215 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:36:12.215 INFO:teuthology.orchestra.run.smithi158.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T16:36:12.215 INFO:teuthology.orchestra.run.smithi158.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T16:36:12.215 INFO:teuthology.orchestra.run.smithi158.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T16:36:12.215 INFO:teuthology.orchestra.run.smithi158.stdout:hardware devices. 2023-10-14T16:36:12.216 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:36:12.216 INFO:teuthology.orchestra.run.smithi158.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T16:36:12.217 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T16:36:12.217 INFO:teuthology.task.kernel:Updating grub on smithi158 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:12.217 DEBUG:teuthology.orchestra.run.smithi158:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T16:36:12.561 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:36:12.561 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2023-10-14T16:36:12.867 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 04:36:10 PM UTC. 2023-10-14T16:36:13.022 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T16:36:13.023 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T16:36:13.023 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T16:36:13.036 INFO:teuthology.orchestra.run.smithi008.stderr:Error: No packages marked for reinstall. 2023-10-14T16:36:13.087 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T16:36:13.206 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2023-10-14T16:36:13.217 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:13.218 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:13.219 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:13.219 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-14T16:36:13.219 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-14T16:36:13.219 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-14T16:36:13.220 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=None, version=distro) 2023-10-14T16:36:13.220 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T16:36:13.350 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:13.350 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:13.351 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2023-10-14T16:36:13.379 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2023-10-14T16:36:13.379 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2023-10-14T16:36:13.379 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.02 2023-10-14T16:36:13.379 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 99.el8_4.1 2023-10-14T16:36:13.379 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2023-10-14T16:36:13.380 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-14T16:36:13.380 INFO:teuthology.orchestra.run.smithi008.stdout:Group : System Environment/Base 2023-10-14T16:36:13.380 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 9264631 2023-10-14T16:36:13.380 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2023-10-14T16:36:13.381 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-14T16:36:13.381 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-14T16:36:13.381 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-14T16:36:13.381 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-14T16:36:13.381 INFO:teuthology.orchestra.run.smithi008.stdout:Relocations : (not relocatable) 2023-10-14T16:36:13.381 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : Red Hat, Inc. 2023-10-14T16:36:13.382 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : Red Hat, Inc. 2023-10-14T16:36:13.382 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T16:36:13.382 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2023-10-14T16:36:13.382 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2023-10-14T16:36:13.383 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:36:13.383 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T16:36:13.383 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T16:36:13.383 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T16:36:13.383 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2023-10-14T16:36:13.384 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:36:13.384 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T16:36:13.385 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T16:36:13.385 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:13.385 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T16:36:13.708 INFO:teuthology.orchestra.run.smithi158.stderr:Generating grub configuration file ... 2023-10-14T16:36:14.624 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2023-10-14T16:36:15.529 INFO:teuthology.orchestra.run.smithi155.stderr:done 2023-10-14T16:36:15.531 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2023-10-14T16:36:15.545 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.vkILfnMTK8 2023-10-14T16:36:15.546 DEBUG:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vkILfnMTK8 2023-10-14T16:36:15.616 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.vkILfnMTK8 2023-10-14T16:36:15.768 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.vkILfnMTK8 is 6KB 2023-10-14T16:36:15.817 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.vkILfnMTK8 2023-10-14T16:36:15.830 DEBUG:teuthology.orchestra.run.smithi155:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T16:36:15.873 INFO:teuthology.orchestra.run.smithi158.stderr:done 2023-10-14T16:36:15.875 DEBUG:teuthology.orchestra.run.smithi158:> mktemp 2023-10-14T16:36:15.889 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.DlX39bY6Wc 2023-10-14T16:36:15.889 DEBUG:teuthology.orchestra.run.smithi158:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DlX39bY6Wc 2023-10-14T16:36:15.896 INFO:teuthology.orchestra.run.smithi155.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-14T16:36:15.896 INFO:teuthology.orchestra.run.smithi155.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-14T16:36:15.896 INFO:teuthology.orchestra.run.smithi155.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-14T16:36:15.896 INFO:teuthology.orchestra.run.smithi155.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-14T16:36:15.897 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:15.964 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.DlX39bY6Wc 2023-10-14T16:36:16.094 DEBUG:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2023-10-14T16:36:16.115 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.DlX39bY6Wc is 6KB 2023-10-14T16:36:16.165 DEBUG:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.DlX39bY6Wc 2023-10-14T16:36:16.179 DEBUG:teuthology.orchestra.run.smithi158:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T16:36:16.259 INFO:teuthology.orchestra.run.smithi158.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-14T16:36:16.260 INFO:teuthology.orchestra.run.smithi158.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-14T16:36:16.260 INFO:teuthology.orchestra.run.smithi158.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-14T16:36:16.260 INFO:teuthology.orchestra.run.smithi158.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-14T16:36:16.261 DEBUG:teuthology.orchestra.run.smithi158:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:16.449 DEBUG:teuthology.orchestra.run.smithi158:> sudo shutdown -r now 2023-10-14T16:36:16.807 INFO:teuthology.orchestra.run.smithi008.stderr:done 2023-10-14T16:36:16.808 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-10-14T16:36:16.823 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.7OGQgatQKO 2023-10-14T16:36:16.823 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7OGQgatQKO 2023-10-14T16:36:16.891 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.7OGQgatQKO 2023-10-14T16:36:17.044 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.7OGQgatQKO is 6KB 2023-10-14T16:36:17.093 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.7OGQgatQKO 2023-10-14T16:36:17.107 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T16:36:17.182 INFO:teuthology.orchestra.run.smithi008.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-14T16:36:17.183 INFO:teuthology.orchestra.run.smithi008.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-14T16:36:17.183 INFO:teuthology.orchestra.run.smithi008.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-14T16:36:17.183 INFO:teuthology.orchestra.run.smithi008.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-14T16:36:17.184 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-14T16:36:17.343 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2023-10-14T16:36:46.124 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-14T16:36:46.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-14T16:36:46.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:36:46.451 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-14T16:36:46.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-14T16:36:46.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:36:47.346 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-14T16:36:47.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-14T16:36:47.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:37:20.634 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-14T16:37:21.146 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-14T16:37:29.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-14T16:37:29.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:37:30.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-14T16:37:30.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:37:33.214 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-14T16:37:45.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-14T16:37:45.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:37:47.350 DEBUG:teuthology.orchestra.remote:timed out 2023-10-14T16:37:48.026 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-14T16:37:56.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-14T16:37:56.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:37:56.756 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-14T16:37:57.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-14T16:37:57.052 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-14T16:37:57.052 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-14T16:37:57.109 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-14T16:37:57.109 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:37:57.109 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T16:37:57.110 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-14T16:37:58.110 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-14T16:37:58.111 DEBUG:teuthology.orchestra.run.smithi008:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-14T16:37:58.213 INFO:teuthology.orchestra.run.smithi008.stdout:ttyS1 2023-10-14T16:37:58.226 DEBUG:teuthology.parallel:result is None 2023-10-14T16:38:00.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-14T16:38:00.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:38:02.270 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-10-14T16:38:02.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-14T16:38:02.582 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-14T16:38:02.582 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2023-10-14T16:38:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-14T16:38:02.598 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:38:02.599 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T16:38:02.599 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-14T16:38:03.600 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-14T16:38:03.600 DEBUG:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-14T16:38:03.729 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2023-10-14T16:38:03.741 DEBUG:teuthology.parallel:result is None 2023-10-14T16:38:17.046 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-14T16:38:17.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-14T16:38:17.386 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-14T16:38:17.386 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-10-14T16:38:17.400 INFO:teuthology.orchestra.run.smithi158.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-14T16:38:17.400 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-14T16:38:17.401 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T16:38:17.401 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-14T16:38:18.402 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-10-14T16:38:18.402 DEBUG:teuthology.orchestra.run.smithi158:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-14T16:38:18.571 INFO:teuthology.orchestra.run.smithi158.stdout:ttyS1 2023-10-14T16:38:18.586 DEBUG:teuthology.parallel:result is None 2023-10-14T16:38:18.587 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T16:38:18.602 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T16:38:18.602 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T16:38:18.608 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T16:38:18.612 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T16:38:18.629 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T16:38:18.636 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T16:38:18.644 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T16:38:18.644 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T16:38:18.667 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T16:38:18.672 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T16:38:18.706 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T16:38:18.712 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T16:38:18.713 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T16:38:18.733 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T16:38:18.736 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T16:38:18.775 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T16:38:18.778 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T16:38:18.782 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T16:38:18.787 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T16:38:18.791 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T16:38:18.794 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T16:38:18.796 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T16:38:18.803 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T16:38:18.804 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T16:38:18.808 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T16:38:18.810 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T16:38:18.854 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T16:38:18.864 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T16:38:18.865 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T16:38:18.876 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T16:38:18.878 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T16:38:18.909 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T16:38:18.975 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T16:38:19.018 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T16:38:19.102 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T16:38:19.143 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:38:19.144 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T16:38:19.210 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T16:38:19.250 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T16:38:19.295 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T16:38:19.376 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T16:38:19.416 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:38:19.417 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T16:38:19.481 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T16:38:19.524 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T16:38:19.606 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T16:38:19.642 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T16:38:19.687 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-14T16:38:19.687 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T16:38:19.754 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2023-10-14T16:38:19.757 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2023-10-14T16:38:19.759 DEBUG:teuthology.orchestra.run.smithi158:> sudo service rsyslog restart 2023-10-14T16:38:19.816 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T16:38:19.822 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T16:38:19.858 INFO:teuthology.orchestra.run.smithi158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T16:38:20.295 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T16:38:20.306 INFO:teuthology.task.internal:Starting timer... 2023-10-14T16:38:20.307 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T16:38:20.318 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T16:38:20.327 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-14T16:38:20.327 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2023-10-14T16:38:20.387 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: [ OK ] 2023-10-14T16:38:20.388 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2023-10-14T16:38:20.450 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: [ OK ] 2023-10-14T16:38:20.450 DEBUG:teuthology.orchestra.run.smithi158:> sudo service auditd rotate 2023-10-14T16:38:20.531 INFO:teuthology.orchestra.run.smithi158.stdout:Rotating logs: [ OK ] 2023-10-14T16:38:20.533 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T16:38:20.533 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2023-10-14T16:38:20.557 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2023-10-14T16:38:20.558 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2023-10-14T16:38:20.579 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2023-10-14T16:38:20.580 DEBUG:teuthology.orchestra.run.smithi158:> /usr/sbin/getenforce 2023-10-14T16:38:20.620 INFO:teuthology.orchestra.run.smithi158.stdout:Permissive 2023-10-14T16:38:20.620 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi158.front.sepia.ceph.com': 'permissive'} 2023-10-14T16:38:20.621 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T16:38:20.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T16:38:20.647 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T16:38:20.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T16:38:20.673 DEBUG:teuthology.orchestra.run.smithi158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T16:38:20.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T16:38:20.699 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T16:38:20.700 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2023-10-14T16:38:20.726 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2023-10-14T16:38:20.751 DEBUG:teuthology.orchestra.run.smithi158:> sudo /usr/sbin/setenforce permissive 2023-10-14T16:38:20.783 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T16:38:20.792 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-14T16:38:20.797 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-14T16:38:20.919 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T16:38:20.937 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T16:38:20.939 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi155.front.sepia.ceph.com,smithi158.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T16:48:12.239 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com'), Remote(name='ubuntu@smithi158.front.sepia.ceph.com')] 2023-10-14T16:48:12.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-14T16:48:12.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:48:12.314 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-14T16:48:12.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-14T16:48:12.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-14T16:48:12.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:48:12.452 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-10-14T16:48:12.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-14T16:48:12.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-14T16:48:12.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T16:48:12.587 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-14T16:48:12.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-14T16:48:12.649 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T16:48:12.660 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T16:48:12.660 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T16:48:12.661 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T16:48:12.664 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T16:48:12.665 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T16:48:12.668 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T16:48:12.668 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T16:48:12.694 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T16:48:12.695 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T16:48:12.709 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T16:48:12.710 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T16:48:12.717 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T16:48:12.732 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T16:48:12.741 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2023-10-14T16:48:12.746 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2023-10-14T16:48:12.751 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2023-10-14T16:48:12.757 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2023-10-14T16:48:12.763 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: ntpd: command not found 2023-10-14T16:48:12.765 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T16:48:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T16:48:12.773 INFO:teuthology.orchestra.run.smithi158.stdout:506 Cannot talk to daemon 2023-10-14T16:48:12.778 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T16:48:12.786 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T16:48:12.787 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T16:48:12.801 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T16:48:12.848 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2023-10-14T16:48:12.850 INFO:teuthology.orchestra.run.smithi155.stdout:210 Number of sources = 4 2023-10-14T16:48:12.851 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T16:48:12.851 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2023-10-14T16:48:12.851 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T16:48:12.851 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T16:48:12.851 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T16:48:12.852 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T16:48:12.854 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-10-14T16:48:12.856 INFO:teuthology.orchestra.run.smithi008.stdout:210 Number of sources = 4 2023-10-14T16:48:12.856 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T16:48:12.856 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-10-14T16:48:12.856 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T16:48:12.857 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T16:48:12.857 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T16:48:12.857 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T16:48:12.865 INFO:teuthology.orchestra.run.smithi158.stderr:bash: ntpq: command not found 2023-10-14T16:48:12.868 INFO:teuthology.orchestra.run.smithi158.stdout:210 Number of sources = 4 2023-10-14T16:48:12.868 INFO:teuthology.orchestra.run.smithi158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T16:48:12.868 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================== 2023-10-14T16:48:12.869 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T16:48:12.869 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T16:48:12.869 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T16:48:12.869 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T16:48:12.870 INFO:teuthology.run_tasks:Running task install... 2023-10-14T16:48:12.878 DEBUG:teuthology.task.install:project ceph 2023-10-14T16:48:12.879 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}} 2023-10-14T16:48:12.879 DEBUG:teuthology.task.install:config {'cleanup': True, 'flavor': 'default', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'} 2023-10-14T16:48:12.879 INFO:teuthology.task.install:Using flavor: default 2023-10-14T16:48:12.886 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T16:48:12.886 INFO:teuthology.task.install:extra packages: [] 2023-10-14T16:48:12.887 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': True, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'tag': None, 'wait_for_package': False} 2023-10-14T16:48:12.888 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T16:48:12.890 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': True, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'tag': None, 'wait_for_package': False} 2023-10-14T16:48:12.891 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T16:48:12.892 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': True, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'tag': None, 'wait_for_package': False} 2023-10-14T16:48:12.893 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T16:48:13.044 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/ 2023-10-14T16:48:13.044 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1415.g9d6d32bb 2023-10-14T16:48:13.050 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/ 2023-10-14T16:48:13.050 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1415.g9d6d32bb 2023-10-14T16:48:13.119 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/ 2023-10-14T16:48:13.119 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1415.g9d6d32bb 2023-10-14T16:48:13.215 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T16:48:13.216 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:48:13.216 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T16:48:13.223 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T16:48:13.223 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-14T16:48:13.224 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T16:48:13.243 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-10-14T16:48:13.244 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T16:48:13.249 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-10-14T16:48:13.249 DEBUG:teuthology.orchestra.run.smithi158:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T16:48:13.287 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T16:48:13.288 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:48:13.288 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T16:48:13.311 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T16:48:13.314 DEBUG:teuthology.orchestra.run.smithi158:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T16:48:13.322 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-10-14T16:48:13.322 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T16:48:13.387 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T16:48:13.389 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T16:48:13.390 DEBUG:teuthology.orchestra.run.smithi158:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T16:48:13.453 INFO:teuthology.orchestra.run.smithi158.stdout:check_obsoletes = 1 2023-10-14T16:48:13.454 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum clean all 2023-10-14T16:48:13.455 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2023-10-14T16:48:13.456 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2023-10-14T16:48:13.462 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T16:48:13.525 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2023-10-14T16:48:13.526 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2023-10-14T16:48:13.842 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:48:13.867 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:48:13.918 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:48:15.210 INFO:teuthology.orchestra.run.smithi158.stdout:44 files removed 2023-10-14T16:48:15.236 INFO:teuthology.orchestra.run.smithi155.stdout:44 files removed 2023-10-14T16:48:15.264 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-radosgw 2023-10-14T16:48:15.293 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw 2023-10-14T16:48:15.460 INFO:teuthology.orchestra.run.smithi008.stdout:44 files removed 2023-10-14T16:48:15.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw 2023-10-14T16:48:15.615 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:48:15.641 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:48:15.888 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:48:17.660 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 232 kB/s | 78 kB 00:00 2023-10-14T16:48:17.682 INFO:teuthology.orchestra.run.smithi158.stdout:ceph packages for x86_64 153 kB/s | 78 kB 00:00 2023-10-14T16:48:17.950 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 37 kB/s | 9.1 kB 00:00 2023-10-14T16:48:17.965 INFO:teuthology.orchestra.run.smithi158.stdout:ceph noarch packages 38 kB/s | 9.1 kB 00:00 2023-10-14T16:48:17.986 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 209 kB/s | 78 kB 00:00 2023-10-14T16:48:18.224 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2023-10-14T16:48:18.237 INFO:teuthology.orchestra.run.smithi158.stdout:ceph source packages 6.1 kB/s | 1.5 kB 00:00 2023-10-14T16:48:18.332 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 30 kB/s | 9.1 kB 00:00 2023-10-14T16:48:18.352 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for python3-asyncssh owned by ceph 40 kB/s | 3.5 kB 00:00 2023-10-14T16:48:18.357 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph 33 kB/s | 3.5 kB 00:00 2023-10-14T16:48:18.614 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 5.9 kB/s | 1.5 kB 00:00 2023-10-14T16:48:18.725 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 44 kB/s | 3.5 kB 00:00 2023-10-14T16:48:19.068 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-14T16:48:20.120 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-14T16:48:22.369 INFO:teuthology.orchestra.run.smithi158.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-14T16:48:23.041 INFO:teuthology.orchestra.run.smithi158.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 MB/s | 38 MB 00:00 2023-10-14T16:48:23.642 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-14T16:48:24.775 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 MB/s | 33 MB 00:01 2023-10-14T16:48:28.909 INFO:teuthology.orchestra.run.smithi158.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 33 MB 00:00 2023-10-14T16:48:30.940 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 37 MB/s | 38 MB 00:01 2023-10-14T16:48:34.257 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 16 MB 00:15 2023-10-14T16:48:37.299 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:48:37.301 INFO:teuthology.orchestra.run.smithi158.stdout:==================================================================================================== 2023-10-14T16:48:37.302 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T16:48:37.302 INFO:teuthology.orchestra.run.smithi158.stdout:==================================================================================================== 2023-10-14T16:48:37.302 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:48:37.302 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T16:48:37.303 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrading: 2023-10-14T16:48:37.303 INFO:teuthology.orchestra.run.smithi158.stdout: librados2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T16:48:37.303 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.6 M 2023-10-14T16:48:37.303 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-10-14T16:48:37.304 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.2 M 2023-10-14T16:48:37.304 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 23 M 2023-10-14T16:48:37.304 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 24 k 2023-10-14T16:48:37.304 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T16:48:37.305 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 797 k 2023-10-14T16:48:37.305 INFO:teuthology.orchestra.run.smithi158.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T16:48:37.305 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T16:48:37.305 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 506 k 2023-10-14T16:48:37.305 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-14T16:48:37.306 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.6 M 2023-10-14T16:48:37.306 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T16:48:37.306 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T16:48:37.306 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 45 k 2023-10-14T16:48:37.306 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 115 k 2023-10-14T16:48:37.307 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 190 k 2023-10-14T16:48:37.307 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T16:48:37.307 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 370 k 2023-10-14T16:48:37.307 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 359 k 2023-10-14T16:48:37.307 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 107 k 2023-10-14T16:48:37.308 INFO:teuthology.orchestra.run.smithi158.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T16:48:37.308 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:48:37.308 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:48:37.308 INFO:teuthology.orchestra.run.smithi158.stdout:==================================================================================================== 2023-10-14T16:48:37.309 INFO:teuthology.orchestra.run.smithi158.stdout:Install 21 Packages 2023-10-14T16:48:37.309 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrade 2 Packages 2023-10-14T16:48:37.309 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:48:37.309 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 63 M 2023-10-14T16:48:37.310 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:48:37.516 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-14T16:48:38.185 INFO:teuthology.orchestra.run.smithi155.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 33 MB 00:00 2023-10-14T16:48:38.346 INFO:teuthology.orchestra.run.smithi158.stdout:(1/23): ceph-base-17.2.6-1415.g9d6d32bb.el8.x86 7.4 MB/s | 5.2 MB 00:00 2023-10-14T16:48:38.374 INFO:teuthology.orchestra.run.smithi158.stdout:(2/23): ceph-selinux-17.2.6-1415.g9d6d32bb.el8. 883 kB/s | 24 kB 00:00 2023-10-14T16:48:38.462 INFO:teuthology.orchestra.run.smithi158.stdout:(3/23): libcephfs2-17.2.6-1415.g9d6d32bb.el8.x8 8.9 MB/s | 797 kB 00:00 2023-10-14T16:48:38.553 INFO:teuthology.orchestra.run.smithi158.stdout:(4/23): libradosstriper1-17.2.6-1415.g9d6d32bb. 5.5 MB/s | 506 kB 00:00 2023-10-14T16:48:39.400 INFO:teuthology.orchestra.run.smithi158.stdout:(5/23): librgw2-17.2.6-1415.g9d6d32bb.el8.x86_6 6.6 MB/s | 5.6 MB 00:00 2023-10-14T16:48:39.459 INFO:teuthology.orchestra.run.smithi158.stdout:(6/23): python3-ceph-argparse-17.2.6-1415.g9d6d 754 kB/s | 45 kB 00:00 2023-10-14T16:48:39.622 INFO:teuthology.orchestra.run.smithi158.stdout:(7/23): ceph-radosgw-17.2.6-1415.g9d6d32bb.el8. 8.5 MB/s | 17 MB 00:01 2023-10-14T16:48:39.624 INFO:teuthology.orchestra.run.smithi158.stdout:(8/23): python3-ceph-common-17.2.6-1415.g9d6d32 704 kB/s | 115 kB 00:00 2023-10-14T16:48:39.659 INFO:teuthology.orchestra.run.smithi158.stdout:(9/23): python3-cephfs-17.2.6-1415.g9d6d32bb.el 5.1 MB/s | 190 kB 00:00 2023-10-14T16:48:39.672 INFO:teuthology.orchestra.run.smithi158.stdout:(10/23): python3-rados-17.2.6-1415.g9d6d32bb.el 7.6 MB/s | 370 kB 00:00 2023-10-14T16:48:39.713 INFO:teuthology.orchestra.run.smithi158.stdout:(11/23): python3-rbd-17.2.6-1415.g9d6d32bb.el8. 6.5 MB/s | 359 kB 00:00 2023-10-14T16:48:39.716 INFO:teuthology.orchestra.run.smithi158.stdout:(12/23): python3-rgw-17.2.6-1415.g9d6d32bb.el8. 2.4 MB/s | 107 kB 00:00 2023-10-14T16:48:40.125 INFO:teuthology.orchestra.run.smithi158.stdout:(13/23): ceph-common-17.2.6-1415.g9d6d32bb.el8. 9.5 MB/s | 23 MB 00:02 2023-10-14T16:48:40.126 INFO:teuthology.orchestra.run.smithi158.stdout:(14/23): liboath-2.6.2-3.el8.x86_64.rpm 143 kB/s | 59 kB 00:00 2023-10-14T16:48:40.128 INFO:teuthology.orchestra.run.smithi158.stdout:(15/23): gperftools-libs-2.7-9.el8.x86_64.rpm 739 kB/s | 306 kB 00:00 2023-10-14T16:48:40.325 INFO:teuthology.orchestra.run.smithi158.stdout:(16/23): libunwind-1.3.1-3.el8.x86_64.rpm 377 kB/s | 75 kB 00:00 2023-10-14T16:48:40.362 INFO:teuthology.orchestra.run.smithi158.stdout:(17/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 200 kB/s | 47 kB 00:00 2023-10-14T16:48:40.501 INFO:teuthology.orchestra.run.smithi158.stdout:(18/23): python3-prettytable-0.7.2-14.el8.noarc 250 kB/s | 44 kB 00:00 2023-10-14T16:48:40.533 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:48:40.536 INFO:teuthology.orchestra.run.smithi008.stdout:==================================================================================================== 2023-10-14T16:48:40.536 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T16:48:40.536 INFO:teuthology.orchestra.run.smithi008.stdout:==================================================================================================== 2023-10-14T16:48:40.537 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:48:40.537 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T16:48:40.537 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-10-14T16:48:40.537 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T16:48:40.538 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.6 M 2023-10-14T16:48:40.538 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-14T16:48:40.538 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.2 M 2023-10-14T16:48:40.538 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 23 M 2023-10-14T16:48:40.539 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 24 k 2023-10-14T16:48:40.539 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T16:48:40.539 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 797 k 2023-10-14T16:48:40.540 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T16:48:40.540 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T16:48:40.540 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 506 k 2023-10-14T16:48:40.540 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-14T16:48:40.541 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.6 M 2023-10-14T16:48:40.541 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T16:48:40.541 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T16:48:40.542 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 45 k 2023-10-14T16:48:40.542 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 115 k 2023-10-14T16:48:40.542 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 190 k 2023-10-14T16:48:40.542 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T16:48:40.543 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 370 k 2023-10-14T16:48:40.543 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 359 k 2023-10-14T16:48:40.543 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 107 k 2023-10-14T16:48:40.543 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T16:48:40.543 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:48:40.544 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:48:40.544 INFO:teuthology.orchestra.run.smithi008.stdout:==================================================================================================== 2023-10-14T16:48:40.544 INFO:teuthology.orchestra.run.smithi008.stdout:Install 21 Packages 2023-10-14T16:48:40.544 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 2 Packages 2023-10-14T16:48:40.544 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:48:40.545 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 63 M 2023-10-14T16:48:40.545 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:48:40.558 INFO:teuthology.orchestra.run.smithi158.stdout:(19/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-10-14T16:48:40.708 INFO:teuthology.orchestra.run.smithi158.stdout:(20/23): librdkafka-0.11.4-1.el8.x86_64.rpm 1.7 MB/s | 353 kB 00:00 2023-10-14T16:48:40.930 INFO:teuthology.orchestra.run.smithi158.stdout:(21/23): librados2-17.2.6-1415.g9d6d32bb.el8.x8 9.3 MB/s | 3.5 MB 00:00 2023-10-14T16:48:40.938 INFO:teuthology.orchestra.run.smithi158.stdout:(22/23): thrift-0.13.0-2.el8.x86_64.rpm 2.1 MB/s | 1.7 MB 00:00 2023-10-14T16:48:41.133 INFO:teuthology.orchestra.run.smithi158.stdout:(23/23): librbd1-17.2.6-1415.g9d6d32bb.el8.x86_ 8.4 MB/s | 3.6 MB 00:00 2023-10-14T16:48:41.139 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:48:41.140 INFO:teuthology.orchestra.run.smithi158.stdout:Total 17 MB/s | 63 MB 00:03 2023-10-14T16:48:41.143 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:48:41.189 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:48:41.189 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:48:41.961 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:48:42.012 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:48:42.175 INFO:teuthology.orchestra.run.smithi008.stdout:(1/23): ceph-base-17.2.6-1415.g9d6d32bb.el8.x86 4.0 MB/s | 5.2 MB 00:01 2023-10-14T16:48:42.229 INFO:teuthology.orchestra.run.smithi008.stdout:(2/23): ceph-selinux-17.2.6-1415.g9d6d32bb.el8. 448 kB/s | 24 kB 00:00 2023-10-14T16:48:42.774 INFO:teuthology.orchestra.run.smithi008.stdout:(3/23): libcephfs2-17.2.6-1415.g9d6d32bb.el8.x8 1.4 MB/s | 797 kB 00:00 2023-10-14T16:48:43.054 INFO:teuthology.orchestra.run.smithi008.stdout:(4/23): libradosstriper1-17.2.6-1415.g9d6d32bb. 1.8 MB/s | 506 kB 00:00 2023-10-14T16:48:43.137 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:48:43.371 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-10-14T16:48:43.444 INFO:teuthology.orchestra.run.smithi155.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 89 MB/s | 38 MB 00:00 2023-10-14T16:48:43.747 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-10-14T16:48:44.004 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/25 2023-10-14T16:48:44.114 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/25 2023-10-14T16:48:44.293 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/25 2023-10-14T16:48:44.579 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/25 2023-10-14T16:48:44.753 INFO:teuthology.orchestra.run.smithi008.stdout:(5/23): ceph-radosgw-17.2.6-1415.g9d6d32bb.el8. 4.4 MB/s | 17 MB 00:03 2023-10-14T16:48:44.770 INFO:teuthology.orchestra.run.smithi008.stdout:(6/23): librgw2-17.2.6-1415.g9d6d32bb.el8.x86_6 3.2 MB/s | 5.6 MB 00:01 2023-10-14T16:48:44.821 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/25 2023-10-14T16:48:44.824 INFO:teuthology.orchestra.run.smithi008.stdout:(7/23): python3-ceph-argparse-17.2.6-1415.g9d6d 630 kB/s | 45 kB 00:00 2023-10-14T16:48:44.831 INFO:teuthology.orchestra.run.smithi008.stdout:(8/23): python3-ceph-common-17.2.6-1415.g9d6d32 1.9 MB/s | 115 kB 00:00 2023-10-14T16:48:44.906 INFO:teuthology.orchestra.run.smithi008.stdout:(9/23): python3-cephfs-17.2.6-1415.g9d6d32bb.el 2.3 MB/s | 190 kB 00:00 2023-10-14T16:48:44.961 INFO:teuthology.orchestra.run.smithi008.stdout:(10/23): python3-rados-17.2.6-1415.g9d6d32bb.el 2.8 MB/s | 370 kB 00:00 2023-10-14T16:48:44.995 INFO:teuthology.orchestra.run.smithi008.stdout:(11/23): python3-rbd-17.2.6-1415.g9d6d32bb.el8. 4.0 MB/s | 359 kB 00:00 2023-10-14T16:48:45.035 INFO:teuthology.orchestra.run.smithi008.stdout:(12/23): python3-rgw-17.2.6-1415.g9d6d32bb.el8. 1.4 MB/s | 107 kB 00:00 2023-10-14T16:48:45.198 INFO:teuthology.orchestra.run.smithi008.stdout:(13/23): ceph-common-17.2.6-1415.g9d6d32bb.el8. 5.5 MB/s | 23 MB 00:04 2023-10-14T16:48:45.216 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/25 2023-10-14T16:48:45.262 INFO:teuthology.orchestra.run.smithi008.stdout:(14/23): liboath-2.6.2-3.el8.x86_64.rpm 259 kB/s | 59 kB 00:00 2023-10-14T16:48:45.271 INFO:teuthology.orchestra.run.smithi008.stdout:(15/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-10-14T16:48:45.321 INFO:teuthology.orchestra.run.smithi008.stdout:(16/23): libunwind-1.3.1-3.el8.x86_64.rpm 614 kB/s | 75 kB 00:00 2023-10-14T16:48:45.423 INFO:teuthology.orchestra.run.smithi008.stdout:(17/23): python3-prettytable-0.7.2-14.el8.noarc 288 kB/s | 44 kB 00:00 2023-10-14T16:48:45.448 INFO:teuthology.orchestra.run.smithi008.stdout:(18/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2023-10-14T16:48:45.462 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/25 2023-10-14T16:48:45.523 INFO:teuthology.orchestra.run.smithi008.stdout:(19/23): librdkafka-0.11.4-1.el8.x86_64.rpm 3.5 MB/s | 353 kB 00:00 2023-10-14T16:48:45.532 INFO:teuthology.orchestra.run.smithi008.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 6.4 MB/s | 1.7 MB 00:00 2023-10-14T16:48:45.558 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/25 2023-10-14T16:48:45.607 INFO:teuthology.orchestra.run.smithi008.stdout:(21/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 294 kB/s | 47 kB 00:00 2023-10-14T16:48:45.787 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 7/25 2023-10-14T16:48:45.838 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 7/25 2023-10-14T16:48:46.180 INFO:teuthology.orchestra.run.smithi008.stdout:(22/23): librbd1-17.2.6-1415.g9d6d32bb.el8.x86_ 5.5 MB/s | 3.6 MB 00:00 2023-10-14T16:48:46.190 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-10-14T16:48:46.452 INFO:teuthology.orchestra.run.smithi008.stdout:(23/23): librados2-17.2.6-1415.g9d6d32bb.el8.x8 3.7 MB/s | 3.5 MB 00:00 2023-10-14T16:48:46.456 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:48:46.456 INFO:teuthology.orchestra.run.smithi008.stdout:Total 11 MB/s | 63 MB 00:05 2023-10-14T16:48:46.461 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:48:46.514 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:48:46.514 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:48:46.897 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/25 2023-10-14T16:48:47.103 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/25 2023-10-14T16:48:47.184 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/25 2023-10-14T16:48:47.330 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:48:47.335 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:48:47.340 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8. 11/25 2023-10-14T16:48:47.532 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 12/25 2023-10-14T16:48:47.780 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/25 2023-10-14T16:48:48.032 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 14/25 2023-10-14T16:48:48.187 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 15/25 2023-10-14T16:48:48.289 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 15/25 2023-10-14T16:48:48.456 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-10-14T16:48:48.547 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:48:48.672 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/25 2023-10-14T16:48:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-10-14T16:48:48.966 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-10-14T16:48:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-10-14T16:48:49.179 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x8 19/25 2023-10-14T16:48:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/25 2023-10-14T16:48:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/25 2023-10-14T16:48:49.844 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/25 2023-10-14T16:48:50.135 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/25 2023-10-14T16:48:50.379 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/25 2023-10-14T16:48:50.787 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/25 2023-10-14T16:48:50.995 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/25 2023-10-14T16:48:51.053 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/25 2023-10-14T16:48:51.283 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2023-10-14T16:48:51.488 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2023-10-14T16:48:51.721 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2023-10-14T16:48:52.405 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/25 2023-10-14T16:48:52.762 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/25 2023-10-14T16:48:52.831 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/25 2023-10-14T16:48:52.936 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:48:52.939 INFO:teuthology.orchestra.run.smithi155.stdout:==================================================================================================== 2023-10-14T16:48:52.939 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T16:48:52.939 INFO:teuthology.orchestra.run.smithi155.stdout:==================================================================================================== 2023-10-14T16:48:52.939 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:48:52.939 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T16:48:52.940 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2023-10-14T16:48:52.940 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T16:48:52.940 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.6 M 2023-10-14T16:48:52.940 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-10-14T16:48:52.941 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.2 M 2023-10-14T16:48:52.941 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 23 M 2023-10-14T16:48:52.941 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 24 k 2023-10-14T16:48:52.941 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T16:48:52.941 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 797 k 2023-10-14T16:48:52.942 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T16:48:52.942 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T16:48:52.942 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 506 k 2023-10-14T16:48:52.942 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-14T16:48:52.942 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.6 M 2023-10-14T16:48:52.943 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T16:48:52.943 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T16:48:52.943 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 45 k 2023-10-14T16:48:52.943 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 115 k 2023-10-14T16:48:52.943 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 190 k 2023-10-14T16:48:52.944 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T16:48:52.944 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 370 k 2023-10-14T16:48:52.944 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 359 k 2023-10-14T16:48:52.944 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 107 k 2023-10-14T16:48:52.944 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T16:48:52.945 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:48:52.945 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:48:52.945 INFO:teuthology.orchestra.run.smithi155.stdout:==================================================================================================== 2023-10-14T16:48:52.945 INFO:teuthology.orchestra.run.smithi155.stdout:Install 21 Packages 2023-10-14T16:48:52.945 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 2 Packages 2023-10-14T16:48:52.946 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:48:52.946 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 63 M 2023-10-14T16:48:52.946 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:48:52.967 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8. 11/25 2023-10-14T16:48:53.175 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 12/25 2023-10-14T16:48:53.443 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/25 2023-10-14T16:48:53.670 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 14/25 2023-10-14T16:48:53.870 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 15/25 2023-10-14T16:48:53.939 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 15/25 2023-10-14T16:48:54.118 INFO:teuthology.orchestra.run.smithi155.stdout:(1/23): ceph-radosgw-17.2.6-1415.g9d6d32bb.el8. 16 MB/s | 17 MB 00:01 2023-10-14T16:48:54.141 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-10-14T16:48:54.145 INFO:teuthology.orchestra.run.smithi155.stdout:(2/23): ceph-selinux-17.2.6-1415.g9d6d32bb.el8. 923 kB/s | 24 kB 00:00 2023-10-14T16:48:54.191 INFO:teuthology.orchestra.run.smithi155.stdout:(3/23): libcephfs2-17.2.6-1415.g9d6d32bb.el8.x8 17 MB/s | 797 kB 00:00 2023-10-14T16:48:54.230 INFO:teuthology.orchestra.run.smithi155.stdout:(4/23): libradosstriper1-17.2.6-1415.g9d6d32bb. 13 MB/s | 506 kB 00:00 2023-10-14T16:48:54.341 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 20/25 2023-10-14T16:48:54.369 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/25 2023-10-14T16:48:54.514 INFO:teuthology.orchestra.run.smithi155.stdout:(5/23): ceph-base-17.2.6-1415.g9d6d32bb.el8.x86 3.6 MB/s | 5.2 MB 00:01 2023-10-14T16:48:54.532 INFO:teuthology.orchestra.run.smithi155.stdout:(6/23): librgw2-17.2.6-1415.g9d6d32bb.el8.x86_6 18 MB/s | 5.6 MB 00:00 2023-10-14T16:48:54.551 INFO:teuthology.orchestra.run.smithi155.stdout:(7/23): python3-ceph-argparse-17.2.6-1415.g9d6d 1.2 MB/s | 45 kB 00:00 2023-10-14T16:48:54.554 INFO:teuthology.orchestra.run.smithi155.stdout:(8/23): python3-ceph-common-17.2.6-1415.g9d6d32 5.1 MB/s | 115 kB 00:00 2023-10-14T16:48:54.585 INFO:teuthology.orchestra.run.smithi155.stdout:(9/23): python3-rados-17.2.6-1415.g9d6d32bb.el8 12 MB/s | 370 kB 00:00 2023-10-14T16:48:54.586 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 20/25 2023-10-14T16:48:54.589 INFO:teuthology.orchestra.run.smithi155.stdout:(10/23): python3-cephfs-17.2.6-1415.g9d6d32bb.e 4.9 MB/s | 190 kB 00:00 2023-10-14T16:48:54.614 INFO:teuthology.orchestra.run.smithi155.stdout:(11/23): python3-rbd-17.2.6-1415.g9d6d32bb.el8. 12 MB/s | 359 kB 00:00 2023-10-14T16:48:54.633 INFO:teuthology.orchestra.run.smithi155.stdout:(12/23): python3-rgw-17.2.6-1415.g9d6d32bb.el8. 2.4 MB/s | 107 kB 00:00 2023-10-14T16:48:54.664 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-10-14T16:48:54.881 INFO:teuthology.orchestra.run.smithi155.stdout:(13/23): liboath-2.6.2-3.el8.x86_64.rpm 237 kB/s | 59 kB 00:00 2023-10-14T16:48:54.887 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x8 19/25 2023-10-14T16:48:54.960 INFO:teuthology.orchestra.run.smithi155.stdout:(14/23): libunwind-1.3.1-3.el8.x86_64.rpm 947 kB/s | 75 kB 00:00 2023-10-14T16:48:54.987 INFO:teuthology.orchestra.run.smithi155.stdout:(15/23): gperftools-libs-2.7-9.el8.x86_64.rpm 822 kB/s | 306 kB 00:00 2023-10-14T16:48:55.115 INFO:teuthology.orchestra.run.smithi155.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 343 kB/s | 44 kB 00:00 2023-10-14T16:48:55.178 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 20/25 2023-10-14T16:48:55.206 INFO:teuthology.orchestra.run.smithi155.stdout:(17/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-10-14T16:48:55.225 INFO:teuthology.orchestra.run.smithi155.stdout:(18/23): thrift-0.13.0-2.el8.x86_64.rpm 6.5 MB/s | 1.7 MB 00:00 2023-10-14T16:48:55.293 INFO:teuthology.orchestra.run.smithi155.stdout:(19/23): librdkafka-0.11.4-1.el8.x86_64.rpm 4.0 MB/s | 353 kB 00:00 2023-10-14T16:48:55.358 INFO:teuthology.orchestra.run.smithi155.stdout:(20/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 353 kB/s | 47 kB 00:00 2023-10-14T16:48:55.478 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 21/25 2023-10-14T16:48:55.576 INFO:teuthology.orchestra.run.smithi155.stdout:(21/23): librbd1-17.2.6-1415.g9d6d32bb.el8.x86_ 16 MB/s | 3.6 MB 00:00 2023-10-14T16:48:55.597 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 21/25 2023-10-14T16:48:55.752 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 22/25 2023-10-14T16:48:55.767 INFO:teuthology.orchestra.run.smithi155.stdout:(22/23): librados2-17.2.6-1415.g9d6d32bb.el8.x8 7.3 MB/s | 3.5 MB 00:00 2023-10-14T16:48:56.874 INFO:teuthology.orchestra.run.smithi155.stdout:(23/23): ceph-common-17.2.6-1415.g9d6d32bb.el8. 6.2 MB/s | 23 MB 00:03 2023-10-14T16:48:56.879 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:48:56.879 INFO:teuthology.orchestra.run.smithi155.stdout:Total 16 MB/s | 63 MB 00:03 2023-10-14T16:48:56.883 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:48:56.928 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:48:56.929 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:48:57.717 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:48:57.721 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:48:58.794 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:48:59.047 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-10-14T16:48:59.442 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-10-14T16:48:59.688 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/25 2023-10-14T16:48:59.785 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/25 2023-10-14T16:48:59.986 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/25 2023-10-14T16:49:00.271 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/25 2023-10-14T16:49:00.331 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 20/25 2023-10-14T16:49:00.463 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/25 2023-10-14T16:49:00.553 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 20/25 2023-10-14T16:49:00.863 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/25 2023-10-14T16:49:01.079 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/25 2023-10-14T16:49:01.134 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/25 2023-10-14T16:49:01.184 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 20/25 2023-10-14T16:49:01.379 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2023-10-14T16:49:01.494 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 21/25 2023-10-14T16:49:01.584 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 21/25 2023-10-14T16:49:01.596 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2023-10-14T16:49:01.761 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 22/25 2023-10-14T16:49:01.818 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2023-10-14T16:49:02.531 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/25 2023-10-14T16:49:02.696 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/25 2023-10-14T16:49:02.765 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/25 2023-10-14T16:49:02.907 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8. 11/25 2023-10-14T16:49:03.124 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 12/25 2023-10-14T16:49:03.340 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/25 2023-10-14T16:49:03.566 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 14/25 2023-10-14T16:49:03.762 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 15/25 2023-10-14T16:49:03.837 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 15/25 2023-10-14T16:49:04.006 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-10-14T16:49:04.231 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/25 2023-10-14T16:49:04.476 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-10-14T16:49:04.671 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x8 19/25 2023-10-14T16:49:09.679 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 20/25 2023-10-14T16:49:09.945 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 20/25 2023-10-14T16:49:10.538 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 20/25 2023-10-14T16:49:10.819 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 21/25 2023-10-14T16:49:10.913 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 21/25 2023-10-14T16:49:11.103 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 22/25 2023-10-14T16:49:13.806 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 22/25 2023-10-14T16:49:13.807 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /sys 2023-10-14T16:49:13.807 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /proc 2023-10-14T16:49:13.807 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-10-14T16:49:13.807 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /run 2023-10-14T16:49:13.808 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /mnt 2023-10-14T16:49:13.808 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /var/tmp 2023-10-14T16:49:13.808 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /home 2023-10-14T16:49:13.808 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /tmp 2023-10-14T16:49:13.808 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-10-14T16:49:13.809 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:49:15.608 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/25 2023-10-14T16:49:15.697 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/25 2023-10-14T16:49:15.697 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-10-14T16:49:15.910 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-10-14T16:49:15.910 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-10-14T16:49:16.700 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-10-14T16:49:16.701 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/25 2023-10-14T16:49:16.701 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/25 2023-10-14T16:49:16.701 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/25 2023-10-14T16:49:16.701 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/25 2023-10-14T16:49:16.701 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/25 2023-10-14T16:49:16.702 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 6/25 2023-10-14T16:49:16.702 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/25 2023-10-14T16:49:16.702 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8. 8/25 2023-10-14T16:49:16.702 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x8 9/25 2023-10-14T16:49:16.702 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/25 2023-10-14T16:49:16.703 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/25 2023-10-14T16:49:16.703 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 12/25 2023-10-14T16:49:16.703 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/25 2023-10-14T16:49:16.703 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2023-10-14T16:49:16.703 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2023-10-14T16:49:16.704 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2023-10-14T16:49:16.704 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2023-10-14T16:49:16.704 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 18/25 2023-10-14T16:49:16.704 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 19/25 2023-10-14T16:49:16.705 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 20/25 2023-10-14T16:49:16.705 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 21/25 2023-10-14T16:49:16.705 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 22/25 2023-10-14T16:49:16.705 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-10-14T16:49:16.705 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/25 2023-10-14T16:49:18.153 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-10-14T16:49:18.154 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:00:50 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:49:20.292 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 22/25 2023-10-14T16:49:20.292 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2023-10-14T16:49:20.292 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2023-10-14T16:49:20.292 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-10-14T16:49:20.293 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /run 2023-10-14T16:49:20.293 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2023-10-14T16:49:20.293 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2023-10-14T16:49:20.293 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2023-10-14T16:49:20.294 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2023-10-14T16:49:20.294 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-10-14T16:49:20.294 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:49:22.141 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/25 2023-10-14T16:49:22.235 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/25 2023-10-14T16:49:22.236 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-10-14T16:49:22.444 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-10-14T16:49:22.445 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-10-14T16:49:23.245 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-10-14T16:49:23.245 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/25 2023-10-14T16:49:23.245 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/25 2023-10-14T16:49:23.245 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/25 2023-10-14T16:49:23.246 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/25 2023-10-14T16:49:23.246 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/25 2023-10-14T16:49:23.246 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 6/25 2023-10-14T16:49:23.246 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/25 2023-10-14T16:49:23.246 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8. 8/25 2023-10-14T16:49:23.247 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x8 9/25 2023-10-14T16:49:23.247 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/25 2023-10-14T16:49:23.247 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/25 2023-10-14T16:49:23.247 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 12/25 2023-10-14T16:49:23.247 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/25 2023-10-14T16:49:23.248 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2023-10-14T16:49:23.248 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2023-10-14T16:49:23.248 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2023-10-14T16:49:23.248 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2023-10-14T16:49:23.248 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-10-14T16:49:23.249 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 19/25 2023-10-14T16:49:23.249 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 20/25 2023-10-14T16:49:23.249 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 21/25 2023-10-14T16:49:23.249 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 22/25 2023-10-14T16:49:23.249 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-10-14T16:49:23.250 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/25 2023-10-14T16:49:23.805 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:49:23.922 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:49:23.922 INFO:teuthology.orchestra.run.smithi158.stdout:Upgraded: 2023-10-14T16:49:23.922 INFO:teuthology.orchestra.run.smithi158.stdout: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.923 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.923 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:49:23.923 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.923 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.923 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.924 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.924 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T16:49:23.924 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.924 INFO:teuthology.orchestra.run.smithi158.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T16:49:23.924 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T16:49:23.925 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.925 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-14T16:49:23.925 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.925 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T16:49:23.926 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T16:49:23.926 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.926 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.926 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.926 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T16:49:23.927 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.927 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.927 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:23.927 INFO:teuthology.orchestra.run.smithi158.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T16:49:23.927 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:49:23.928 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:49:24.063 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-test 2023-10-14T16:49:24.432 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:49:24.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-10-14T16:49:24.733 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:00:54 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:49:26.185 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:00:58 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:49:28.043 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:49:28.044 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================================ 2023-10-14T16:49:28.044 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T16:49:28.044 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================================ 2023-10-14T16:49:28.045 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:49:28.045 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 52 M 2023-10-14T16:49:28.045 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-10-14T16:49:28.045 INFO:teuthology.orchestra.run.smithi158.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-14T16:49:28.045 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T16:49:28.046 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T16:49:28.046 INFO:teuthology.orchestra.run.smithi158.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-14T16:49:28.046 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T16:49:28.046 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:49:28.046 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:49:28.047 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================================ 2023-10-14T16:49:28.047 INFO:teuthology.orchestra.run.smithi158.stdout:Install 6 Packages 2023-10-14T16:49:28.047 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:49:28.048 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 53 M 2023-10-14T16:49:28.048 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 233 M 2023-10-14T16:49:28.048 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:49:28.050 INFO:teuthology.orchestra.run.smithi158.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 17 MB/s | 70 kB 00:00 2023-10-14T16:49:28.212 INFO:teuthology.orchestra.run.smithi158.stdout:(2/6): jq-1.5-12.el8.x86_64.rpm 997 kB/s | 161 kB 00:00 2023-10-14T16:49:28.431 INFO:teuthology.orchestra.run.smithi158.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 858 kB/s | 187 kB 00:00 2023-10-14T16:49:28.529 INFO:teuthology.orchestra.run.smithi158.stdout:(4/6): libcephsqlite-17.2.6-1415.g9d6d32bb.el8. 360 kB/s | 174 kB 00:00 2023-10-14T16:49:28.646 INFO:teuthology.orchestra.run.smithi158.stdout:(5/6): socat-1.7.3.3-2.el8.x86_64.rpm 1.4 MB/s | 302 kB 00:00 2023-10-14T16:49:28.886 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 22/25 2023-10-14T16:49:28.887 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2023-10-14T16:49:28.887 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2023-10-14T16:49:28.887 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2023-10-14T16:49:28.887 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /run 2023-10-14T16:49:28.887 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2023-10-14T16:49:28.888 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2023-10-14T16:49:28.888 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2023-10-14T16:49:28.888 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2023-10-14T16:49:28.888 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2023-10-14T16:49:28.888 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:49:29.483 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:49:29.597 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:49:29.597 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-10-14T16:49:29.597 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.597 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.598 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:49:29.598 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.598 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.598 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.598 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.599 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T16:49:29.599 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.599 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T16:49:29.599 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T16:49:29.599 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.600 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-14T16:49:29.600 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.600 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T16:49:29.600 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T16:49:29.600 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.601 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.601 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.601 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T16:49:29.601 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.601 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.602 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:29.602 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T16:49:29.602 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:49:29.602 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:49:29.741 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-test 2023-10-14T16:49:30.129 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:49:30.658 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/25 2023-10-14T16:49:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/25 2023-10-14T16:49:30.745 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-10-14T16:49:30.960 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-10-14T16:49:30.961 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-10-14T16:49:31.787 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-10-14T16:49:31.787 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/25 2023-10-14T16:49:31.788 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/25 2023-10-14T16:49:31.788 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/25 2023-10-14T16:49:31.788 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/25 2023-10-14T16:49:31.788 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/25 2023-10-14T16:49:31.788 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 6/25 2023-10-14T16:49:31.789 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/25 2023-10-14T16:49:31.789 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8. 8/25 2023-10-14T16:49:31.789 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x8 9/25 2023-10-14T16:49:31.789 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/25 2023-10-14T16:49:31.789 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/25 2023-10-14T16:49:31.790 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 12/25 2023-10-14T16:49:31.790 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/25 2023-10-14T16:49:31.790 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2023-10-14T16:49:31.790 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2023-10-14T16:49:31.790 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2023-10-14T16:49:31.791 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2023-10-14T16:49:31.791 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-10-14T16:49:31.791 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 19/25 2023-10-14T16:49:31.791 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 20/25 2023-10-14T16:49:31.791 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 21/25 2023-10-14T16:49:31.791 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 22/25 2023-10-14T16:49:31.792 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-10-14T16:49:31.792 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/25 2023-10-14T16:49:32.253 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:02 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:49:33.350 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-10-14T16:49:33.351 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:50 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:49:34.200 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:49:34.201 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2023-10-14T16:49:34.201 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T16:49:34.201 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2023-10-14T16:49:34.201 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:49:34.202 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 52 M 2023-10-14T16:49:34.202 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-14T16:49:34.202 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-14T16:49:34.202 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T16:49:34.202 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T16:49:34.203 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-14T16:49:34.203 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T16:49:34.203 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:49:34.203 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:49:34.203 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================ 2023-10-14T16:49:34.204 INFO:teuthology.orchestra.run.smithi008.stdout:Install 6 Packages 2023-10-14T16:49:34.204 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:49:34.205 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 53 M 2023-10-14T16:49:34.205 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 233 M 2023-10-14T16:49:34.205 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:49:34.207 INFO:teuthology.orchestra.run.smithi008.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 20 MB/s | 70 kB 00:00 2023-10-14T16:49:34.344 INFO:teuthology.orchestra.run.smithi008.stdout:(2/6): jq-1.5-12.el8.x86_64.rpm 1.1 MB/s | 161 kB 00:00 2023-10-14T16:49:34.412 INFO:teuthology.orchestra.run.smithi008.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2023-10-14T16:49:34.533 INFO:teuthology.orchestra.run.smithi008.stdout:(4/6): socat-1.7.3.3-2.el8.x86_64.rpm 2.4 MB/s | 302 kB 00:00 2023-10-14T16:49:34.562 INFO:teuthology.orchestra.run.smithi008.stdout:(5/6): libcephsqlite-17.2.6-1415.g9d6d32bb.el8. 488 kB/s | 174 kB 00:00 2023-10-14T16:49:38.003 INFO:teuthology.orchestra.run.smithi008.stdout:(6/6): ceph-test-17.2.6-1415.g9d6d32bb.el8.x86_ 14 MB/s | 52 MB 00:03 2023-10-14T16:49:38.006 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:49:38.007 INFO:teuthology.orchestra.run.smithi008.stdout:Total 14 MB/s | 53 MB 00:03 2023-10-14T16:49:38.011 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:49:38.037 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:49:38.038 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:49:38.442 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:49:38.447 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:49:38.588 INFO:teuthology.orchestra.run.smithi158.stdout:(6/6): ceph-test-17.2.6-1415.g9d6d32bb.el8.x86_ 4.9 MB/s | 52 MB 00:10 2023-10-14T16:49:38.591 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:49:38.591 INFO:teuthology.orchestra.run.smithi158.stdout:Total 5.0 MB/s | 53 MB 00:10 2023-10-14T16:49:38.595 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:49:38.618 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:49:38.619 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:49:38.990 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:49:38.994 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:49:39.025 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:49:39.235 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 1/6 2023-10-14T16:49:39.456 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 2/6 2023-10-14T16:49:39.524 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:49:39.534 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 2/6 2023-10-14T16:49:39.715 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 1/6 2023-10-14T16:49:39.732 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.5-12.el8.x86_64 3/6 2023-10-14T16:49:39.881 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2023-10-14T16:49:39.928 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 2/6 2023-10-14T16:49:40.001 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 2/6 2023-10-14T16:49:40.056 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T16:49:40.206 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : jq-1.5-12.el8.x86_64 3/6 2023-10-14T16:49:40.410 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2023-10-14T16:49:40.533 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:49:40.578 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T16:49:40.643 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:49:40.643 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2023-10-14T16:49:40.644 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.644 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.644 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:49:40.644 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.644 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.645 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.645 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.645 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T16:49:40.645 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.645 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T16:49:40.646 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T16:49:40.646 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.646 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-14T16:49:40.646 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.647 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T16:49:40.647 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T16:49:40.647 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.647 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.647 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.648 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T16:49:40.648 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.648 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.648 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:40.649 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T16:49:40.649 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:49:40.649 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:49:40.796 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-test 2023-10-14T16:49:41.167 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:49:43.149 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:00 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:49:45.058 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:49:45.059 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================ 2023-10-14T16:49:45.060 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T16:49:45.060 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================ 2023-10-14T16:49:45.060 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:49:45.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 52 M 2023-10-14T16:49:45.060 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-10-14T16:49:45.061 INFO:teuthology.orchestra.run.smithi155.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-14T16:49:45.061 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T16:49:45.061 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T16:49:45.061 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-14T16:49:45.062 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T16:49:45.062 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:49:45.062 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:49:45.062 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================ 2023-10-14T16:49:45.063 INFO:teuthology.orchestra.run.smithi155.stdout:Install 6 Packages 2023-10-14T16:49:45.063 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:49:45.063 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 53 M 2023-10-14T16:49:45.064 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 233 M 2023-10-14T16:49:45.064 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:49:45.065 INFO:teuthology.orchestra.run.smithi155.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-10-14T16:49:45.203 INFO:teuthology.orchestra.run.smithi155.stdout:(2/6): jq-1.5-12.el8.x86_64.rpm 1.1 MB/s | 161 kB 00:00 2023-10-14T16:49:45.223 INFO:teuthology.orchestra.run.smithi155.stdout:(3/6): libcephsqlite-17.2.6-1415.g9d6d32bb.el8. 1.1 MB/s | 174 kB 00:00 2023-10-14T16:49:45.307 INFO:teuthology.orchestra.run.smithi155.stdout:(4/6): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-10-14T16:49:45.357 INFO:teuthology.orchestra.run.smithi155.stdout:(5/6): socat-1.7.3.3-2.el8.x86_64.rpm 2.2 MB/s | 302 kB 00:00 2023-10-14T16:49:45.424 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T16:49:45.616 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T16:49:45.730 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/6 2023-10-14T16:49:45.917 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/6 2023-10-14T16:49:46.006 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/6 2023-10-14T16:49:46.007 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/6 2023-10-14T16:49:46.007 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/6 2023-10-14T16:49:46.007 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2023-10-14T16:49:46.007 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2023-10-14T16:49:46.008 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2023-10-14T16:49:46.195 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/6 2023-10-14T16:49:46.195 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/6 2023-10-14T16:49:46.195 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/6 2023-10-14T16:49:46.195 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2023-10-14T16:49:46.196 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2023-10-14T16:49:46.196 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2023-10-14T16:49:47.183 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 6/6 2023-10-14T16:49:47.184 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:17 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:49:47.280 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 6/6 2023-10-14T16:49:47.280 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:01:19 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:49:47.668 INFO:teuthology.orchestra.run.smithi155.stdout:(6/6): ceph-test-17.2.6-1415.g9d6d32bb.el8.x86_ 20 MB/s | 52 MB 00:02 2023-10-14T16:49:47.671 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:49:47.672 INFO:teuthology.orchestra.run.smithi155.stdout:Total 20 MB/s | 53 MB 00:02 2023-10-14T16:49:47.675 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:49:47.699 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:49:47.699 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:49:48.049 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:49:48.053 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:49:48.574 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:49:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 1/6 2023-10-14T16:49:49.014 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 2/6 2023-10-14T16:49:49.094 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 2/6 2023-10-14T16:49:49.268 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : jq-1.5-12.el8.x86_64 3/6 2023-10-14T16:49:49.504 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2023-10-14T16:49:49.689 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T16:49:52.588 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:49:52.685 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:49:52.686 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:49:52.686 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:52.686 INFO:teuthology.orchestra.run.smithi158.stdout: jq-1.5-12.el8.x86_64 2023-10-14T16:49:52.686 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:52.687 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T16:49:52.687 INFO:teuthology.orchestra.run.smithi158.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-14T16:49:52.687 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T16:49:52.687 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:49:52.687 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:49:52.813 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph 2023-10-14T16:49:53.167 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:49:53.673 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:49:53.778 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:49:53.779 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:49:53.779 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:53.779 INFO:teuthology.orchestra.run.smithi008.stdout: jq-1.5-12.el8.x86_64 2023-10-14T16:49:53.779 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:49:53.779 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T16:49:53.780 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-14T16:49:53.780 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T16:49:53.780 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:49:53.780 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:49:53.952 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph 2023-10-14T16:49:54.330 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:49:54.726 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T16:49:54.968 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:01:26 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:49:54.987 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/6 2023-10-14T16:49:55.261 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/6 2023-10-14T16:49:55.261 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/6 2023-10-14T16:49:55.262 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/6 2023-10-14T16:49:55.262 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2023-10-14T16:49:55.262 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2023-10-14T16:49:55.262 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2023-10-14T16:49:56.184 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:26 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:49:56.448 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 6/6 2023-10-14T16:49:56.448 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:13 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:49:56.859 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:49:56.862 INFO:teuthology.orchestra.run.smithi158.stdout:======================================================================================================= 2023-10-14T16:49:56.862 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T16:49:56.862 INFO:teuthology.orchestra.run.smithi158.stdout:======================================================================================================= 2023-10-14T16:49:56.862 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:49:56.863 INFO:teuthology.orchestra.run.smithi158.stdout: ceph x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 6.4 k 2023-10-14T16:49:56.863 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-10-14T16:49:56.863 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 2.3 M 2023-10-14T16:49:56.863 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 1.6 M 2023-10-14T16:49:56.864 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 238 k 2023-10-14T16:49:56.864 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.9 M 2023-10-14T16:49:56.864 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T16:49:56.864 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T16:49:56.865 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T16:49:56.865 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T16:49:56.865 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T16:49:56.865 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T16:49:56.865 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T16:49:56.866 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T16:49:56.866 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T16:49:56.866 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T16:49:56.866 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T16:49:56.867 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T16:49:56.867 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T16:49:56.867 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T16:49:56.867 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T16:49:56.867 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T16:49:56.868 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T16:49:56.868 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T16:49:56.868 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T16:49:56.868 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T16:49:56.868 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T16:49:56.869 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T16:49:56.869 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T16:49:56.869 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:49:56.869 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:49:56.870 INFO:teuthology.orchestra.run.smithi158.stdout:======================================================================================================= 2023-10-14T16:49:56.870 INFO:teuthology.orchestra.run.smithi158.stdout:Install 28 Packages 2023-10-14T16:49:56.870 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:49:56.871 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 27 M 2023-10-14T16:49:56.871 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 106 M 2023-10-14T16:49:56.871 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:49:57.063 INFO:teuthology.orchestra.run.smithi158.stdout:(1/28): ceph-17.2.6-1415.g9d6d32bb.el8.x86_64.r 62 kB/s | 6.4 kB 00:00 2023-10-14T16:49:57.253 INFO:teuthology.orchestra.run.smithi158.stdout:(2/28): ceph-mgr-17.2.6-1415.g9d6d32bb.el8.x86_ 5.3 MB/s | 1.6 MB 00:00 2023-10-14T16:49:57.356 INFO:teuthology.orchestra.run.smithi158.stdout:(3/28): ceph-mds-17.2.6-1415.g9d6d32bb.el8.x86_ 5.8 MB/s | 2.3 MB 00:00 2023-10-14T16:49:57.420 INFO:teuthology.orchestra.run.smithi158.stdout:(4/28): ceph-mgr-modules-core-17.2.6-1415.g9d6d 3.7 MB/s | 238 kB 00:00 2023-10-14T16:49:57.533 INFO:teuthology.orchestra.run.smithi158.stdout:(5/28): ceph-mon-17.2.6-1415.g9d6d32bb.el8.x86_ 8.4 MB/s | 3.9 MB 00:00 2023-10-14T16:49:57.810 INFO:teuthology.orchestra.run.smithi158.stdout:(6/28): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 112 kB/s | 44 kB 00:00 2023-10-14T16:49:58.091 INFO:teuthology.orchestra.run.smithi158.stdout:(7/28): ceph-osd-17.2.6-1415.g9d6d32bb.el8.x86_ 20 MB/s | 17 MB 00:00 2023-10-14T16:49:58.093 INFO:teuthology.orchestra.run.smithi158.stdout:(8/28): python3-beautifulsoup4-4.6.3-2.el8.1.no 331 kB/s | 185 kB 00:00 2023-10-14T16:49:58.093 INFO:teuthology.orchestra.run.smithi158.stdout:(9/28): python3-cheroot-8.5.2-1.el8.noarch.rpm 609 kB/s | 173 kB 00:00 2023-10-14T16:49:58.159 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:49:58.162 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================================= 2023-10-14T16:49:58.162 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T16:49:58.162 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================================= 2023-10-14T16:49:58.162 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:49:58.163 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 6.4 k 2023-10-14T16:49:58.163 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-14T16:49:58.163 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 2.3 M 2023-10-14T16:49:58.163 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 1.6 M 2023-10-14T16:49:58.164 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 238 k 2023-10-14T16:49:58.164 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.9 M 2023-10-14T16:49:58.164 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T16:49:58.164 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T16:49:58.164 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T16:49:58.165 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T16:49:58.165 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T16:49:58.165 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T16:49:58.165 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T16:49:58.165 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T16:49:58.166 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T16:49:58.166 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T16:49:58.166 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T16:49:58.166 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T16:49:58.167 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T16:49:58.167 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T16:49:58.167 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T16:49:58.167 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T16:49:58.167 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T16:49:58.168 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T16:49:58.168 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T16:49:58.168 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T16:49:58.168 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T16:49:58.168 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T16:49:58.169 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T16:49:58.169 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:49:58.169 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:49:58.169 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================================= 2023-10-14T16:49:58.169 INFO:teuthology.orchestra.run.smithi008.stdout:Install 28 Packages 2023-10-14T16:49:58.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:49:58.170 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 27 M 2023-10-14T16:49:58.171 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 106 M 2023-10-14T16:49:58.171 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:49:58.174 INFO:teuthology.orchestra.run.smithi158.stdout:(10/28): python3-jaraco-6.2-6.el8.noarch.rpm 138 kB/s | 11 kB 00:00 2023-10-14T16:49:58.177 INFO:teuthology.orchestra.run.smithi158.stdout:(11/28): python3-jaraco-functools-2.0-4.el8.noa 211 kB/s | 18 kB 00:00 2023-10-14T16:49:58.269 INFO:teuthology.orchestra.run.smithi158.stdout:(12/28): python3-logutils-0.3.5-11.el8.noarch.r 517 kB/s | 49 kB 00:00 2023-10-14T16:49:58.274 INFO:teuthology.orchestra.run.smithi158.stdout:(13/28): python3-more-itertools-7.2.0-3.el8.noa 605 kB/s | 59 kB 00:00 2023-10-14T16:49:58.287 INFO:teuthology.orchestra.run.smithi008.stdout:(1/28): ceph-17.2.6-1415.g9d6d32bb.el8.x86_64.r 71 kB/s | 6.4 kB 00:00 2023-10-14T16:49:58.377 INFO:teuthology.orchestra.run.smithi158.stdout:(14/28): python3-portend-2.6-1.el8.noarch.rpm 152 kB/s | 16 kB 00:00 2023-10-14T16:49:58.466 INFO:teuthology.orchestra.run.smithi158.stdout:(15/28): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-10-14T16:49:58.491 INFO:teuthology.orchestra.run.smithi158.stdout:(16/28): python3-simplegeneric-0.8.1-17.el8.noa 164 kB/s | 19 kB 00:00 2023-10-14T16:49:58.545 INFO:teuthology.orchestra.run.smithi158.stdout:(17/28): python3-singledispatch-3.4.0.3-18.el8. 303 kB/s | 24 kB 00:00 2023-10-14T16:49:58.578 INFO:teuthology.orchestra.run.smithi158.stdout:(18/28): python3-tempora-1.14.1-5.el8.noarch.rp 338 kB/s | 29 kB 00:00 2023-10-14T16:49:58.625 INFO:teuthology.orchestra.run.smithi158.stdout:(19/28): python3-trustme-0.6.0-4.el8.noarch.rpm 344 kB/s | 27 kB 00:00 2023-10-14T16:49:58.689 INFO:teuthology.orchestra.run.smithi158.stdout:(20/28): python3-cherrypy-18.4.0-1.el8.noarch.r 644 kB/s | 384 kB 00:00 2023-10-14T16:49:58.732 INFO:teuthology.orchestra.run.smithi158.stdout:(21/28): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.3 MB/s | 251 kB 00:00 2023-10-14T16:49:58.756 INFO:teuthology.orchestra.run.smithi158.stdout:(22/28): python3-waitress-1.4.3-1.el8.noarch.rp 1.4 MB/s | 255 kB 00:00 2023-10-14T16:49:58.778 INFO:teuthology.orchestra.run.smithi158.stdout:(23/28): python3-webtest-2.0.33-1.el8.noarch.rp 957 kB/s | 85 kB 00:00 2023-10-14T16:49:58.788 INFO:teuthology.orchestra.run.smithi008.stdout:(2/28): ceph-mds-17.2.6-1415.g9d6d32bb.el8.x86_ 3.9 MB/s | 2.3 MB 00:00 2023-10-14T16:49:58.811 INFO:teuthology.orchestra.run.smithi158.stdout:(24/28): python3-zc-lockfile-2.0-2.el8.noarch.r 290 kB/s | 23 kB 00:00 2023-10-14T16:49:58.922 INFO:teuthology.orchestra.run.smithi158.stdout:(25/28): python3-markupsafe-0.23-19.el8.x86_64. 271 kB/s | 39 kB 00:00 2023-10-14T16:49:58.925 INFO:teuthology.orchestra.run.smithi158.stdout:(26/28): python3-mako-1.0.6-13.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2023-10-14T16:49:58.929 INFO:teuthology.orchestra.run.smithi158.stdout:(27/28): python3-werkzeug-0.12.2-4.el8.noarch.r 2.6 MB/s | 457 kB 00:00 2023-10-14T16:49:58.975 INFO:teuthology.orchestra.run.smithi008.stdout:(3/28): ceph-mon-17.2.6-1415.g9d6d32bb.el8.x86_ 5.7 MB/s | 3.9 MB 00:00 2023-10-14T16:49:59.004 INFO:teuthology.orchestra.run.smithi008.stdout:(4/28): ceph-mgr-modules-core-17.2.6-1415.g9d6d 8.4 MB/s | 238 kB 00:00 2023-10-14T16:49:59.026 INFO:teuthology.orchestra.run.smithi008.stdout:(5/28): ceph-mgr-17.2.6-1415.g9d6d32bb.el8.x86_ 1.9 MB/s | 1.6 MB 00:00 2023-10-14T16:49:59.079 INFO:teuthology.orchestra.run.smithi158.stdout:(28/28): python3-pytz-2017.2-9.el8.noarch.rpm 345 kB/s | 54 kB 00:00 2023-10-14T16:49:59.084 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:49:59.084 INFO:teuthology.orchestra.run.smithi158.stdout:Total 12 MB/s | 27 MB 00:02 2023-10-14T16:49:59.089 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:49:59.125 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:49:59.126 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:49:59.129 INFO:teuthology.orchestra.run.smithi008.stdout:(6/28): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 348 kB/s | 44 kB 00:00 2023-10-14T16:49:59.212 INFO:teuthology.orchestra.run.smithi008.stdout:(7/28): python3-beautifulsoup4-4.6.3-2.el8.1.no 993 kB/s | 185 kB 00:00 2023-10-14T16:49:59.226 INFO:teuthology.orchestra.run.smithi008.stdout:(8/28): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.7 MB/s | 173 kB 00:00 2023-10-14T16:49:59.258 INFO:teuthology.orchestra.run.smithi008.stdout:(9/28): python3-jaraco-6.2-6.el8.noarch.rpm 348 kB/s | 11 kB 00:00 2023-10-14T16:49:59.291 INFO:teuthology.orchestra.run.smithi008.stdout:(10/28): python3-jaraco-functools-2.0-4.el8.noa 538 kB/s | 18 kB 00:00 2023-10-14T16:49:59.296 INFO:teuthology.orchestra.run.smithi008.stdout:(11/28): python3-cherrypy-18.4.0-1.el8.noarch.r 4.5 MB/s | 384 kB 00:00 2023-10-14T16:49:59.327 INFO:teuthology.orchestra.run.smithi008.stdout:(12/28): python3-logutils-0.3.5-11.el8.noarch.r 1.3 MB/s | 49 kB 00:00 2023-10-14T16:49:59.329 INFO:teuthology.orchestra.run.smithi008.stdout:(13/28): python3-more-itertools-7.2.0-3.el8.noa 1.7 MB/s | 59 kB 00:00 2023-10-14T16:49:59.361 INFO:teuthology.orchestra.run.smithi008.stdout:(14/28): python3-portend-2.6-1.el8.noarch.rpm 497 kB/s | 16 kB 00:00 2023-10-14T16:49:59.389 INFO:teuthology.orchestra.run.smithi008.stdout:(15/28): python3-pecan-1.3.2-9.el8.noarch.rpm 4.5 MB/s | 283 kB 00:00 2023-10-14T16:49:59.392 INFO:teuthology.orchestra.run.smithi008.stdout:(16/28): python3-simplegeneric-0.8.1-17.el8.noa 603 kB/s | 19 kB 00:00 2023-10-14T16:49:59.421 INFO:teuthology.orchestra.run.smithi008.stdout:(17/28): python3-singledispatch-3.4.0.3-18.el8. 763 kB/s | 24 kB 00:00 2023-10-14T16:49:59.424 INFO:teuthology.orchestra.run.smithi008.stdout:(18/28): python3-tempora-1.14.1-5.el8.noarch.rp 937 kB/s | 29 kB 00:00 2023-10-14T16:49:59.453 INFO:teuthology.orchestra.run.smithi008.stdout:(19/28): python3-trustme-0.6.0-4.el8.noarch.rpm 855 kB/s | 27 kB 00:00 2023-10-14T16:49:59.468 INFO:teuthology.orchestra.run.smithi008.stdout:(20/28): python3-waitress-1.4.3-1.el8.noarch.rp 5.7 MB/s | 255 kB 00:00 2023-10-14T16:49:59.503 INFO:teuthology.orchestra.run.smithi008.stdout:(21/28): python3-webob-1.8.5-1.el8.1.noarch.rpm 5.0 MB/s | 251 kB 00:00 2023-10-14T16:49:59.503 INFO:teuthology.orchestra.run.smithi008.stdout:(22/28): python3-webtest-2.0.33-1.el8.noarch.rp 2.3 MB/s | 85 kB 00:00 2023-10-14T16:49:59.520 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:49:59.524 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:49:59.534 INFO:teuthology.orchestra.run.smithi008.stdout:(23/28): python3-zc-lockfile-2.0-2.el8.noarch.r 734 kB/s | 23 kB 00:00 2023-10-14T16:49:59.735 INFO:teuthology.orchestra.run.smithi008.stdout:(24/28): ceph-osd-17.2.6-1415.g9d6d32bb.el8.x86 18 MB/s | 17 MB 00:00 2023-10-14T16:49:59.743 INFO:teuthology.orchestra.run.smithi008.stdout:(25/28): python3-werkzeug-0.12.2-4.el8.noarch.r 1.9 MB/s | 457 kB 00:00 2023-10-14T16:49:59.767 INFO:teuthology.orchestra.run.smithi008.stdout:(26/28): python3-markupsafe-0.23-19.el8.x86_64. 167 kB/s | 39 kB 00:00 2023-10-14T16:49:59.826 INFO:teuthology.orchestra.run.smithi008.stdout:(27/28): python3-pytz-2017.2-9.el8.noarch.rpm 651 kB/s | 54 kB 00:00 2023-10-14T16:49:59.893 INFO:teuthology.orchestra.run.smithi008.stdout:(28/28): python3-mako-1.0.6-13.el8.noarch.rpm 995 kB/s | 157 kB 00:00 2023-10-14T16:49:59.896 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:49:59.897 INFO:teuthology.orchestra.run.smithi008.stdout:Total 16 MB/s | 27 MB 00:01 2023-10-14T16:49:59.902 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:49:59.943 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:49:59.943 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:50:00.346 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:50:00.351 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:50:00.630 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:50:00.873 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/28 2023-10-14T16:50:00.878 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:50:00.976 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:00.976 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:50:00.976 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:00.976 INFO:teuthology.orchestra.run.smithi155.stdout: jq-1.5-12.el8.x86_64 2023-10-14T16:50:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T16:50:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-14T16:50:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T16:50:00.977 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:00.978 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:50:01.095 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph 2023-10-14T16:50:01.106 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/28 2023-10-14T16:50:01.270 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 3/28 2023-10-14T16:50:01.452 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:01.510 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:50:01.539 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 4/28 2023-10-14T16:50:01.719 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/28 2023-10-14T16:50:01.888 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 5/28 2023-10-14T16:50:01.911 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/28 2023-10-14T16:50:02.109 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 3/28 2023-10-14T16:50:02.141 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/28 2023-10-14T16:50:02.387 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 7/28 2023-10-14T16:50:02.520 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 4/28 2023-10-14T16:50:02.624 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 8/28 2023-10-14T16:50:02.790 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 9/28 2023-10-14T16:50:02.872 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 5/28 2023-10-14T16:50:02.970 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 10/28 2023-10-14T16:50:03.121 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/28 2023-10-14T16:50:03.152 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 11/28 2023-10-14T16:50:03.155 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:20 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:50:03.377 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 12/28 2023-10-14T16:50:03.394 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 7/28 2023-10-14T16:50:03.548 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 13/28 2023-10-14T16:50:03.612 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 8/28 2023-10-14T16:50:03.761 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 9/28 2023-10-14T16:50:03.762 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 14/28 2023-10-14T16:50:03.917 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 10/28 2023-10-14T16:50:03.994 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 15/28 2023-10-14T16:50:04.137 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 11/28 2023-10-14T16:50:04.188 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 16/28 2023-10-14T16:50:04.315 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 12/28 2023-10-14T16:50:04.427 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-portend-2.6-1.el8.noarch 17/28 2023-10-14T16:50:04.636 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 13/28 2023-10-14T16:50:04.671 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 18/28 2023-10-14T16:50:04.853 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 14/28 2023-10-14T16:50:04.892 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/28 2023-10-14T16:50:05.025 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:50:05.028 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================================= 2023-10-14T16:50:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T16:50:05.029 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================================= 2023-10-14T16:50:05.029 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:50:05.029 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 6.4 k 2023-10-14T16:50:05.030 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-10-14T16:50:05.030 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 2.3 M 2023-10-14T16:50:05.031 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 1.6 M 2023-10-14T16:50:05.031 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 238 k 2023-10-14T16:50:05.031 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.9 M 2023-10-14T16:50:05.032 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T16:50:05.032 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T16:50:05.032 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T16:50:05.033 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T16:50:05.033 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T16:50:05.034 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T16:50:05.034 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T16:50:05.034 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T16:50:05.034 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T16:50:05.035 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T16:50:05.035 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T16:50:05.035 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T16:50:05.035 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T16:50:05.035 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T16:50:05.036 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T16:50:05.036 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T16:50:05.036 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T16:50:05.036 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T16:50:05.036 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T16:50:05.037 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T16:50:05.037 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T16:50:05.037 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T16:50:05.037 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T16:50:05.038 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:05.038 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:50:05.038 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================================= 2023-10-14T16:50:05.038 INFO:teuthology.orchestra.run.smithi155.stdout:Install 28 Packages 2023-10-14T16:50:05.039 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:05.040 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 27 M 2023-10-14T16:50:05.040 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 106 M 2023-10-14T16:50:05.040 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:50:05.077 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 15/28 2023-10-14T16:50:05.176 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 20/28 2023-10-14T16:50:05.182 INFO:teuthology.orchestra.run.smithi155.stdout:(1/28): ceph-17.2.6-1415.g9d6d32bb.el8.x86_64.r 68 kB/s | 6.4 kB 00:00 2023-10-14T16:50:05.277 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 16/28 2023-10-14T16:50:05.342 INFO:teuthology.orchestra.run.smithi155.stdout:(2/28): ceph-mgr-17.2.6-1415.g9d6d32bb.el8.x86_ 6.2 MB/s | 1.6 MB 00:00 2023-10-14T16:50:05.467 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 21/28 2023-10-14T16:50:05.577 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-2.6-1.el8.noarch 17/28 2023-10-14T16:50:05.636 INFO:teuthology.orchestra.run.smithi155.stdout:(3/28): ceph-mon-17.2.6-1415.g9d6d32bb.el8.x86_ 8.7 MB/s | 3.9 MB 00:00 2023-10-14T16:50:05.687 INFO:teuthology.orchestra.run.smithi155.stdout:(4/28): ceph-mgr-modules-core-17.2.6-1415.g9d6d 4.6 MB/s | 238 kB 00:00 2023-10-14T16:50:05.737 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 22/28 2023-10-14T16:50:05.807 INFO:teuthology.orchestra.run.smithi155.stdout:(5/28): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 364 kB/s | 44 kB 00:00 2023-10-14T16:50:05.840 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 18/28 2023-10-14T16:50:05.858 INFO:teuthology.orchestra.run.smithi155.stdout:(6/28): python3-beautifulsoup4-4.6.3-2.el8.1.no 3.6 MB/s | 185 kB 00:00 2023-10-14T16:50:05.879 INFO:teuthology.orchestra.run.smithi155.stdout:(7/28): python3-cheroot-8.5.2-1.el8.noarch.rpm 8.2 MB/s | 173 kB 00:00 2023-10-14T16:50:05.917 INFO:teuthology.orchestra.run.smithi155.stdout:(8/28): python3-cherrypy-18.4.0-1.el8.noarch.rp 9.8 MB/s | 384 kB 00:00 2023-10-14T16:50:05.934 INFO:teuthology.orchestra.run.smithi155.stdout:(9/28): python3-jaraco-6.2-6.el8.noarch.rpm 657 kB/s | 11 kB 00:00 2023-10-14T16:50:05.951 INFO:teuthology.orchestra.run.smithi155.stdout:(10/28): python3-jaraco-functools-2.0-4.el8.noa 1.0 MB/s | 18 kB 00:00 2023-10-14T16:50:05.965 INFO:teuthology.orchestra.run.smithi155.stdout:(11/28): ceph-mds-17.2.6-1415.g9d6d32bb.el8.x86 2.6 MB/s | 2.3 MB 00:00 2023-10-14T16:50:05.968 INFO:teuthology.orchestra.run.smithi155.stdout:(12/28): python3-logutils-0.3.5-11.el8.noarch.r 2.8 MB/s | 49 kB 00:00 2023-10-14T16:50:06.003 INFO:teuthology.orchestra.run.smithi155.stdout:(13/28): python3-pecan-1.3.2-9.el8.noarch.rpm 8.1 MB/s | 283 kB 00:00 2023-10-14T16:50:06.020 INFO:teuthology.orchestra.run.smithi155.stdout:(14/28): python3-portend-2.6-1.el8.noarch.rpm 921 kB/s | 16 kB 00:00 2023-10-14T16:50:06.037 INFO:teuthology.orchestra.run.smithi155.stdout:(15/28): python3-simplegeneric-0.8.1-17.el8.noa 1.1 MB/s | 19 kB 00:00 2023-10-14T16:50:06.054 INFO:teuthology.orchestra.run.smithi155.stdout:(16/28): python3-singledispatch-3.4.0.3-18.el8. 1.4 MB/s | 24 kB 00:00 2023-10-14T16:50:06.072 INFO:teuthology.orchestra.run.smithi155.stdout:(17/28): python3-tempora-1.14.1-5.el8.noarch.rp 1.7 MB/s | 29 kB 00:00 2023-10-14T16:50:06.073 INFO:teuthology.orchestra.run.smithi155.stdout:(18/28): python3-more-itertools-7.2.0-3.el8.noa 546 kB/s | 59 kB 00:00 2023-10-14T16:50:06.076 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/28 2023-10-14T16:50:06.080 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8. 23/28 2023-10-14T16:50:06.088 INFO:teuthology.orchestra.run.smithi155.stdout:(19/28): python3-trustme-0.6.0-4.el8.noarch.rpm 1.6 MB/s | 27 kB 00:00 2023-10-14T16:50:06.109 INFO:teuthology.orchestra.run.smithi155.stdout:(20/28): python3-webob-1.8.5-1.el8.1.noarch.rpm 12 MB/s | 251 kB 00:00 2023-10-14T16:50:06.196 INFO:teuthology.orchestra.run.smithi155.stdout:(21/28): ceph-osd-17.2.6-1415.g9d6d32bb.el8.x86 20 MB/s | 17 MB 00:00 2023-10-14T16:50:06.197 INFO:teuthology.orchestra.run.smithi155.stdout:(22/28): python3-webtest-2.0.33-1.el8.noarch.rp 967 kB/s | 85 kB 00:00 2023-10-14T16:50:06.199 INFO:teuthology.orchestra.run.smithi155.stdout:(23/28): python3-waitress-1.4.3-1.el8.noarch.rp 2.0 MB/s | 255 kB 00:00 2023-10-14T16:50:06.241 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/28 2023-10-14T16:50:06.298 INFO:teuthology.orchestra.run.smithi155.stdout:(24/28): python3-zc-lockfile-2.0-2.el8.noarch.r 226 kB/s | 23 kB 00:00 2023-10-14T16:50:06.303 INFO:teuthology.orchestra.run.smithi155.stdout:(25/28): python3-werkzeug-0.12.2-4.el8.noarch.r 4.2 MB/s | 457 kB 00:00 2023-10-14T16:50:06.347 INFO:teuthology.orchestra.run.smithi155.stdout:(26/28): python3-markupsafe-0.23-19.el8.x86_64. 262 kB/s | 39 kB 00:00 2023-10-14T16:50:06.407 INFO:teuthology.orchestra.run.smithi155.stdout:(27/28): python3-pytz-2017.2-9.el8.noarch.rpm 523 kB/s | 54 kB 00:00 2023-10-14T16:50:06.423 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 20/28 2023-10-14T16:50:06.453 INFO:teuthology.orchestra.run.smithi155.stdout:(28/28): python3-mako-1.0.6-13.el8.noarch.rpm 1.0 MB/s | 157 kB 00:00 2023-10-14T16:50:06.458 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:50:06.458 INFO:teuthology.orchestra.run.smithi155.stdout:Total 19 MB/s | 27 MB 00:01 2023-10-14T16:50:06.462 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:50:06.498 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:50:06.498 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:50:06.705 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 21/28 2023-10-14T16:50:06.897 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:50:06.901 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:50:07.012 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 22/28 2023-10-14T16:50:07.368 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8. 23/28 2023-10-14T16:50:07.544 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/28 2023-10-14T16:50:07.755 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/28 2023-10-14T16:50:07.923 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:50:07.949 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 25/28 2023-10-14T16:50:08.154 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/28 2023-10-14T16:50:08.345 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 25/28 2023-10-14T16:50:08.351 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/28 2023-10-14T16:50:08.532 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 26/28 2023-10-14T16:50:08.556 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 3/28 2023-10-14T16:50:08.752 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 26/28 2023-10-14T16:50:08.810 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 4/28 2023-10-14T16:50:08.920 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 27/28 2023-10-14T16:50:08.939 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 27/28 2023-10-14T16:50:09.048 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 28/28 2023-10-14T16:50:09.156 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/28 2023-10-14T16:50:09.165 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 5/28 2023-10-14T16:50:09.302 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 25/28 2023-10-14T16:50:09.420 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/28 2023-10-14T16:50:09.468 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 28/28 2023-10-14T16:50:09.468 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/28 2023-10-14T16:50:09.469 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/28 2023-10-14T16:50:09.469 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/28 2023-10-14T16:50:09.469 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/28 2023-10-14T16:50:09.470 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/28 2023-10-14T16:50:09.470 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8. 6/28 2023-10-14T16:50:09.470 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/28 2023-10-14T16:50:09.470 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/28 2023-10-14T16:50:09.471 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/28 2023-10-14T16:50:09.471 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/28 2023-10-14T16:50:09.471 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/28 2023-10-14T16:50:09.471 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/28 2023-10-14T16:50:09.472 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/28 2023-10-14T16:50:09.472 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/28 2023-10-14T16:50:09.472 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/28 2023-10-14T16:50:09.472 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/28 2023-10-14T16:50:09.472 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/28 2023-10-14T16:50:09.473 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/28 2023-10-14T16:50:09.473 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/28 2023-10-14T16:50:09.473 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/28 2023-10-14T16:50:09.473 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 21/28 2023-10-14T16:50:09.474 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/28 2023-10-14T16:50:09.474 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/28 2023-10-14T16:50:09.474 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/28 2023-10-14T16:50:09.474 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 25/28 2023-10-14T16:50:09.475 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 26/28 2023-10-14T16:50:09.475 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 27/28 2023-10-14T16:50:09.700 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 7/28 2023-10-14T16:50:09.723 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 25/28 2023-10-14T16:50:09.869 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 26/28 2023-10-14T16:50:09.911 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 8/28 2023-10-14T16:50:10.100 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 26/28 2023-10-14T16:50:10.126 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 9/28 2023-10-14T16:50:10.282 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 10/28 2023-10-14T16:50:10.287 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 27/28 2023-10-14T16:50:10.307 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 27/28 2023-10-14T16:50:10.419 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 28/28 2023-10-14T16:50:10.471 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 11/28 2023-10-14T16:50:10.697 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 12/28 2023-10-14T16:50:10.841 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 13/28 2023-10-14T16:50:10.863 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 28/28 2023-10-14T16:50:10.865 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/28 2023-10-14T16:50:10.866 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/28 2023-10-14T16:50:10.866 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/28 2023-10-14T16:50:10.866 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/28 2023-10-14T16:50:10.866 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/28 2023-10-14T16:50:10.866 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8. 6/28 2023-10-14T16:50:10.867 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/28 2023-10-14T16:50:10.867 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/28 2023-10-14T16:50:10.867 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/28 2023-10-14T16:50:10.867 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/28 2023-10-14T16:50:10.867 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/28 2023-10-14T16:50:10.868 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/28 2023-10-14T16:50:10.868 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/28 2023-10-14T16:50:10.868 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/28 2023-10-14T16:50:10.868 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/28 2023-10-14T16:50:10.868 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/28 2023-10-14T16:50:10.869 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/28 2023-10-14T16:50:10.869 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/28 2023-10-14T16:50:10.869 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/28 2023-10-14T16:50:10.869 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/28 2023-10-14T16:50:10.869 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 21/28 2023-10-14T16:50:10.870 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/28 2023-10-14T16:50:10.870 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/28 2023-10-14T16:50:10.870 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/28 2023-10-14T16:50:10.870 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 25/28 2023-10-14T16:50:10.870 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 26/28 2023-10-14T16:50:10.871 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 27/28 2023-10-14T16:50:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 14/28 2023-10-14T16:50:11.112 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 28/28 2023-10-14T16:50:11.112 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:01:43 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:50:11.314 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 15/28 2023-10-14T16:50:11.474 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 16/28 2023-10-14T16:50:11.739 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-2.6-1.el8.noarch 17/28 2023-10-14T16:50:12.042 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 18/28 2023-10-14T16:50:12.287 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/28 2023-10-14T16:50:12.636 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 20/28 2023-10-14T16:50:12.903 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 21/28 2023-10-14T16:50:13.223 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 22/28 2023-10-14T16:50:13.574 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8. 23/28 2023-10-14T16:50:13.759 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/28 2023-10-14T16:50:14.740 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 28/28 2023-10-14T16:50:14.741 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:44 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:50:15.247 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/28 2023-10-14T16:50:15.458 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 25/28 2023-10-14T16:50:15.863 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 25/28 2023-10-14T16:50:16.060 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 26/28 2023-10-14T16:50:16.278 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 26/28 2023-10-14T16:50:16.475 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 27/28 2023-10-14T16:50:16.494 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 27/28 2023-10-14T16:50:16.634 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 28/28 2023-10-14T16:50:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 28/28 2023-10-14T16:50:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/28 2023-10-14T16:50:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/28 2023-10-14T16:50:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/28 2023-10-14T16:50:17.033 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/28 2023-10-14T16:50:17.033 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/28 2023-10-14T16:50:17.033 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8. 6/28 2023-10-14T16:50:17.033 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/28 2023-10-14T16:50:17.034 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/28 2023-10-14T16:50:17.034 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/28 2023-10-14T16:50:17.034 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/28 2023-10-14T16:50:17.034 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/28 2023-10-14T16:50:17.035 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/28 2023-10-14T16:50:17.035 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/28 2023-10-14T16:50:17.035 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/28 2023-10-14T16:50:17.035 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/28 2023-10-14T16:50:17.036 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/28 2023-10-14T16:50:17.036 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/28 2023-10-14T16:50:17.036 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/28 2023-10-14T16:50:17.036 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/28 2023-10-14T16:50:17.037 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/28 2023-10-14T16:50:17.037 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 21/28 2023-10-14T16:50:17.037 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/28 2023-10-14T16:50:17.038 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/28 2023-10-14T16:50:17.038 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/28 2023-10-14T16:50:17.038 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 25/28 2023-10-14T16:50:17.038 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 26/28 2023-10-14T16:50:17.039 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 27/28 2023-10-14T16:50:18.687 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 28/28 2023-10-14T16:50:18.687 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:35 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:50:18.720 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:50:18.818 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:50:18.819 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:50:18.819 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:18.819 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:18.819 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:18.819 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:50:18.820 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:18.820 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:18.820 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T16:50:18.820 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T16:50:18.820 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T16:50:18.821 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T16:50:18.821 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T16:50:18.821 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T16:50:18.821 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T16:50:18.821 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T16:50:18.822 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T16:50:18.822 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T16:50:18.822 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T16:50:18.822 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T16:50:18.825 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T16:50:18.826 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T16:50:18.826 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T16:50:18.826 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T16:50:18.826 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T16:50:18.826 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T16:50:18.827 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T16:50:18.827 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T16:50:18.827 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T16:50:18.827 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T16:50:18.827 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:50:18.827 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:50:18.963 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-base 2023-10-14T16:50:19.334 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:21.003 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:01:53 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:50:21.063 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:50:21.174 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:50:21.175 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:50:21.175 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:21.175 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:21.175 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:21.176 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:50:21.176 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:21.176 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:21.176 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T16:50:21.176 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T16:50:21.177 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T16:50:21.177 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T16:50:21.177 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T16:50:21.177 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T16:50:21.177 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T16:50:21.177 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T16:50:21.178 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T16:50:21.178 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T16:50:21.178 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T16:50:21.178 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T16:50:21.179 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T16:50:21.179 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T16:50:21.179 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T16:50:21.180 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T16:50:21.180 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T16:50:21.180 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T16:50:21.180 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T16:50:21.181 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T16:50:21.181 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T16:50:21.181 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T16:50:21.182 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:50:21.182 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:50:21.341 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-base 2023-10-14T16:50:21.728 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:22.318 INFO:teuthology.orchestra.run.smithi158.stdout:Package ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:50:22.808 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:50:22.810 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T16:50:22.810 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:50:22.917 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install cephadm 2023-10-14T16:50:23.286 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:23.733 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:53 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:50:25.161 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:01:57 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:50:25.190 INFO:teuthology.orchestra.run.smithi008.stdout:Package ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:50:25.652 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:50:25.725 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:50:25.727 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T16:50:25.727 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:50:25.753 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:25.754 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:50:25.754 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:25.754 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:25.754 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:25.755 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:50:25.755 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:25.755 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:25.755 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T16:50:25.755 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T16:50:25.756 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T16:50:25.756 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T16:50:25.756 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T16:50:25.756 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T16:50:25.757 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T16:50:25.757 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T16:50:25.757 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T16:50:25.757 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T16:50:25.758 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T16:50:25.758 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T16:50:25.758 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T16:50:25.758 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T16:50:25.759 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T16:50:25.759 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T16:50:25.759 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T16:50:25.759 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T16:50:25.759 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T16:50:25.760 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T16:50:25.760 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T16:50:25.760 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T16:50:25.760 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:25.761 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:50:25.831 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install cephadm 2023-10-14T16:50:26.215 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:26.595 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-base 2023-10-14T16:50:26.953 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:50:26.954 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:50:26.955 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T16:50:26.955 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:50:26.955 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:50:26.956 INFO:teuthology.orchestra.run.smithi158.stdout: cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 80 k 2023-10-14T16:50:26.956 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:50:26.956 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:50:26.957 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:50:26.957 INFO:teuthology.orchestra.run.smithi158.stdout:Install 1 Package 2023-10-14T16:50:26.957 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:50:26.958 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 80 k 2023-10-14T16:50:26.958 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 364 k 2023-10-14T16:50:26.958 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:50:26.961 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:27.087 INFO:teuthology.orchestra.run.smithi158.stdout:cephadm-17.2.6-1415.g9d6d32bb.el8.noarch.rpm 610 kB/s | 80 kB 00:00 2023-10-14T16:50:27.088 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:50:27.088 INFO:teuthology.orchestra.run.smithi158.stdout:Total 603 kB/s | 80 kB 00:00 2023-10-14T16:50:27.088 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:50:27.096 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:50:27.096 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:50:27.098 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:50:27.102 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:50:27.147 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:50:28.244 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:58 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:50:28.962 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:45 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:50:30.143 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:50:30.165 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:50:30.166 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:50:30.166 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T16:50:30.166 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:50:30.166 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:50:30.167 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 80 k 2023-10-14T16:50:30.167 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:50:30.167 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:50:30.167 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:50:30.167 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-14T16:50:30.167 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:50:30.168 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 80 k 2023-10-14T16:50:30.168 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 364 k 2023-10-14T16:50:30.168 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:50:30.308 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:50:30.348 INFO:teuthology.orchestra.run.smithi155.stdout:Package ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:50:30.522 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:50:30.717 INFO:teuthology.orchestra.run.smithi008.stdout:cephadm-17.2.6-1415.g9d6d32bb.el8.noarch.rpm 146 kB/s | 80 kB 00:00 2023-10-14T16:50:30.717 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:50:30.718 INFO:teuthology.orchestra.run.smithi008.stdout:Total 145 kB/s | 80 kB 00:00 2023-10-14T16:50:30.718 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:50:30.727 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:50:30.728 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:50:30.730 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:50:30.735 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:50:30.798 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:50:30.826 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:50:30.827 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T16:50:30.827 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:50:30.931 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install cephadm 2023-10-14T16:50:31.297 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:31.472 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:50:31.473 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:02:03 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:50:33.346 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:50 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:50:33.840 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:50:33.982 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:50:34.199 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:50:35.177 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:50:35.178 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:50:35.178 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T16:50:35.178 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:50:35.178 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:50:35.179 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 80 k 2023-10-14T16:50:35.179 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:35.179 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:50:35.179 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:50:35.179 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-10-14T16:50:35.180 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:35.180 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 80 k 2023-10-14T16:50:35.180 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 364 k 2023-10-14T16:50:35.180 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:50:35.336 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:50:35.336 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:05 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:50:35.401 INFO:teuthology.orchestra.run.smithi155.stdout:cephadm-17.2.6-1415.g9d6d32bb.el8.noarch.rpm 361 kB/s | 80 kB 00:00 2023-10-14T16:50:35.402 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:50:35.402 INFO:teuthology.orchestra.run.smithi155.stdout:Total 358 kB/s | 80 kB 00:00 2023-10-14T16:50:35.403 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:50:35.410 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:50:35.411 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:50:35.412 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:50:35.417 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:50:35.464 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:50:38.347 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:50:38.493 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:50:38.698 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:50:38.990 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:50:39.087 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:50:39.087 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:50:39.087 INFO:teuthology.orchestra.run.smithi158.stdout: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:50:39.087 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:50:39.088 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:50:39.235 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-immutable-object-cache 2023-10-14T16:50:39.612 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:39.890 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:50:39.891 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:56 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:50:41.276 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:02:13 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:50:41.717 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:50:41.821 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:50:41.821 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:50:41.822 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:50:41.822 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:50:41.822 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:50:41.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-immutable-object-cache 2023-10-14T16:50:42.377 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:43.122 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:50:43.123 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:50:43.124 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repo Size 2023-10-14T16:50:43.124 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:50:43.124 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:50:43.124 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 161 k 2023-10-14T16:50:43.124 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:50:43.125 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:50:43.125 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:50:43.125 INFO:teuthology.orchestra.run.smithi158.stdout:Install 1 Package 2023-10-14T16:50:43.125 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:50:43.125 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 161 k 2023-10-14T16:50:43.126 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 490 k 2023-10-14T16:50:43.126 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:50:43.288 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-immutable-object-cache-17.2.6-1415.g9d6d32 987 kB/s | 161 kB 00:00 2023-10-14T16:50:43.288 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:50:43.289 INFO:teuthology.orchestra.run.smithi158.stdout:Total 979 kB/s | 161 kB 00:00 2023-10-14T16:50:43.289 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:50:43.302 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:50:43.302 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:50:43.355 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:50:43.359 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:50:43.489 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:50:43.684 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb. 1/1 2023-10-14T16:50:44.108 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb. 1/1 2023-10-14T16:50:44.248 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:14 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:50:45.083 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb. 1/1 2023-10-14T16:50:45.083 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:02:17 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:50:46.182 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:50:46.183 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:50:46.184 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repo Size 2023-10-14T16:50:46.184 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:50:46.184 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:50:46.184 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 161 k 2023-10-14T16:50:46.184 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:50:46.185 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:50:46.185 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:50:46.185 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-14T16:50:46.185 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:50:46.185 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 161 k 2023-10-14T16:50:46.186 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 490 k 2023-10-14T16:50:46.186 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:50:46.333 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:50:46.431 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:46.431 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:50:46.431 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:50:46.431 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:46.432 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:50:46.447 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-immutable-object-cache-17.2.6-1415.g9d6d32 616 kB/s | 161 kB 00:00 2023-10-14T16:50:46.448 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:50:46.448 INFO:teuthology.orchestra.run.smithi008.stdout:Total 612 kB/s | 161 kB 00:00 2023-10-14T16:50:46.449 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:50:46.461 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:50:46.462 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:50:46.518 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:50:46.522 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:50:46.573 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-immutable-object-cache 2023-10-14T16:50:46.653 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:50:46.954 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:46.956 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb. 1/1 2023-10-14T16:50:47.405 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb. 1/1 2023-10-14T16:50:48.526 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb. 1/1 2023-10-14T16:50:48.527 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:18 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:50:48.833 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:05 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:50:50.713 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:50:50.714 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:50:50.714 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2023-10-14T16:50:50.714 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:50:50.715 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:50:50.715 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 161 k 2023-10-14T16:50:50.715 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:50.715 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:50:50.715 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:50:50.716 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-10-14T16:50:50.716 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:50.716 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 161 k 2023-10-14T16:50:50.716 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 490 k 2023-10-14T16:50:50.716 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:50:50.973 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-immutable-object-cache-17.2.6-1415.g9d6d32 624 kB/s | 161 kB 00:00 2023-10-14T16:50:50.974 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:50:50.974 INFO:teuthology.orchestra.run.smithi155.stdout:Total 621 kB/s | 161 kB 00:00 2023-10-14T16:50:50.975 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:50:50.987 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:50:50.988 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:50:51.040 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:50:51.044 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:50:51.156 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:50:51.329 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb. 1/1 2023-10-14T16:50:51.745 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb. 1/1 2023-10-14T16:50:52.029 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:50:52.127 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:50:52.127 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:50:52.128 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:52.128 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:50:52.128 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:50:52.245 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-mgr 2023-10-14T16:50:52.611 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:52.850 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb. 1/1 2023-10-14T16:50:52.850 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:09 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:50:54.328 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:02:26 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:50:54.753 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:50:54.858 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:50:54.859 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:50:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:54.859 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:50:54.859 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:50:54.994 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr 2023-10-14T16:50:55.381 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:55.679 INFO:teuthology.orchestra.run.smithi158.stdout:Package ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:50:56.154 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:50:56.155 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T16:50:56.155 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:50:56.288 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-mgr-dashboard 2023-10-14T16:50:56.651 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:50:57.344 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:27 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:50:58.769 INFO:teuthology.orchestra.run.smithi008.stdout:Package ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:50:58.779 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:02:30 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:50:59.265 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:50:59.266 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T16:50:59.266 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:50:59.372 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr-dashboard 2023-10-14T16:50:59.492 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:50:59.589 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:59.589 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:50:59.589 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:50:59.590 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:50:59.590 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:50:59.708 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr 2023-10-14T16:50:59.754 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:51:00.075 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:51:00.614 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:51:00.615 INFO:teuthology.orchestra.run.smithi158.stdout:=================================================================================================== 2023-10-14T16:51:00.615 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T16:51:00.616 INFO:teuthology.orchestra.run.smithi158.stdout:=================================================================================================== 2023-10-14T16:51:00.616 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:51:00.616 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 1.7 M 2023-10-14T16:51:00.616 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-10-14T16:51:00.616 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 23 k 2023-10-14T16:51:00.617 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 14 k 2023-10-14T16:51:00.617 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T16:51:00.617 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T16:51:00.617 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T16:51:00.617 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:00.618 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:51:00.618 INFO:teuthology.orchestra.run.smithi158.stdout:=================================================================================================== 2023-10-14T16:51:00.618 INFO:teuthology.orchestra.run.smithi158.stdout:Install 6 Packages 2023-10-14T16:51:00.618 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:00.619 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 2.0 M 2023-10-14T16:51:00.620 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 8.0 M 2023-10-14T16:51:00.620 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:51:00.834 INFO:teuthology.orchestra.run.smithi158.stdout:(1/6): ceph-grafana-dashboards-17.2.6-1415.g9d6 124 kB/s | 23 kB 00:00 2023-10-14T16:51:00.838 INFO:teuthology.orchestra.run.smithi158.stdout:(2/6): ceph-prometheus-alerts-17.2.6-1415.g9d6d 76 kB/s | 14 kB 00:00 2023-10-14T16:51:00.896 INFO:teuthology.orchestra.run.smithi158.stdout:(3/6): ceph-mgr-dashboard-17.2.6-1415.g9d6d32bb 6.8 MB/s | 1.7 MB 00:00 2023-10-14T16:51:01.053 INFO:teuthology.orchestra.run.smithi158.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 154 kB/s | 34 kB 00:00 2023-10-14T16:51:01.162 INFO:teuthology.orchestra.run.smithi158.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 160 kB/s | 43 kB 00:00 2023-10-14T16:51:01.201 INFO:teuthology.orchestra.run.smithi158.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 541 kB/s | 196 kB 00:00 2023-10-14T16:51:01.204 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:51:01.204 INFO:teuthology.orchestra.run.smithi158.stdout:Total 3.4 MB/s | 2.0 MB 00:00 2023-10-14T16:51:01.205 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:51:01.214 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:51:01.214 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:51:01.293 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:51:01.298 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:51:01.603 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:51:01.811 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:31 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:51:01.848 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2023-10-14T16:51:02.053 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:19 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:51:02.089 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2023-10-14T16:51:02.250 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2023-10-14T16:51:02.404 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.n 4/6 2023-10-14T16:51:02.767 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8. 5/6 2023-10-14T16:51:03.005 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/6 2023-10-14T16:51:03.266 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/6 2023-10-14T16:51:03.267 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8. 1/6 2023-10-14T16:51:03.267 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarc 2/6 2023-10-14T16:51:03.267 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.n 3/6 2023-10-14T16:51:03.267 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2023-10-14T16:51:03.267 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2023-10-14T16:51:03.468 INFO:teuthology.orchestra.run.smithi155.stdout:Package ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:51:03.888 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:51:03.889 INFO:teuthology.orchestra.run.smithi008.stdout:=================================================================================================== 2023-10-14T16:51:03.889 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T16:51:03.890 INFO:teuthology.orchestra.run.smithi008.stdout:=================================================================================================== 2023-10-14T16:51:03.890 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:51:03.890 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 1.7 M 2023-10-14T16:51:03.890 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-14T16:51:03.890 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 23 k 2023-10-14T16:51:03.891 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 14 k 2023-10-14T16:51:03.891 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T16:51:03.891 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T16:51:03.891 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T16:51:03.891 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:51:03.891 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:51:03.892 INFO:teuthology.orchestra.run.smithi008.stdout:=================================================================================================== 2023-10-14T16:51:03.892 INFO:teuthology.orchestra.run.smithi008.stdout:Install 6 Packages 2023-10-14T16:51:03.892 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:51:03.893 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 2.0 M 2023-10-14T16:51:03.893 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 8.0 M 2023-10-14T16:51:03.893 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:51:03.948 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:51:03.950 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T16:51:03.950 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:51:04.061 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-dashboard 2023-10-14T16:51:04.231 INFO:teuthology.orchestra.run.smithi008.stdout:(1/6): ceph-grafana-dashboards-17.2.6-1415.g9d6 121 kB/s | 23 kB 00:00 2023-10-14T16:51:04.234 INFO:teuthology.orchestra.run.smithi008.stdout:(2/6): ceph-prometheus-alerts-17.2.6-1415.g9d6d 75 kB/s | 14 kB 00:00 2023-10-14T16:51:04.291 INFO:teuthology.orchestra.run.smithi008.stdout:(3/6): ceph-mgr-dashboard-17.2.6-1415.g9d6d32bb 6.8 MB/s | 1.7 MB 00:00 2023-10-14T16:51:04.313 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2023-10-14T16:51:04.313 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:02:36 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:51:04.423 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:51:04.434 INFO:teuthology.orchestra.run.smithi008.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 297 kB/s | 43 kB 00:00 2023-10-14T16:51:04.669 INFO:teuthology.orchestra.run.smithi008.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 77 kB/s | 34 kB 00:00 2023-10-14T16:51:04.905 INFO:teuthology.orchestra.run.smithi008.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 293 kB/s | 196 kB 00:00 2023-10-14T16:51:04.910 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:51:04.911 INFO:teuthology.orchestra.run.smithi008.stdout:Total 2.0 MB/s | 2.0 MB 00:01 2023-10-14T16:51:04.913 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:51:04.923 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:51:04.923 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:51:05.014 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:51:05.019 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:51:05.322 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:51:05.545 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2023-10-14T16:51:05.792 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2023-10-14T16:51:05.981 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2023-10-14T16:51:06.094 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.n 4/6 2023-10-14T16:51:06.333 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:23 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:51:06.510 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8. 5/6 2023-10-14T16:51:06.761 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/6 2023-10-14T16:51:07.028 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/6 2023-10-14T16:51:07.028 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8. 1/6 2023-10-14T16:51:07.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarc 2/6 2023-10-14T16:51:07.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.n 3/6 2023-10-14T16:51:07.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2023-10-14T16:51:07.029 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2023-10-14T16:51:08.182 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:51:08.183 INFO:teuthology.orchestra.run.smithi155.stdout:=================================================================================================== 2023-10-14T16:51:08.184 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T16:51:08.184 INFO:teuthology.orchestra.run.smithi155.stdout:=================================================================================================== 2023-10-14T16:51:08.184 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:51:08.184 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 1.7 M 2023-10-14T16:51:08.184 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-10-14T16:51:08.185 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 23 k 2023-10-14T16:51:08.185 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 14 k 2023-10-14T16:51:08.185 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T16:51:08.185 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T16:51:08.185 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T16:51:08.185 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:51:08.186 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:51:08.186 INFO:teuthology.orchestra.run.smithi155.stdout:=================================================================================================== 2023-10-14T16:51:08.186 INFO:teuthology.orchestra.run.smithi155.stdout:Install 6 Packages 2023-10-14T16:51:08.186 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:51:08.187 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 2.0 M 2023-10-14T16:51:08.187 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 8.0 M 2023-10-14T16:51:08.187 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:51:08.235 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2023-10-14T16:51:08.235 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:38 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:51:08.333 INFO:teuthology.orchestra.run.smithi155.stdout:(1/6): ceph-prometheus-alerts-17.2.6-1415.g9d6d 122 kB/s | 14 kB 00:00 2023-10-14T16:51:08.409 INFO:teuthology.orchestra.run.smithi155.stdout:(2/6): ceph-grafana-dashboards-17.2.6-1415.g9d6 118 kB/s | 23 kB 00:00 2023-10-14T16:51:08.469 INFO:teuthology.orchestra.run.smithi155.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 248 kB/s | 34 kB 00:00 2023-10-14T16:51:08.564 INFO:teuthology.orchestra.run.smithi155.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 452 kB/s | 43 kB 00:00 2023-10-14T16:51:08.568 INFO:teuthology.orchestra.run.smithi155.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.2 MB/s | 196 kB 00:00 2023-10-14T16:51:08.626 INFO:teuthology.orchestra.run.smithi155.stdout:(6/6): ceph-mgr-dashboard-17.2.6-1415.g9d6d32bb 4.1 MB/s | 1.7 MB 00:00 2023-10-14T16:51:08.630 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:51:08.630 INFO:teuthology.orchestra.run.smithi155.stdout:Total 4.5 MB/s | 2.0 MB 00:00 2023-10-14T16:51:08.632 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:51:08.640 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:51:08.640 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:51:08.724 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:51:08.728 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:51:09.021 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:51:09.256 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2023-10-14T16:51:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2023-10-14T16:51:09.696 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2023-10-14T16:51:09.841 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.n 4/6 2023-10-14T16:51:10.068 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:51:10.166 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:10.167 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:51:10.167 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:10.167 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:10.167 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:10.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T16:51:10.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T16:51:10.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T16:51:10.168 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:10.168 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:51:10.238 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8. 5/6 2023-10-14T16:51:10.294 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-14T16:51:10.475 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/6 2023-10-14T16:51:10.667 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:51:10.753 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/6 2023-10-14T16:51:10.754 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8. 1/6 2023-10-14T16:51:10.754 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarc 2/6 2023-10-14T16:51:10.754 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.n 3/6 2023-10-14T16:51:10.755 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2023-10-14T16:51:10.755 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2023-10-14T16:51:11.829 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2023-10-14T16:51:11.829 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:28 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:51:12.243 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:02:44 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:51:13.082 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:51:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:51:13.189 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:51:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:13.189 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T16:51:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T16:51:13.190 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T16:51:13.191 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:51:13.191 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:51:13.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-14T16:51:13.723 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:51:14.047 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:51:14.049 INFO:teuthology.orchestra.run.smithi158.stdout:====================================================================================================================== 2023-10-14T16:51:14.049 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T16:51:14.049 INFO:teuthology.orchestra.run.smithi158.stdout:====================================================================================================================== 2023-10-14T16:51:14.049 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:51:14.050 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 7.4 M 2023-10-14T16:51:14.050 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-10-14T16:51:14.050 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-14T16:51:14.050 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-14T16:51:14.050 INFO:teuthology.orchestra.run.smithi158.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-14T16:51:14.050 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T16:51:14.051 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T16:51:14.051 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T16:51:14.051 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-14T16:51:14.051 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:14.051 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:51:14.052 INFO:teuthology.orchestra.run.smithi158.stdout:====================================================================================================================== 2023-10-14T16:51:14.052 INFO:teuthology.orchestra.run.smithi158.stdout:Install 8 Packages 2023-10-14T16:51:14.052 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:14.052 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 36 M 2023-10-14T16:51:14.053 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 199 M 2023-10-14T16:51:14.053 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:51:14.218 INFO:teuthology.orchestra.run.smithi158.stdout:(1/8): libquadmath-8.4.1-1.el8.x86_64.rpm 1.0 MB/s | 169 kB 00:00 2023-10-14T16:51:14.303 INFO:teuthology.orchestra.run.smithi158.stdout:(2/8): libgfortran-8.4.1-1.el8.x86_64.rpm 2.5 MB/s | 639 kB 00:00 2023-10-14T16:51:14.407 INFO:teuthology.orchestra.run.smithi158.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 2.1 MB/s | 225 kB 00:00 2023-10-14T16:51:14.505 INFO:teuthology.orchestra.run.smithi158.stdout:(4/8): ceph-mgr-diskprediction-local-17.2.6-141 16 MB/s | 7.4 MB 00:00 2023-10-14T16:51:14.556 INFO:teuthology.orchestra.run.smithi158.stdout:(5/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 25 MB/s | 3.7 MB 00:00 2023-10-14T16:51:14.701 INFO:teuthology.orchestra.run.smithi158.stdout:(6/8): python3-scipy-1.0.0-20.module+el8.1.0+33 30 MB/s | 15 MB 00:00 2023-10-14T16:51:14.761 INFO:teuthology.orchestra.run.smithi158.stdout:(7/8): openblas-0.3.12-1.el8.x86_64.rpm 22 MB/s | 4.6 MB 00:00 2023-10-14T16:51:14.774 INFO:teuthology.orchestra.run.smithi158.stdout:(8/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-14T16:51:14.776 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:51:14.776 INFO:teuthology.orchestra.run.smithi158.stdout:Total 50 MB/s | 36 MB 00:00 2023-10-14T16:51:14.785 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:51:14.804 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:51:14.805 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:51:15.243 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:51:15.247 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:51:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:45 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:51:15.906 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:51:16.087 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2023-10-14T16:51:16.262 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2023-10-14T16:51:16.470 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2023-10-14T16:51:16.545 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:51:16.642 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:51:16.643 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:51:16.643 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:16.643 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:16.643 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:16.644 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T16:51:16.644 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T16:51:16.644 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T16:51:16.644 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:51:16.644 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:51:16.771 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-14T16:51:17.026 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2023-10-14T16:51:17.141 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:51:17.237 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-10-14T16:51:17.581 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:51:17.583 INFO:teuthology.orchestra.run.smithi008.stdout:====================================================================================================================== 2023-10-14T16:51:17.583 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T16:51:17.583 INFO:teuthology.orchestra.run.smithi008.stdout:====================================================================================================================== 2023-10-14T16:51:17.583 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:51:17.584 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 7.4 M 2023-10-14T16:51:17.584 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-14T16:51:17.584 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-14T16:51:17.584 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-14T16:51:17.584 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-14T16:51:17.585 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T16:51:17.585 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T16:51:17.585 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T16:51:17.585 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-14T16:51:17.585 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:51:17.585 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:51:17.586 INFO:teuthology.orchestra.run.smithi008.stdout:====================================================================================================================== 2023-10-14T16:51:17.586 INFO:teuthology.orchestra.run.smithi008.stdout:Install 8 Packages 2023-10-14T16:51:17.586 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:51:17.587 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 36 M 2023-10-14T16:51:17.587 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 199 M 2023-10-14T16:51:17.587 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:51:17.770 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-10-14T16:51:17.781 INFO:teuthology.orchestra.run.smithi008.stdout:(1/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 1.1 MB/s | 225 kB 00:00 2023-10-14T16:51:17.961 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openblas-0.3.12-1.el8.x86_64 4/8 2023-10-14T16:51:18.018 INFO:teuthology.orchestra.run.smithi008.stdout:(2/8): python3-scipy-1.0.0-20.module+el8.1.0+33 34 MB/s | 15 MB 00:00 2023-10-14T16:51:18.042 INFO:teuthology.orchestra.run.smithi008.stdout:(3/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 14 MB/s | 3.7 MB 00:00 2023-10-14T16:51:18.239 INFO:teuthology.orchestra.run.smithi008.stdout:(4/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2023-10-14T16:51:18.294 INFO:teuthology.orchestra.run.smithi008.stdout:(5/8): openblas-0.3.12-1.el8.x86_64.rpm 18 MB/s | 4.6 MB 00:00 2023-10-14T16:51:18.316 INFO:teuthology.orchestra.run.smithi008.stdout:(6/8): ceph-mgr-diskprediction-local-17.2.6-141 10 MB/s | 7.4 MB 00:00 2023-10-14T16:51:18.341 INFO:teuthology.orchestra.run.smithi008.stdout:(7/8): libquadmath-8.4.1-1.el8.x86_64.rpm 1.6 MB/s | 169 kB 00:00 2023-10-14T16:51:18.434 INFO:teuthology.orchestra.run.smithi008.stdout:(8/8): libgfortran-8.4.1-1.el8.x86_64.rpm 4.5 MB/s | 639 kB 00:00 2023-10-14T16:51:18.435 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:51:18.436 INFO:teuthology.orchestra.run.smithi008.stdout:Total 42 MB/s | 36 MB 00:00 2023-10-14T16:51:18.446 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:51:18.467 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:51:18.467 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:51:18.715 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 4/8 2023-10-14T16:51:18.939 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:51:18.943 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:51:18.989 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:35 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:51:19.073 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2023-10-14T16:51:19.319 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-10-14T16:51:19.614 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:51:19.851 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2023-10-14T16:51:19.981 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2023-10-14T16:51:20.143 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2023-10-14T16:51:20.730 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2023-10-14T16:51:20.805 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:51:20.806 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================================================== 2023-10-14T16:51:20.806 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T16:51:20.807 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================================================== 2023-10-14T16:51:20.807 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:51:20.807 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 7.4 M 2023-10-14T16:51:20.807 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-10-14T16:51:20.807 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-14T16:51:20.808 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-14T16:51:20.808 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-14T16:51:20.808 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T16:51:20.808 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T16:51:20.809 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T16:51:20.809 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-14T16:51:20.809 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:51:20.809 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:51:20.809 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================================================== 2023-10-14T16:51:20.810 INFO:teuthology.orchestra.run.smithi155.stdout:Install 8 Packages 2023-10-14T16:51:20.810 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:51:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 36 M 2023-10-14T16:51:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 199 M 2023-10-14T16:51:20.811 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:51:20.918 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-10-14T16:51:20.986 INFO:teuthology.orchestra.run.smithi155.stdout:(1/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 1.2 MB/s | 225 kB 00:00 2023-10-14T16:51:21.207 INFO:teuthology.orchestra.run.smithi155.stdout:(2/8): python3-scipy-1.0.0-20.module+el8.1.0+33 37 MB/s | 15 MB 00:00 2023-10-14T16:51:21.272 INFO:teuthology.orchestra.run.smithi155.stdout:(3/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 13 MB/s | 3.7 MB 00:00 2023-10-14T16:51:21.363 INFO:teuthology.orchestra.run.smithi155.stdout:(4/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 30 MB/s | 4.7 MB 00:00 2023-10-14T16:51:21.378 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-10-14T16:51:21.451 INFO:teuthology.orchestra.run.smithi155.stdout:(5/8): ceph-mgr-diskprediction-local-17.2.6-141 12 MB/s | 7.4 MB 00:00 2023-10-14T16:51:21.454 INFO:teuthology.orchestra.run.smithi155.stdout:(6/8): libquadmath-8.4.1-1.el8.x86_64.rpm 1.8 MB/s | 169 kB 00:00 2023-10-14T16:51:21.488 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-10-14T16:51:21.489 INFO:teuthology.orchestra.run.smithi155.stdout:(7/8): openblas-0.3.12-1.el8.x86_64.rpm 21 MB/s | 4.6 MB 00:00 2023-10-14T16:51:21.551 INFO:teuthology.orchestra.run.smithi155.stdout:(8/8): libgfortran-8.4.1-1.el8.x86_64.rpm 6.3 MB/s | 639 kB 00:00 2023-10-14T16:51:21.552 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:51:21.552 INFO:teuthology.orchestra.run.smithi155.stdout:Total 48 MB/s | 36 MB 00:00 2023-10-14T16:51:21.562 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:51:21.581 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:51:21.581 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:51:21.710 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.12-1.el8.x86_64 4/8 2023-10-14T16:51:21.997 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:51:22.001 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:51:22.479 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 4/8 2023-10-14T16:51:22.652 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:51:22.663 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2023-10-14T16:51:22.802 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32b 8/8 2023-10-14T16:51:22.833 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2023-10-14T16:51:22.834 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2023-10-14T16:51:22.964 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2023-10-14T16:51:23.051 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-10-14T16:51:23.124 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2023-10-14T16:51:23.137 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32b 8/8 2023-10-14T16:51:23.137 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32b 1/8 2023-10-14T16:51:23.137 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 2/8 2023-10-14T16:51:23.138 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 3/8 2023-10-14T16:51:23.138 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 4/8 2023-10-14T16:51:23.138 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2023-10-14T16:51:23.138 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 6/8 2023-10-14T16:51:23.138 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 7/8 2023-10-14T16:51:23.710 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2023-10-14T16:51:23.907 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-10-14T16:51:24.252 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 8/8 2023-10-14T16:51:24.253 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:02:56 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:51:24.431 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-10-14T16:51:24.624 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.12-1.el8.x86_64 4/8 2023-10-14T16:51:25.239 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-10-14T16:51:25.348 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 4/8 2023-10-14T16:51:25.718 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2023-10-14T16:51:25.932 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-10-14T16:51:26.567 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2023-10-14T16:51:26.759 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32b 8/8 2023-10-14T16:51:27.080 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32b 8/8 2023-10-14T16:51:27.081 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32b 1/8 2023-10-14T16:51:27.081 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 2/8 2023-10-14T16:51:27.081 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 3/8 2023-10-14T16:51:27.081 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2023-10-14T16:51:27.082 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 5/8 2023-10-14T16:51:27.082 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 6/8 2023-10-14T16:51:27.082 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 7/8 2023-10-14T16:51:27.981 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-10-14T16:51:28.223 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 8/8 2023-10-14T16:51:28.224 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:58 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:51:29.240 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2023-10-14T16:51:29.424 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32b 8/8 2023-10-14T16:51:29.706 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32b 8/8 2023-10-14T16:51:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32b 1/8 2023-10-14T16:51:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 2/8 2023-10-14T16:51:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 3/8 2023-10-14T16:51:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2023-10-14T16:51:29.707 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 5/8 2023-10-14T16:51:29.708 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 6/8 2023-10-14T16:51:29.708 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 7/8 2023-10-14T16:51:30.864 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 8/8 2023-10-14T16:51:30.864 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:47 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:51:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:51:31.288 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:31.289 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:51:31.289 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:31.290 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-14T16:51:31.290 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-14T16:51:31.290 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-14T16:51:31.290 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-14T16:51:31.290 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-14T16:51:31.291 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-14T16:51:31.291 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-14T16:51:31.291 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:31.291 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:51:31.443 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-mgr-rook 2023-10-14T16:51:31.808 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:51:33.882 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:03:05 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:51:35.702 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:51:35.703 INFO:teuthology.orchestra.run.smithi158.stdout:======================================================================================================== 2023-10-14T16:51:35.704 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T16:51:35.704 INFO:teuthology.orchestra.run.smithi158.stdout:======================================================================================================== 2023-10-14T16:51:35.704 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:51:35.704 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 47 k 2023-10-14T16:51:35.704 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-10-14T16:51:35.705 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T16:51:35.705 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T16:51:35.705 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T16:51:35.705 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T16:51:35.705 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T16:51:35.706 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T16:51:35.706 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T16:51:35.706 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T16:51:35.706 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T16:51:35.707 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T16:51:35.707 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T16:51:35.707 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T16:51:35.707 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:35.707 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:51:35.707 INFO:teuthology.orchestra.run.smithi158.stdout:======================================================================================================== 2023-10-14T16:51:35.708 INFO:teuthology.orchestra.run.smithi158.stdout:Install 13 Packages 2023-10-14T16:51:35.708 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:35.708 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 1.9 M 2023-10-14T16:51:35.709 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 25 M 2023-10-14T16:51:35.709 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:51:35.802 INFO:teuthology.orchestra.run.smithi158.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 328 kB/s | 16 kB 00:00 2023-10-14T16:51:35.809 INFO:teuthology.orchestra.run.smithi158.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 583 kB/s | 33 kB 00:00 2023-10-14T16:51:35.858 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:51:35.884 INFO:teuthology.orchestra.run.smithi158.stdout:(3/13): ceph-mgr-rook-17.2.6-1415.g9d6d32bb.el8 359 kB/s | 47 kB 00:00 2023-10-14T16:51:35.961 INFO:teuthology.orchestra.run.smithi158.stdout:(4/13): python3-rsa-4.9-2.el8.noarch.rpm 837 kB/s | 64 kB 00:00 2023-10-14T16:51:35.968 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:51:35.968 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:51:35.969 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:35.969 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-14T16:51:35.969 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-14T16:51:35.969 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-14T16:51:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-14T16:51:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-14T16:51:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-14T16:51:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-14T16:51:35.970 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:51:35.971 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:51:35.990 INFO:teuthology.orchestra.run.smithi158.stdout:(5/13): python3-websocket-client-0.56.0-5.el8.n 2.0 MB/s | 61 kB 00:00 2023-10-14T16:51:36.005 INFO:teuthology.orchestra.run.smithi158.stdout:(6/13): python3-google-auth-1.1.1-10.el8.noarch 399 kB/s | 81 kB 00:00 2023-10-14T16:51:36.129 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr-rook 2023-10-14T16:51:36.131 INFO:teuthology.orchestra.run.smithi158.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.1 MB/s | 155 kB 00:00 2023-10-14T16:51:36.151 INFO:teuthology.orchestra.run.smithi158.stdout:(8/13): python3-kubernetes-11.0.0-6.el8.noarch. 3.4 MB/s | 1.2 MB 00:00 2023-10-14T16:51:36.162 INFO:teuthology.orchestra.run.smithi158.stdout:(9/13): python3-requests-oauthlib-1.0.0-1.el8.n 273 kB/s | 43 kB 00:00 2023-10-14T16:51:36.242 INFO:teuthology.orchestra.run.smithi158.stdout:(10/13): python3-jsonpatch-1.21-2.el8.noarch.rp 241 kB/s | 27 kB 00:00 2023-10-14T16:51:36.301 INFO:teuthology.orchestra.run.smithi158.stdout:(11/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 844 kB/s | 126 kB 00:00 2023-10-14T16:51:36.302 INFO:teuthology.orchestra.run.smithi158.stdout:(12/13): python3-pyasn1-modules-0.3.7-6.el8.noa 784 kB/s | 110 kB 00:00 2023-10-14T16:51:36.330 INFO:teuthology.orchestra.run.smithi158.stdout:(13/13): python3-jsonpointer-1.10-11.el8.noarch 225 kB/s | 20 kB 00:00 2023-10-14T16:51:36.331 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:51:36.331 INFO:teuthology.orchestra.run.smithi158.stdout:Total 3.1 MB/s | 1.9 MB 00:00 2023-10-14T16:51:36.337 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:51:36.351 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:51:36.351 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:51:36.441 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:51:36.445 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:51:36.516 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:51:36.962 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:51:37.211 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-10-14T16:51:37.456 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rsa-4.9-2.el8.noarch 2/13 2023-10-14T16:51:37.682 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2023-10-14T16:51:37.924 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 4/13 2023-10-14T16:51:37.965 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:51:38.065 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:51:38.065 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:51:38.065 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:38.066 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-14T16:51:38.066 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-14T16:51:38.066 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-14T16:51:38.066 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-14T16:51:38.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-14T16:51:38.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-14T16:51:38.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-14T16:51:38.067 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:51:38.067 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:51:38.164 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 5/13 2023-10-14T16:51:38.206 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-rook 2023-10-14T16:51:38.447 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:03:08 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:51:38.473 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-10-14T16:51:38.571 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:51:38.754 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-10-14T16:51:39.000 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2023-10-14T16:51:39.217 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-10-14T16:51:39.434 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2023-10-14T16:51:40.364 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:51:40.366 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================================== 2023-10-14T16:51:40.366 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T16:51:40.366 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================================== 2023-10-14T16:51:40.366 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:51:40.367 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 47 k 2023-10-14T16:51:40.367 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-14T16:51:40.367 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T16:51:40.367 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T16:51:40.368 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T16:51:40.368 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T16:51:40.368 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T16:51:40.368 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T16:51:40.368 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T16:51:40.369 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T16:51:40.369 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T16:51:40.369 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T16:51:40.369 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T16:51:40.369 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T16:51:40.370 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:51:40.370 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:51:40.370 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================================== 2023-10-14T16:51:40.370 INFO:teuthology.orchestra.run.smithi008.stdout:Install 13 Packages 2023-10-14T16:51:40.370 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:51:40.371 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 1.9 M 2023-10-14T16:51:40.371 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 25 M 2023-10-14T16:51:40.372 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:51:40.448 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:02:57 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:51:40.595 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2023-10-14T16:51:40.927 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2023-10-14T16:51:40.929 INFO:teuthology.orchestra.run.smithi008.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 77 kB/s | 16 kB 00:00 2023-10-14T16:51:40.938 INFO:teuthology.orchestra.run.smithi008.stdout:(2/13): ceph-mgr-rook-17.2.6-1415.g9d6d32bb.el8 214 kB/s | 47 kB 00:00 2023-10-14T16:51:40.942 INFO:teuthology.orchestra.run.smithi008.stdout:(3/13): python3-cachetools-3.1.1-4.el8.noarch.r 146 kB/s | 33 kB 00:00 2023-10-14T16:51:41.054 INFO:teuthology.orchestra.run.smithi008.stdout:(4/13): python3-rsa-4.9-2.el8.noarch.rpm 574 kB/s | 64 kB 00:00 2023-10-14T16:51:41.069 INFO:teuthology.orchestra.run.smithi008.stdout:(5/13): python3-google-auth-1.1.1-10.el8.noarch 580 kB/s | 81 kB 00:00 2023-10-14T16:51:41.091 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 13/13 2023-10-14T16:51:41.124 INFO:teuthology.orchestra.run.smithi008.stdout:(6/13): python3-websocket-client-0.56.0-5.el8.n 884 kB/s | 61 kB 00:00 2023-10-14T16:51:41.163 INFO:teuthology.orchestra.run.smithi008.stdout:(7/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 284 kB/s | 27 kB 00:00 2023-10-14T16:51:41.238 INFO:teuthology.orchestra.run.smithi008.stdout:(8/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-10-14T16:51:41.260 INFO:teuthology.orchestra.run.smithi008.stdout:(9/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.1 MB/s | 110 kB 00:00 2023-10-14T16:51:41.273 INFO:teuthology.orchestra.run.smithi008.stdout:(10/13): python3-jsonpointer-1.10-11.el8.noarch 588 kB/s | 20 kB 00:00 2023-10-14T16:51:41.338 INFO:teuthology.orchestra.run.smithi008.stdout:(11/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 2.0 MB/s | 155 kB 00:00 2023-10-14T16:51:41.362 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 13/13 2023-10-14T16:51:41.362 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/13 2023-10-14T16:51:41.363 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2023-10-14T16:51:41.363 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2023-10-14T16:51:41.363 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2023-10-14T16:51:41.363 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2023-10-14T16:51:41.364 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 6/13 2023-10-14T16:51:41.364 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2023-10-14T16:51:41.364 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-10-14T16:51:41.364 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-10-14T16:51:41.364 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 10/13 2023-10-14T16:51:41.365 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 11/13 2023-10-14T16:51:41.365 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 12/13 2023-10-14T16:51:41.398 INFO:teuthology.orchestra.run.smithi008.stdout:(12/13): python3-requests-oauthlib-1.0.0-1.el8. 340 kB/s | 43 kB 00:00 2023-10-14T16:51:41.412 INFO:teuthology.orchestra.run.smithi008.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.5 MB/s | 1.2 MB 00:00 2023-10-14T16:51:41.416 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:51:41.416 INFO:teuthology.orchestra.run.smithi008.stdout:Total 1.8 MB/s | 1.9 MB 00:01 2023-10-14T16:51:41.424 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:51:41.441 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:51:41.441 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:51:41.549 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:51:41.554 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:51:42.072 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:51:42.283 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:51:42.284 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================================== 2023-10-14T16:51:42.285 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T16:51:42.285 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================================== 2023-10-14T16:51:42.285 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:51:42.285 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 47 k 2023-10-14T16:51:42.285 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-10-14T16:51:42.286 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T16:51:42.286 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T16:51:42.286 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T16:51:42.286 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T16:51:42.286 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T16:51:42.287 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T16:51:42.287 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T16:51:42.287 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T16:51:42.287 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T16:51:42.287 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T16:51:42.288 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T16:51:42.288 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T16:51:42.288 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:51:42.288 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:51:42.288 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================================== 2023-10-14T16:51:42.289 INFO:teuthology.orchestra.run.smithi155.stdout:Install 13 Packages 2023-10-14T16:51:42.289 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:51:42.289 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 1.9 M 2023-10-14T16:51:42.290 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 25 M 2023-10-14T16:51:42.290 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:51:42.363 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-10-14T16:51:42.430 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 13/13 2023-10-14T16:51:42.430 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:03:14 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:51:42.437 INFO:teuthology.orchestra.run.smithi155.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 181 kB/s | 16 kB 00:00 2023-10-14T16:51:42.449 INFO:teuthology.orchestra.run.smithi155.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 323 kB/s | 33 kB 00:00 2023-10-14T16:51:42.528 INFO:teuthology.orchestra.run.smithi155.stdout:(3/13): python3-google-auth-1.1.1-10.el8.noarch 905 kB/s | 81 kB 00:00 2023-10-14T16:51:42.569 INFO:teuthology.orchestra.run.smithi155.stdout:(4/13): ceph-mgr-rook-17.2.6-1415.g9d6d32bb.el8 214 kB/s | 47 kB 00:00 2023-10-14T16:51:42.570 INFO:teuthology.orchestra.run.smithi155.stdout:(5/13): python3-rsa-4.9-2.el8.noarch.rpm 1.5 MB/s | 64 kB 00:00 2023-10-14T16:51:42.634 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el8.noarch 2/13 2023-10-14T16:51:42.643 INFO:teuthology.orchestra.run.smithi155.stdout:(6/13): python3-kubernetes-11.0.0-6.el8.noarch. 6.0 MB/s | 1.2 MB 00:00 2023-10-14T16:51:42.699 INFO:teuthology.orchestra.run.smithi155.stdout:(7/13): python3-websocket-client-0.56.0-5.el8.n 471 kB/s | 61 kB 00:00 2023-10-14T16:51:42.713 INFO:teuthology.orchestra.run.smithi155.stdout:(8/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 187 kB/s | 27 kB 00:00 2023-10-14T16:51:42.771 INFO:teuthology.orchestra.run.smithi155.stdout:(9/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 986 kB/s | 126 kB 00:00 2023-10-14T16:51:42.826 INFO:teuthology.orchestra.run.smithi155.stdout:(10/13): python3-jsonpointer-1.10-11.el8.noarch 176 kB/s | 20 kB 00:00 2023-10-14T16:51:42.853 INFO:teuthology.orchestra.run.smithi155.stdout:(11/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 1.8 MB/s | 155 kB 00:00 2023-10-14T16:51:42.885 INFO:teuthology.orchestra.run.smithi155.stdout:(12/13): python3-pyasn1-modules-0.3.7-6.el8.noa 592 kB/s | 110 kB 00:00 2023-10-14T16:51:42.911 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2023-10-14T16:51:42.974 INFO:teuthology.orchestra.run.smithi155.stdout:(13/13): python3-requests-oauthlib-1.0.0-1.el8. 289 kB/s | 43 kB 00:00 2023-10-14T16:51:42.975 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:51:42.975 INFO:teuthology.orchestra.run.smithi155.stdout:Total 2.8 MB/s | 1.9 MB 00:00 2023-10-14T16:51:42.980 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:51:42.994 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:51:42.995 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:51:43.088 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:51:43.092 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:51:43.191 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/13 2023-10-14T16:51:43.439 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/13 2023-10-14T16:51:43.605 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:51:43.682 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 6/13 2023-10-14T16:51:43.875 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-10-14T16:51:43.951 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 7/13 2023-10-14T16:51:44.144 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el8.noarch 2/13 2023-10-14T16:51:44.209 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2023-10-14T16:51:44.425 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2023-10-14T16:51:44.436 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-10-14T16:51:44.683 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2023-10-14T16:51:44.837 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/13 2023-10-14T16:51:45.070 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/13 2023-10-14T16:51:45.287 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 6/13 2023-10-14T16:51:45.505 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 7/13 2023-10-14T16:51:45.746 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2023-10-14T16:51:45.926 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2023-10-14T16:51:45.987 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-10-14T16:51:46.228 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2023-10-14T16:51:46.243 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2023-10-14T16:51:46.373 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 13/13 2023-10-14T16:51:46.695 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 13/13 2023-10-14T16:51:46.695 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/13 2023-10-14T16:51:46.695 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2023-10-14T16:51:46.695 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2023-10-14T16:51:46.696 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2023-10-14T16:51:46.696 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2023-10-14T16:51:46.696 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 6/13 2023-10-14T16:51:46.696 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2023-10-14T16:51:46.696 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 8/13 2023-10-14T16:51:46.696 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 9/13 2023-10-14T16:51:46.697 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 10/13 2023-10-14T16:51:46.697 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-10-14T16:51:46.697 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 12/13 2023-10-14T16:51:47.403 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2023-10-14T16:51:47.682 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2023-10-14T16:51:47.821 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 13/13 2023-10-14T16:51:48.050 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 13/13 2023-10-14T16:51:48.050 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:03:18 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:51:48.090 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 13/13 2023-10-14T16:51:48.090 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/13 2023-10-14T16:51:48.091 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2023-10-14T16:51:48.091 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2023-10-14T16:51:48.091 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2023-10-14T16:51:48.091 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2023-10-14T16:51:48.092 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 6/13 2023-10-14T16:51:48.092 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2023-10-14T16:51:48.092 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 8/13 2023-10-14T16:51:48.092 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 9/13 2023-10-14T16:51:48.092 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 10/13 2023-10-14T16:51:48.093 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-10-14T16:51:48.093 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 12/13 2023-10-14T16:51:48.900 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:51:49.000 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:49.000 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:51:49.001 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:49.001 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T16:51:49.001 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T16:51:49.001 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T16:51:49.001 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T16:51:49.002 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T16:51:49.002 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T16:51:49.002 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T16:51:49.002 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T16:51:49.003 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T16:51:49.003 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T16:51:49.003 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T16:51:49.003 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T16:51:49.003 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:49.004 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:51:49.146 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-mgr-cephadm 2023-10-14T16:51:49.252 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 13/13 2023-10-14T16:51:49.252 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:03:06 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:51:49.519 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:51:51.501 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:03:23 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:51:53.368 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:51:53.368 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================================== 2023-10-14T16:51:53.369 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T16:51:53.369 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================================== 2023-10-14T16:51:53.369 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:51:53.369 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 121 k 2023-10-14T16:51:53.369 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-10-14T16:51:53.370 INFO:teuthology.orchestra.run.smithi158.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T16:51:53.370 INFO:teuthology.orchestra.run.smithi158.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T16:51:53.370 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T16:51:53.370 INFO:teuthology.orchestra.run.smithi158.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T16:51:53.370 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:53.371 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:51:53.371 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================================== 2023-10-14T16:51:53.371 INFO:teuthology.orchestra.run.smithi158.stdout:Install 5 Packages 2023-10-14T16:51:53.371 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:51:53.372 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 6.0 M 2023-10-14T16:51:53.372 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 26 M 2023-10-14T16:51:53.372 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:51:53.640 INFO:teuthology.orchestra.run.smithi158.stdout:(1/5): python3-natsort-7.1.1-2.el8.noarch.rpm 564 kB/s | 60 kB 00:00 2023-10-14T16:51:53.688 INFO:teuthology.orchestra.run.smithi158.stdout:(2/5): ceph-mgr-cephadm-17.2.6-1415.g9d6d32bb.e 782 kB/s | 121 kB 00:00 2023-10-14T16:51:53.723 INFO:teuthology.orchestra.run.smithi158.stdout:(3/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.4 MB/s | 476 kB 00:00 2023-10-14T16:51:53.824 INFO:teuthology.orchestra.run.smithi158.stdout:(4/5): python3-babel-2.5.1-5.el8.noarch.rpm 26 MB/s | 4.8 MB 00:00 2023-10-14T16:51:53.831 INFO:teuthology.orchestra.run.smithi158.stdout:(5/5): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 3.7 MB/s | 538 kB 00:00 2023-10-14T16:51:53.834 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:51:53.834 INFO:teuthology.orchestra.run.smithi158.stdout:Total 13 MB/s | 6.0 MB 00:00 2023-10-14T16:51:53.837 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:51:53.847 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:51:53.847 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:51:53.943 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:51:53.950 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:51:54.979 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:51:55.208 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:51:55.318 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:51:55.319 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:51:55.319 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:55.319 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T16:51:55.319 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T16:51:55.320 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T16:51:55.320 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T16:51:55.320 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T16:51:55.320 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T16:51:55.320 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T16:51:55.321 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T16:51:55.321 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T16:51:55.321 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T16:51:55.321 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T16:51:55.321 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T16:51:55.322 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:51:55.322 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:51:55.361 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/5 2023-10-14T16:51:55.578 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:51:55.658 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/5 2023-10-14T16:51:55.675 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:51:55.675 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:51:55.676 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:51:55.676 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T16:51:55.676 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T16:51:55.676 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T16:51:55.677 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T16:51:55.677 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T16:51:55.677 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T16:51:55.677 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T16:51:55.677 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T16:51:55.678 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T16:51:55.678 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T16:51:55.678 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T16:51:55.678 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T16:51:55.678 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:51:55.679 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:51:55.830 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-mgr-cephadm 2023-10-14T16:51:56.013 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-10-14T16:51:56.048 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-mgr-cephadm 2023-10-14T16:51:56.202 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:51:56.294 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-10-14T16:51:56.444 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:51:56.480 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 5/5 2023-10-14T16:51:56.724 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 5/5 2023-10-14T16:51:56.724 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/5 2023-10-14T16:51:56.724 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-10-14T16:51:56.724 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-10-14T16:51:56.725 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 4/5 2023-10-14T16:51:57.721 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/5 2023-10-14T16:51:57.722 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:03:29 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:51:58.138 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:03:28 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:51:58.154 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:03:15 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:51:59.996 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:51:59.997 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================================== 2023-10-14T16:51:59.997 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T16:51:59.997 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================================== 2023-10-14T16:51:59.998 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:51:59.998 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 121 k 2023-10-14T16:51:59.998 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-10-14T16:51:59.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T16:51:59.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T16:52:00.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T16:52:00.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T16:52:00.000 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:00.001 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:52:00.001 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================================== 2023-10-14T16:52:00.001 INFO:teuthology.orchestra.run.smithi155.stdout:Install 5 Packages 2023-10-14T16:52:00.002 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:00.003 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 6.0 M 2023-10-14T16:52:00.003 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 26 M 2023-10-14T16:52:00.004 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:52:00.240 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:52:00.241 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================================== 2023-10-14T16:52:00.241 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T16:52:00.241 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================================== 2023-10-14T16:52:00.242 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:52:00.242 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 121 k 2023-10-14T16:52:00.242 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-14T16:52:00.242 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T16:52:00.243 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T16:52:00.243 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T16:52:00.243 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T16:52:00.243 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:00.243 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:52:00.244 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================================== 2023-10-14T16:52:00.244 INFO:teuthology.orchestra.run.smithi008.stdout:Install 5 Packages 2023-10-14T16:52:00.244 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:00.245 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 6.0 M 2023-10-14T16:52:00.245 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 26 M 2023-10-14T16:52:00.245 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:52:00.293 INFO:teuthology.orchestra.run.smithi155.stdout:(1/5): ceph-mgr-cephadm-17.2.6-1415.g9d6d32bb.e 798 kB/s | 121 kB 00:00 2023-10-14T16:52:00.500 INFO:teuthology.orchestra.run.smithi155.stdout:(2/5): python3-babel-2.5.1-5.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2023-10-14T16:52:00.574 INFO:teuthology.orchestra.run.smithi008.stdout:(1/5): ceph-mgr-cephadm-17.2.6-1415.g9d6d32bb.e 438 kB/s | 121 kB 00:00 2023-10-14T16:52:00.592 INFO:teuthology.orchestra.run.smithi155.stdout:(3/5): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 5.7 MB/s | 538 kB 00:00 2023-10-14T16:52:00.661 INFO:teuthology.orchestra.run.smithi155.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 116 kB/s | 60 kB 00:00 2023-10-14T16:52:00.900 INFO:teuthology.orchestra.run.smithi008.stdout:(2/5): python3-babel-2.5.1-5.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-10-14T16:52:00.901 INFO:teuthology.orchestra.run.smithi008.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 100 kB/s | 60 kB 00:00 2023-10-14T16:52:00.965 INFO:teuthology.orchestra.run.smithi155.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 577 kB/s | 476 kB 00:00 2023-10-14T16:52:00.970 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:00.971 INFO:teuthology.orchestra.run.smithi155.stdout:Total 6.1 MB/s | 6.0 MB 00:00 2023-10-14T16:52:00.974 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:52:00.985 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:52:00.986 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:52:00.995 INFO:teuthology.orchestra.run.smithi008.stdout:(4/5): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 5.6 MB/s | 538 kB 00:00 2023-10-14T16:52:01.162 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:52:01.190 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:52:01.311 INFO:teuthology.orchestra.run.smithi008.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 469 kB/s | 476 kB 00:01 2023-10-14T16:52:01.315 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:01.316 INFO:teuthology.orchestra.run.smithi008.stdout:Total 5.5 MB/s | 6.0 MB 00:01 2023-10-14T16:52:01.320 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:52:01.333 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:52:01.333 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:52:01.457 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:52:01.461 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:52:02.535 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:52:02.718 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:52:02.961 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/5 2023-10-14T16:52:03.042 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:52:03.137 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/5 2023-10-14T16:52:03.140 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:03.140 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:52:03.141 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:52:03.141 INFO:teuthology.orchestra.run.smithi158.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T16:52:03.141 INFO:teuthology.orchestra.run.smithi158.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-14T16:52:03.141 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-14T16:52:03.142 INFO:teuthology.orchestra.run.smithi158.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T16:52:03.142 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:03.142 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:52:03.261 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-fuse 2023-10-14T16:52:03.327 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/5 2023-10-14T16:52:03.439 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/5 2023-10-14T16:52:03.635 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:03.694 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-10-14T16:52:03.788 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-10-14T16:52:03.995 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-10-14T16:52:04.082 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-10-14T16:52:04.204 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 5/5 2023-10-14T16:52:04.251 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 5/5 2023-10-14T16:52:04.489 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 5/5 2023-10-14T16:52:04.489 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/5 2023-10-14T16:52:04.490 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-10-14T16:52:04.490 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-10-14T16:52:04.490 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 4/5 2023-10-14T16:52:04.500 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 5/5 2023-10-14T16:52:04.500 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/5 2023-10-14T16:52:04.501 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-10-14T16:52:04.501 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-10-14T16:52:04.501 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 4/5 2023-10-14T16:52:05.378 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:03:37 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:52:05.636 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/5 2023-10-14T16:52:05.637 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:03:22 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:52:05.654 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/5 2023-10-14T16:52:05.654 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:03:35 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:52:07.183 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:52:07.184 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:52:07.184 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T16:52:07.184 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:52:07.184 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:52:07.185 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse 2023-10-14T16:52:07.185 INFO:teuthology.orchestra.run.smithi158.stdout: x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 876 k 2023-10-14T16:52:07.185 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-10-14T16:52:07.185 INFO:teuthology.orchestra.run.smithi158.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T16:52:07.185 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:07.186 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:52:07.186 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:52:07.186 INFO:teuthology.orchestra.run.smithi158.stdout:Install 2 Packages 2023-10-14T16:52:07.186 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:07.187 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 959 k 2023-10-14T16:52:07.187 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 3.1 M 2023-10-14T16:52:07.187 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:52:07.366 INFO:teuthology.orchestra.run.smithi158.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 458 kB/s | 83 kB 00:00 2023-10-14T16:52:07.404 INFO:teuthology.orchestra.run.smithi158.stdout:(2/2): ceph-fuse-17.2.6-1415.g9d6d32bb.el8.x86_ 3.9 MB/s | 876 kB 00:00 2023-10-14T16:52:07.404 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:07.405 INFO:teuthology.orchestra.run.smithi158.stdout:Total 4.3 MB/s | 959 kB 00:00 2023-10-14T16:52:07.406 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:52:07.427 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:52:07.427 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:52:07.511 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:52:07.515 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:52:07.695 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:52:08.113 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2023-10-14T16:52:08.286 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/2 2023-10-14T16:52:08.683 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/2 2023-10-14T16:52:08.684 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/2 2023-10-14T16:52:09.747 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2023-10-14T16:52:09.747 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:03:41 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:52:11.944 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:52:12.046 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:12.046 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:52:12.046 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:52:12.046 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T16:52:12.047 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-14T16:52:12.047 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-14T16:52:12.047 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T16:52:12.047 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:12.047 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:52:12.180 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-fuse 2023-10-14T16:52:12.555 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:12.825 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:52:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:12.932 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:52:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:52:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T16:52:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-14T16:52:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-14T16:52:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T16:52:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:12.934 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:52:13.070 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-fuse 2023-10-14T16:52:13.465 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:14.486 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:03:31 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:52:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:03:45 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:52:16.379 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:52:16.380 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:52:16.381 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T16:52:16.381 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:52:16.381 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:52:16.381 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse 2023-10-14T16:52:16.382 INFO:teuthology.orchestra.run.smithi155.stdout: x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 876 k 2023-10-14T16:52:16.382 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-10-14T16:52:16.382 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T16:52:16.382 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:16.382 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:52:16.383 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:52:16.383 INFO:teuthology.orchestra.run.smithi155.stdout:Install 2 Packages 2023-10-14T16:52:16.384 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:16.384 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 959 k 2023-10-14T16:52:16.384 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 3.1 M 2023-10-14T16:52:16.384 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:52:16.520 INFO:teuthology.orchestra.run.smithi155.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 593 kB/s | 83 kB 00:00 2023-10-14T16:52:16.599 INFO:teuthology.orchestra.run.smithi155.stdout:(2/2): ceph-fuse-17.2.6-1415.g9d6d32bb.el8.x86_ 3.9 MB/s | 876 kB 00:00 2023-10-14T16:52:16.600 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:16.601 INFO:teuthology.orchestra.run.smithi155.stdout:Total 4.3 MB/s | 959 kB 00:00 2023-10-14T16:52:16.601 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:52:16.623 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:52:16.623 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:52:16.707 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:52:16.712 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:52:16.803 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:52:16.890 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:52:16.902 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:16.902 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:52:16.902 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2023-10-14T16:52:16.903 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:16.903 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:52:17.057 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-volume 2023-10-14T16:52:17.433 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:17.454 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2023-10-14T16:52:17.647 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:52:17.648 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:52:17.648 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T16:52:17.648 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:52:17.648 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:52:17.648 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse 2023-10-14T16:52:17.649 INFO:teuthology.orchestra.run.smithi008.stdout: x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 876 k 2023-10-14T16:52:17.649 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-14T16:52:17.649 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T16:52:17.649 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:17.649 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:52:17.650 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:52:17.650 INFO:teuthology.orchestra.run.smithi008.stdout:Install 2 Packages 2023-10-14T16:52:17.650 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:17.651 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 959 k 2023-10-14T16:52:17.651 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 3.1 M 2023-10-14T16:52:17.651 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:52:17.707 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/2 2023-10-14T16:52:17.818 INFO:teuthology.orchestra.run.smithi008.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 488 kB/s | 83 kB 00:00 2023-10-14T16:52:18.017 INFO:teuthology.orchestra.run.smithi008.stdout:(2/2): ceph-fuse-17.2.6-1415.g9d6d32bb.el8.x86_ 2.3 MB/s | 876 kB 00:00 2023-10-14T16:52:18.017 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:18.018 INFO:teuthology.orchestra.run.smithi008.stdout:Total 2.5 MB/s | 959 kB 00:00 2023-10-14T16:52:18.019 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:52:18.042 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:52:18.042 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:52:18.103 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/2 2023-10-14T16:52:18.104 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/2 2023-10-14T16:52:18.131 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:52:18.136 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:52:18.331 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:52:18.639 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2023-10-14T16:52:18.836 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/2 2023-10-14T16:52:19.198 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2023-10-14T16:52:19.198 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:03:36 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:52:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/2 2023-10-14T16:52:19.231 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/2 2023-10-14T16:52:19.429 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:03:51 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:52:20.377 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2023-10-14T16:52:20.377 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:03:50 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:52:21.216 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:52:21.217 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:52:21.217 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T16:52:21.217 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:52:21.218 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:52:21.218 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-volume noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 267 k 2023-10-14T16:52:21.218 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:21.218 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:52:21.219 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:52:21.219 INFO:teuthology.orchestra.run.smithi158.stdout:Install 1 Package 2023-10-14T16:52:21.219 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:21.219 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 267 k 2023-10-14T16:52:21.219 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 1.3 M 2023-10-14T16:52:21.220 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:52:21.514 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-volume-17.2.6-1415.g9d6d32bb.el8.noarch.rp 901 kB/s | 267 kB 00:00 2023-10-14T16:52:21.515 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:21.516 INFO:teuthology.orchestra.run.smithi158.stdout:Total 896 kB/s | 267 kB 00:00 2023-10-14T16:52:21.516 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:52:21.526 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:52:21.526 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:52:21.577 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:52:21.581 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:52:21.761 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:52:22.084 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:52:22.534 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:52:23.545 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:52:23.545 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:03:55 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:52:25.612 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:52:25.719 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:25.719 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:52:25.719 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2023-10-14T16:52:25.720 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:25.720 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:52:25.828 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-volume 2023-10-14T16:52:26.225 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:27.459 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:52:27.557 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:27.557 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:52:27.558 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2023-10-14T16:52:27.558 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:27.558 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:52:27.703 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-volume 2023-10-14T16:52:28.080 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:28.101 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:03:58 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:52:30.009 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:52:30.010 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:52:30.010 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T16:52:30.011 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:52:30.011 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:52:30.011 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 267 k 2023-10-14T16:52:30.011 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:30.011 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:52:30.012 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:52:30.012 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-14T16:52:30.012 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:30.012 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 267 k 2023-10-14T16:52:30.012 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 1.3 M 2023-10-14T16:52:30.012 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:52:30.162 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:03:47 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:52:30.184 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-volume-17.2.6-1415.g9d6d32bb.el8.noarch.rp 1.5 MB/s | 267 kB 00:00 2023-10-14T16:52:30.185 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:30.185 INFO:teuthology.orchestra.run.smithi008.stdout:Total 1.5 MB/s | 267 kB 00:00 2023-10-14T16:52:30.186 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:52:30.197 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:52:30.197 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:52:30.220 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:52:30.224 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:52:30.415 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:52:30.571 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:52:30.668 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:30.668 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:52:30.668 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:52:30.668 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:30.669 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:52:30.735 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:52:30.800 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install librados-devel 2023-10-14T16:52:31.157 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:52:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:32.030 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:52:32.031 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:52:32.031 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T16:52:32.031 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:52:32.031 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:52:32.031 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 267 k 2023-10-14T16:52:32.032 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:32.032 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:52:32.032 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:52:32.032 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-10-14T16:52:32.032 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:32.033 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 267 k 2023-10-14T16:52:32.033 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 1.3 M 2023-10-14T16:52:32.033 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:52:32.262 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:52:32.263 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:04:02 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:52:32.326 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-volume-17.2.6-1415.g9d6d32bb.el8.noarch.rp 907 kB/s | 267 kB 00:00 2023-10-14T16:52:32.327 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:32.327 INFO:teuthology.orchestra.run.smithi155.stdout:Total 903 kB/s | 267 kB 00:00 2023-10-14T16:52:32.327 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:52:32.337 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:52:32.338 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:52:32.366 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:52:32.370 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:52:32.555 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:52:33.019 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:04:05 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:52:33.089 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:52:33.504 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:52:34.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T16:52:34.665 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:03:51 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:52:34.834 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:52:34.836 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:52:34.836 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repo Size 2023-10-14T16:52:34.837 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:52:34.837 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:52:34.837 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 130 k 2023-10-14T16:52:34.837 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:34.838 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:52:34.838 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:52:34.838 INFO:teuthology.orchestra.run.smithi158.stdout:Install 1 Package 2023-10-14T16:52:34.839 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:34.839 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 130 k 2023-10-14T16:52:34.839 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 464 k 2023-10-14T16:52:34.840 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:52:35.094 INFO:teuthology.orchestra.run.smithi158.stdout:librados-devel-17.2.6-1415.g9d6d32bb.el8.x86_64 504 kB/s | 130 kB 00:00 2023-10-14T16:52:35.094 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:35.095 INFO:teuthology.orchestra.run.smithi158.stdout:Total 501 kB/s | 130 kB 00:00 2023-10-14T16:52:35.095 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:52:35.102 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:52:35.102 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:52:35.157 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:52:35.162 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:52:35.279 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:52:35.489 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:52:35.746 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:52:36.765 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:52:36.766 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:04:08 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:52:37.229 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:52:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:37.337 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:52:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:52:37.337 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:37.338 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:52:37.608 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install librados-devel 2023-10-14T16:52:38.009 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:39.196 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:52:39.292 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:39.292 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:52:39.293 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T16:52:39.293 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:39.293 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:52:39.415 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install librados-devel 2023-10-14T16:52:39.747 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:04:09 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:52:39.790 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:41.575 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:03:58 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:52:41.707 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:52:41.708 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:52:41.709 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repo Size 2023-10-14T16:52:41.709 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:52:41.709 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:52:41.709 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 130 k 2023-10-14T16:52:41.709 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:41.710 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:52:41.710 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:52:41.710 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-14T16:52:41.710 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:41.710 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 130 k 2023-10-14T16:52:41.711 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 464 k 2023-10-14T16:52:41.711 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:52:41.863 INFO:teuthology.orchestra.run.smithi008.stdout:librados-devel-17.2.6-1415.g9d6d32bb.el8.x86_64 847 kB/s | 130 kB 00:00 2023-10-14T16:52:41.864 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:41.864 INFO:teuthology.orchestra.run.smithi008.stdout:Total 839 kB/s | 130 kB 00:00 2023-10-14T16:52:41.864 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:52:41.871 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:52:41.871 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:52:41.894 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:52:41.931 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:52:41.936 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:52:41.992 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:41.992 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:52:41.992 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:52:41.992 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:41.993 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:52:42.061 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:52:42.119 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install libcephfs2 2023-10-14T16:52:42.265 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:52:42.494 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:42.541 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:52:43.450 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:52:43.451 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:52:43.451 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2023-10-14T16:52:43.451 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:52:43.451 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:52:43.452 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 130 k 2023-10-14T16:52:43.452 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:43.452 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:52:43.452 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:52:43.452 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-10-14T16:52:43.452 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:43.453 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 130 k 2023-10-14T16:52:43.453 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 464 k 2023-10-14T16:52:43.453 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:52:43.620 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:52:43.621 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:04:13 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:52:43.684 INFO:teuthology.orchestra.run.smithi155.stdout:librados-devel-17.2.6-1415.g9d6d32bb.el8.x86_64 556 kB/s | 130 kB 00:00 2023-10-14T16:52:43.685 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:43.685 INFO:teuthology.orchestra.run.smithi155.stdout:Total 552 kB/s | 130 kB 00:00 2023-10-14T16:52:43.686 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:52:43.692 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:52:43.692 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:52:43.761 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:52:43.766 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:52:43.997 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:52:44.169 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:52:44.274 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:04:16 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:52:44.448 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:52:45.572 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:52:45.573 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:02 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:52:45.627 INFO:teuthology.orchestra.run.smithi158.stdout:Package libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:52:46.102 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:52:46.103 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T16:52:46.103 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:52:46.219 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install libcephfs-devel 2023-10-14T16:52:46.594 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:48.479 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:04:20 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:52:50.281 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:52:50.282 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:52:50.282 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repo Size 2023-10-14T16:52:50.283 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:52:50.283 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:52:50.283 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 25 k 2023-10-14T16:52:50.283 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:50.283 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:52:50.284 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:52:50.284 INFO:teuthology.orchestra.run.smithi158.stdout:Install 1 Package 2023-10-14T16:52:50.284 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:50.284 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 25 k 2023-10-14T16:52:50.284 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 109 k 2023-10-14T16:52:50.285 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:52:50.393 INFO:teuthology.orchestra.run.smithi158.stdout:libcephfs-devel-17.2.6-1415.g9d6d32bb.el8.x86_6 225 kB/s | 25 kB 00:00 2023-10-14T16:52:50.398 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:50.399 INFO:teuthology.orchestra.run.smithi158.stdout:Total 222 kB/s | 25 kB 00:00 2023-10-14T16:52:50.399 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:52:50.399 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:52:50.399 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:52:50.400 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:52:50.405 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:52:50.423 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:52:50.493 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:52:50.531 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:50.532 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:52:50.532 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:52:50.532 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:50.532 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:52:50.636 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:52:50.649 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install libcephfs2 2023-10-14T16:52:50.879 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:52:51.046 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:51.878 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:52:51.879 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:04:23 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:52:52.197 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:52:52.295 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:52.295 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:52:52.295 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:52:52.295 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:52:52.296 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:52:52.452 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install libcephfs2 2023-10-14T16:52:52.827 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:52.902 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:04:22 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:52:54.571 INFO:teuthology.orchestra.run.smithi008.stdout:Package libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:52:54.805 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:11 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:52:55.070 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:52:55.071 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T16:52:55.071 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:52:55.173 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install libcephfs-devel 2023-10-14T16:52:55.568 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:56.150 INFO:teuthology.orchestra.run.smithi155.stdout:Package libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:52:56.622 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:52:56.624 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T16:52:56.624 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:52:56.726 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install libcephfs-devel 2023-10-14T16:52:57.101 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:57.470 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:04:27 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:52:58.576 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:52:58.671 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:58.672 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:52:58.672 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:52:58.672 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:52:58.673 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:52:58.833 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install librados2 2023-10-14T16:52:59.174 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:16 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:52:59.210 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:52:59.410 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:52:59.411 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:52:59.413 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repo Size 2023-10-14T16:52:59.413 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:52:59.413 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:52:59.414 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 25 k 2023-10-14T16:52:59.414 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:59.414 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:52:59.414 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:52:59.414 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-14T16:52:59.415 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:52:59.415 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 25 k 2023-10-14T16:52:59.415 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 109 k 2023-10-14T16:52:59.415 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:52:59.607 INFO:teuthology.orchestra.run.smithi008.stdout:libcephfs-devel-17.2.6-1415.g9d6d32bb.el8.x86_6 127 kB/s | 25 kB 00:00 2023-10-14T16:52:59.608 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:52:59.608 INFO:teuthology.orchestra.run.smithi008.stdout:Total 126 kB/s | 25 kB 00:00 2023-10-14T16:52:59.609 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:52:59.612 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:52:59.613 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:52:59.615 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:52:59.621 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:52:59.683 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:52:59.830 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:00.110 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:00.841 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:04:32 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:53:01.010 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:53:01.011 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:53:01.011 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2023-10-14T16:53:01.012 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:53:01.012 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:53:01.012 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 25 k 2023-10-14T16:53:01.012 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:53:01.013 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:53:01.013 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:53:01.013 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-10-14T16:53:01.013 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:53:01.013 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 25 k 2023-10-14T16:53:01.014 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 109 k 2023-10-14T16:53:01.014 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:53:01.210 INFO:teuthology.orchestra.run.smithi155.stdout:libcephfs-devel-17.2.6-1415.g9d6d32bb.el8.x86_6 125 kB/s | 25 kB 00:00 2023-10-14T16:53:01.211 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:53:01.212 INFO:teuthology.orchestra.run.smithi155.stdout:Total 124 kB/s | 25 kB 00:00 2023-10-14T16:53:01.212 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:53:01.215 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:53:01.216 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:53:01.218 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:53:01.222 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:53:01.225 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:01.225 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:04:31 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:53:01.280 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:53:01.458 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:01.704 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:02.199 INFO:teuthology.orchestra.run.smithi158.stdout:Package librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:02.674 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:53:02.675 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T16:53:02.676 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:53:02.748 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:19 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:53:02.790 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install librbd1 2023-10-14T16:53:03.162 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:04.850 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:04:36 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:53:06.198 INFO:teuthology.orchestra.run.smithi158.stdout:Package librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:06.559 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:53:06.665 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:53:06.665 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:53:06.665 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:53:06.665 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:53:06.665 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:53:06.671 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:53:06.673 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T16:53:06.673 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:53:06.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install librados2 2023-10-14T16:53:06.812 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install python3-rados 2023-10-14T16:53:07.187 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:07.188 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:08.706 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:53:08.803 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:53:08.803 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:53:08.803 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:53:08.803 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:53:08.804 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:53:08.923 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install librados2 2023-10-14T16:53:08.956 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:04:40 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:53:09.103 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:04:39 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:53:09.301 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:10.273 INFO:teuthology.orchestra.run.smithi158.stdout:Package python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:10.619 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:10.742 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:53:10.743 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T16:53:10.743 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:53:10.859 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install python3-rgw 2023-10-14T16:53:11.070 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:28 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:53:11.111 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:53:11.113 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T16:53:11.113 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:53:11.212 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install librbd1 2023-10-14T16:53:11.232 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:11.606 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:12.439 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:12.805 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:04:44 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:53:12.914 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:53:12.915 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T16:53:12.916 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:53:13.024 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install librbd1 2023-10-14T16:53:13.357 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:04:43 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:53:13.395 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:14.130 INFO:teuthology.orchestra.run.smithi158.stdout:Package python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:14.605 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:53:14.606 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T16:53:14.606 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:53:14.746 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install python3-cephfs 2023-10-14T16:53:14.793 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:15.117 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:15.136 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:32 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:53:15.293 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:53:15.294 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T16:53:15.294 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:53:15.396 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install python3-rados 2023-10-14T16:53:15.790 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:16.553 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:16.786 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:04:48 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:53:17.036 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:53:17.037 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T16:53:17.037 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:53:17.140 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-rados 2023-10-14T16:53:17.512 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:17.770 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:04:47 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:53:18.146 INFO:teuthology.orchestra.run.smithi158.stdout:Package python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:18.630 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:53:18.631 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T16:53:18.631 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:53:18.744 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install python3-rbd 2023-10-14T16:53:19.123 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:19.195 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:36 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:53:19.201 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:19.697 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:53:19.698 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T16:53:19.698 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:53:19.794 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install python3-rgw 2023-10-14T16:53:20.188 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:20.555 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:20.853 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:04:52 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:53:21.044 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:53:21.045 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T16:53:21.046 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:53:21.149 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-rgw 2023-10-14T16:53:21.525 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:22.187 INFO:teuthology.orchestra.run.smithi158.stdout:Package python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:22.229 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:04:52 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:53:22.657 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:53:22.658 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T16:53:22.658 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:53:22.777 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install rbd-fuse 2023-10-14T16:53:23.151 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:23.378 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:40 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:53:23.709 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:24.200 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:53:24.202 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T16:53:24.202 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:53:24.311 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install python3-cephfs 2023-10-14T16:53:24.709 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:24.754 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:24.797 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:04:56 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:53:25.227 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:53:25.228 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T16:53:25.228 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:53:25.339 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-cephfs 2023-10-14T16:53:25.712 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:26.473 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:04:56 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:53:26.706 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:53:26.708 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:53:26.708 INFO:teuthology.orchestra.run.smithi158.stdout: Package Architecture Version Repository Size 2023-10-14T16:53:26.708 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:53:26.709 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:53:26.709 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 90 k 2023-10-14T16:53:26.709 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:53:26.710 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:53:26.710 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:53:26.710 INFO:teuthology.orchestra.run.smithi158.stdout:Install 1 Package 2023-10-14T16:53:26.711 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:53:26.711 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 90 k 2023-10-14T16:53:26.711 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 264 k 2023-10-14T16:53:26.712 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:53:26.942 INFO:teuthology.orchestra.run.smithi158.stdout:rbd-fuse-17.2.6-1415.g9d6d32bb.el8.x86_64.rpm 386 kB/s | 90 kB 00:00 2023-10-14T16:53:26.942 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:53:26.943 INFO:teuthology.orchestra.run.smithi158.stdout:Total 384 kB/s | 90 kB 00:00 2023-10-14T16:53:26.943 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:53:26.954 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:53:26.955 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:53:27.010 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:53:27.015 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:53:27.138 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:53:27.355 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:27.625 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:27.688 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:44 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:53:27.941 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:28.456 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:53:28.457 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T16:53:28.457 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:53:28.569 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install python3-rbd 2023-10-14T16:53:28.617 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:28.618 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:05:00 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:53:28.964 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:29.103 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:29.578 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:53:29.579 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T16:53:29.579 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:53:29.681 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install python3-rbd 2023-10-14T16:53:30.053 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:30.889 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:05:00 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:53:32.104 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:49 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:53:32.334 INFO:teuthology.orchestra.run.smithi008.stdout:Package python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:32.830 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:53:32.832 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T16:53:32.832 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:53:32.929 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install rbd-fuse 2023-10-14T16:53:33.323 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:33.503 INFO:teuthology.orchestra.run.smithi155.stdout:Package python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 is already installed. 2023-10-14T16:53:33.975 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:53:33.977 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T16:53:33.977 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:53:34.088 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install rbd-fuse 2023-10-14T16:53:34.464 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:35.447 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:05:05 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:53:35.799 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:53:35.896 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:53:35.896 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:53:35.896 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:53:35.897 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:53:35.897 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:53:36.023 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install rbd-mirror 2023-10-14T16:53:36.284 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:53 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:53:36.400 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:37.454 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:53:37.455 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:53:37.455 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-14T16:53:37.455 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:53:37.455 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:53:37.456 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 90 k 2023-10-14T16:53:37.456 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:53:37.456 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:53:37.456 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:53:37.457 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-14T16:53:37.457 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:53:37.457 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 90 k 2023-10-14T16:53:37.457 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 264 k 2023-10-14T16:53:37.457 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:53:37.684 INFO:teuthology.orchestra.run.smithi008.stdout:rbd-fuse-17.2.6-1415.g9d6d32bb.el8.x86_64.rpm 395 kB/s | 90 kB 00:00 2023-10-14T16:53:37.685 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:53:37.686 INFO:teuthology.orchestra.run.smithi008.stdout:Total 393 kB/s | 90 kB 00:00 2023-10-14T16:53:37.686 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:53:37.698 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:53:37.699 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:53:37.758 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:53:37.763 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:53:37.883 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:53:38.058 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:38.141 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:53:38.142 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:53:38.142 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2023-10-14T16:53:38.142 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:53:38.142 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:53:38.143 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 90 k 2023-10-14T16:53:38.143 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:53:38.143 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:53:38.143 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:53:38.143 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-10-14T16:53:38.144 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:53:38.144 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 90 k 2023-10-14T16:53:38.144 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 264 k 2023-10-14T16:53:38.144 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:53:38.235 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:05:10 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:53:38.375 INFO:teuthology.orchestra.run.smithi155.stdout:rbd-fuse-17.2.6-1415.g9d6d32bb.el8.x86_64.rpm 388 kB/s | 90 kB 00:00 2023-10-14T16:53:38.376 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:53:38.376 INFO:teuthology.orchestra.run.smithi155.stdout:Total 386 kB/s | 90 kB 00:00 2023-10-14T16:53:38.376 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:53:38.382 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:38.388 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:53:38.388 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:53:38.443 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:53:38.448 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:53:38.589 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:53:38.769 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:39.034 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:39.543 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:39.544 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:05:09 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:53:40.049 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:53:40.050 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:53:40.050 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repo Size 2023-10-14T16:53:40.050 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:53:40.051 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:53:40.051 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T16:53:40.051 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:53:40.051 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:53:40.051 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:53:40.051 INFO:teuthology.orchestra.run.smithi158.stdout:Install 1 Package 2023-10-14T16:53:40.052 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:53:40.052 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 3.5 M 2023-10-14T16:53:40.053 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 16 M 2023-10-14T16:53:40.053 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:53:40.172 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:40.172 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:04:57 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:53:40.359 INFO:teuthology.orchestra.run.smithi158.stdout:rbd-mirror-17.2.6-1415.g9d6d32bb.el8.x86_64.rpm 11 MB/s | 3.5 MB 00:00 2023-10-14T16:53:40.360 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:53:40.361 INFO:teuthology.orchestra.run.smithi158.stdout:Total 11 MB/s | 3.5 MB 00:00 2023-10-14T16:53:40.361 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:53:40.374 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:53:40.374 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:53:40.443 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:53:40.448 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:53:40.894 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:53:41.121 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:41.575 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:42.581 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:42.582 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:05:14 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:53:43.504 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:53:43.611 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:53:43.611 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:53:43.611 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:53:43.611 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:53:43.612 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:53:43.726 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install rbd-mirror 2023-10-14T16:53:44.121 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:45.149 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:53:45.248 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:53:45.248 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:53:45.248 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:53:45.248 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:53:45.248 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:53:45.380 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install rbd-mirror 2023-10-14T16:53:45.755 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:45.922 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:05:15 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:53:47.618 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:05:04 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:53:47.821 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:53:47.822 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:53:47.822 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repo Size 2023-10-14T16:53:47.822 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:53:47.823 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:53:47.823 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T16:53:47.823 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:53:47.823 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:53:47.824 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:53:47.824 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-14T16:53:47.824 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:53:47.824 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 3.5 M 2023-10-14T16:53:47.824 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 16 M 2023-10-14T16:53:47.825 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:53:48.238 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:53:48.335 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:53:48.335 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:53:48.335 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:53:48.335 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:53:48.336 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:53:48.462 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install rbd-nbd 2023-10-14T16:53:48.811 INFO:teuthology.orchestra.run.smithi008.stdout:rbd-mirror-17.2.6-1415.g9d6d32bb.el8.x86_64.rpm 3.5 MB/s | 3.5 MB 00:00 2023-10-14T16:53:48.812 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:53:48.813 INFO:teuthology.orchestra.run.smithi008.stdout:Total 3.5 MB/s | 3.5 MB 00:00 2023-10-14T16:53:48.813 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:53:48.829 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:53:48.829 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:53:48.838 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:48.903 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:53:48.908 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:53:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:53:49.442 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:53:49.443 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:53:49.443 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2023-10-14T16:53:49.444 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:53:49.444 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:53:49.444 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T16:53:49.444 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:53:49.445 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:53:49.445 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:53:49.445 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-10-14T16:53:49.445 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:53:49.445 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 3.5 M 2023-10-14T16:53:49.446 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 16 M 2023-10-14T16:53:49.446 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:53:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:49.932 INFO:teuthology.orchestra.run.smithi155.stdout:rbd-mirror-17.2.6-1415.g9d6d32bb.el8.x86_64.rpm 7.1 MB/s | 3.5 MB 00:00 2023-10-14T16:53:49.933 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:53:49.934 INFO:teuthology.orchestra.run.smithi155.stdout:Total 7.0 MB/s | 3.5 MB 00:00 2023-10-14T16:53:49.934 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:53:49.948 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:53:49.948 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:53:50.015 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:53:50.020 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:53:50.062 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:50.472 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:53:50.688 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:05:22 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:53:50.869 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:51.224 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:51.224 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:05:21 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:53:51.289 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:52.390 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:52.391 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:05:09 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:53:52.557 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T16:53:52.558 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:53:52.559 INFO:teuthology.orchestra.run.smithi158.stdout: Package Architecture Version Repository Size 2023-10-14T16:53:52.559 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:53:52.559 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-10-14T16:53:52.559 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T16:53:52.560 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:53:52.560 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T16:53:52.560 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T16:53:52.560 INFO:teuthology.orchestra.run.smithi158.stdout:Install 1 Package 2023-10-14T16:53:52.561 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:53:52.561 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 174 k 2023-10-14T16:53:52.561 INFO:teuthology.orchestra.run.smithi158.stdout:Installed size: 552 k 2023-10-14T16:53:52.561 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-10-14T16:53:53.009 INFO:teuthology.orchestra.run.smithi158.stdout:rbd-nbd-17.2.6-1415.g9d6d32bb.el8.x86_64.rpm 385 kB/s | 174 kB 00:00 2023-10-14T16:53:53.010 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:53:53.010 INFO:teuthology.orchestra.run.smithi158.stdout:Total 384 kB/s | 174 kB 00:00 2023-10-14T16:53:53.010 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T16:53:53.023 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T16:53:53.023 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T16:53:53.078 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T16:53:53.083 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T16:53:53.213 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T16:53:53.409 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:53.713 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:54.706 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:53:54.706 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:05:26 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T16:53:58.293 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:53:58.394 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:53:58.394 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:53:58.395 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:53:58.395 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:53:58.395 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:53:58.510 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install rbd-nbd 2023-10-14T16:53:58.549 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:53:58.655 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:53:58.655 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:53:58.655 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:53:58.655 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:53:58.656 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:53:58.779 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install rbd-nbd 2023-10-14T16:53:58.887 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T16:53:59.174 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T16:54:00.584 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T16:54:00.613 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:05:17 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:54:00.682 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:00.683 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-10-14T16:54:00.683 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:54:00.683 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:00.683 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T16:54:00.818 DEBUG:teuthology.parallel:result is None 2023-10-14T16:54:00.963 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:05:30 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:54:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T16:54:02.489 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:54:02.490 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2023-10-14T16:54:02.490 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:54:02.490 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-14T16:54:02.490 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T16:54:02.491 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:02.491 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T16:54:02.491 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T16:54:02.491 INFO:teuthology.orchestra.run.smithi155.stdout:Install 1 Package 2023-10-14T16:54:02.491 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:02.491 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 174 k 2023-10-14T16:54:02.492 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 552 k 2023-10-14T16:54:02.492 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-14T16:54:02.681 INFO:teuthology.orchestra.run.smithi155.stdout:rbd-nbd-17.2.6-1415.g9d6d32bb.el8.x86_64.rpm 897 kB/s | 174 kB 00:00 2023-10-14T16:54:02.682 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:54:02.682 INFO:teuthology.orchestra.run.smithi155.stdout:Total 890 kB/s | 174 kB 00:00 2023-10-14T16:54:02.683 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T16:54:02.695 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T16:54:02.695 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T16:54:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T16:54:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T16:54:02.877 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T16:54:02.878 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:54:02.879 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-14T16:54:02.879 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:54:02.879 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-14T16:54:02.879 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T16:54:02.879 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:02.880 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T16:54:02.880 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T16:54:02.880 INFO:teuthology.orchestra.run.smithi008.stdout:Install 1 Package 2023-10-14T16:54:02.880 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:02.880 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 174 k 2023-10-14T16:54:02.881 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 552 k 2023-10-14T16:54:02.881 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-14T16:54:02.884 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T16:54:03.065 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:54:03.229 INFO:teuthology.orchestra.run.smithi008.stdout:rbd-nbd-17.2.6-1415.g9d6d32bb.el8.x86_64.rpm 496 kB/s | 174 kB 00:00 2023-10-14T16:54:03.230 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-14T16:54:03.231 INFO:teuthology.orchestra.run.smithi008.stdout:Total 494 kB/s | 174 kB 00:00 2023-10-14T16:54:03.231 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T16:54:03.245 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T16:54:03.245 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T16:54:03.305 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T16:54:03.310 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T16:54:03.337 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:54:03.452 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T16:54:03.622 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:54:03.912 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:54:04.424 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:54:04.424 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:05:21 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T16:54:05.101 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T16:54:05.101 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:05:35 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T16:54:10.379 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T16:54:10.476 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:10.477 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-14T16:54:10.477 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:54:10.477 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:10.477 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T16:54:10.593 DEBUG:teuthology.parallel:result is None 2023-10-14T16:54:11.986 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T16:54:12.093 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:12.093 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-14T16:54:12.093 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T16:54:12.094 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:12.094 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T16:54:12.223 DEBUG:teuthology.parallel:result is None 2023-10-14T16:54:12.224 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T16:54:12.383 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T16:54:12.403 INFO:teuthology.orchestra.run.smithi008.stdout:17.2.6-1415.g9d6d32bb.el8 2023-10-14T16:54:12.404 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1415.g9d6d32bb.el8 2023-10-14T16:54:12.404 INFO:teuthology.task.install:The correct ceph version 17.2.6-1415.g9d6d32bb is installed. 2023-10-14T16:54:12.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T16:54:12.629 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T16:54:12.650 INFO:teuthology.orchestra.run.smithi155.stdout:17.2.6-1415.g9d6d32bb.el8 2023-10-14T16:54:12.651 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1415.g9d6d32bb.el8 2023-10-14T16:54:12.651 INFO:teuthology.task.install:The correct ceph version 17.2.6-1415.g9d6d32bb is installed. 2023-10-14T16:54:12.652 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T16:54:12.800 DEBUG:teuthology.orchestra.run.smithi158:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T16:54:12.824 INFO:teuthology.orchestra.run.smithi158.stdout:17.2.6-1415.g9d6d32bb.el8 2023-10-14T16:54:12.825 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1415.g9d6d32bb.el8 2023-10-14T16:54:12.825 INFO:teuthology.task.install:The correct ceph version 17.2.6-1415.g9d6d32bb is installed. 2023-10-14T16:54:12.825 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T16:54:12.826 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:12.826 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T16:54:12.855 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:12.856 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T16:54:12.883 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-14T16:54:12.883 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T16:54:12.912 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T16:54:12.913 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:12.913 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T16:54:12.941 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T16:54:13.009 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:13.009 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T16:54:13.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T16:54:13.100 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-14T16:54:13.101 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T16:54:13.127 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T16:54:13.194 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T16:54:13.194 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:13.194 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T16:54:13.223 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T16:54:13.289 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:13.290 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T16:54:13.316 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T16:54:13.380 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-14T16:54:13.380 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T16:54:13.404 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T16:54:13.469 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T16:54:13.469 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:13.469 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T16:54:13.496 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T16:54:13.563 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:13.563 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T16:54:13.588 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T16:54:13.653 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-14T16:54:13.654 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T16:54:13.677 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T16:54:13.742 INFO:teuthology.run_tasks:Running task ceph... 2023-10-14T16:54:13.803 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-14T16:54:13.804 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /var/log/ceph 2023-10-14T16:54:13.806 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2023-10-14T16:54:13.809 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 777 /var/log/ceph 2023-10-14T16:54:13.832 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-14T16:54:13.833 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T16:54:13.874 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T16:54:13.876 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T16:54:13.900 INFO:tasks.ceph:Creating extra log directories... 2023-10-14T16:54:13.900 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T16:54:13.941 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T16:54:13.943 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T16:54:13.972 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-14T16:54:13.973 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-14T16:54:13.973 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-14T16:54:13.973 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:13.974 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T16:54:14.022 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:14.139 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:14.165 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:14.165 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T16:54:14.179 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:14.291 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:14.315 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-14T16:54:14.315 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T16:54:14.330 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:14.441 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:14.471 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-14T16:54:14.471 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-14T16:54:14.472 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843', 'branch': 'quincy-release', 'description': 'smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/libcephfs_interface_tests}}', 'email': None, 'first_in_suite': False, 'job_id': '7427843', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 2, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 10}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'quincy-release'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'quincy-release', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mds.a', 'mgr.x', 'osd.0', 'osd.1'], ['mon.b', 'mds.b', 'mon.c', 'mgr.y', 'osd.2', 'osd.3'], ['client.0']], 'seed': 7103, 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'smoke', 'suite_branch': 'quincy-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'targets': {'smithi008.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD2V1pydE/Nblj3F4zQzonPePLslsJxTqHZe77IvppnxXBBQTRtAw4C/kCVRrQ5GV1qjj48Pi6CWkzVdTuZmKxE=', 'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNaUt6XRwPyW83NOO/DkbIe/LUU6Y2Cn96Nv3CIAiYNCssmdJz9Js0dvmPROFs6P2o6JmTgg2g2gCpslr8k39SI=', 'smithi158.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwgx9MI7rNF66HyQBifvvzkRYTwdRRWRfiNkc1T8eFE2sG5claga68c6UZUAR8BcwSDUK0UWyjKdviBBBruHlU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'cleanup': True, 'flavor': 'default', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}}, {'ceph': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'client.0': ['libcephfs/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-14_16:11:58', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-14T16:54:14.472 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T16:54:14.475 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T16:54:14.477 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T16:54:14.522 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T16:54:14.531 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T16:54:14.533 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T16:54:14.586 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:14.586 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T16:54:14.611 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T16:54:14.612 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2023-10-14T16:54:14.667 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T16:54:14.668 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T16:54:14.668 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 220495 Links: 1 2023-10-14T16:54:14.668 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T16:54:14.668 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T16:54:14.669 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-14 16:53:49.815766237 +0000 2023-10-14T16:54:14.669 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-14 16:47:41.134506973 +0000 2023-10-14T16:54:14.669 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-14 16:47:41.134506973 +0000 2023-10-14T16:54:14.669 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-10-14T16:54:14.670 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T16:54:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-14T16:54:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-14T16:54:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000150524 s, 3.4 MB/s 2023-10-14T16:54:14.733 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T16:54:14.790 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2023-10-14T16:54:14.846 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T16:54:14.846 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T16:54:14.847 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 220578 Links: 1 2023-10-14T16:54:14.847 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T16:54:14.847 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T16:54:14.847 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-14 16:53:49.815766237 +0000 2023-10-14T16:54:14.847 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-14 16:47:41.650501642 +0000 2023-10-14T16:54:14.848 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-14 16:47:41.650501642 +0000 2023-10-14T16:54:14.848 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-10-14T16:54:14.848 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T16:54:14.910 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-14T16:54:14.911 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-14T16:54:14.911 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 9.7149e-05 s, 5.3 MB/s 2023-10-14T16:54:14.912 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T16:54:14.968 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2023-10-14T16:54:15.024 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T16:54:15.024 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T16:54:15.024 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 219952 Links: 1 2023-10-14T16:54:15.025 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T16:54:15.025 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T16:54:15.025 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-14 16:53:49.815766237 +0000 2023-10-14T16:54:15.025 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-14 16:47:42.142496579 +0000 2023-10-14T16:54:15.025 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-14 16:47:42.142496579 +0000 2023-10-14T16:54:15.026 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-10-14T16:54:15.026 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T16:54:15.088 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-14T16:54:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-14T16:54:15.089 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 9.3894e-05 s, 5.5 MB/s 2023-10-14T16:54:15.090 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T16:54:15.147 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2023-10-14T16:54:15.202 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T16:54:15.202 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T16:54:15.202 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 219019 Links: 1 2023-10-14T16:54:15.203 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T16:54:15.203 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T16:54:15.203 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-14 16:53:49.815766237 +0000 2023-10-14T16:54:15.203 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-14 16:47:42.668491167 +0000 2023-10-14T16:54:15.203 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-14 16:47:42.668491167 +0000 2023-10-14T16:54:15.204 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-10-14T16:54:15.204 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T16:54:15.266 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-14T16:54:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-14T16:54:15.267 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000114319 s, 4.5 MB/s 2023-10-14T16:54:15.268 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T16:54:15.324 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-10-14T16:54:15.325 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:15.325 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T16:54:15.342 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T16:54:15.342 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2023-10-14T16:54:15.397 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T16:54:15.398 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T16:54:15.398 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 215900 Links: 1 2023-10-14T16:54:15.398 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T16:54:15.398 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T16:54:15.398 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-10-14 16:53:51.059064403 +0000 2023-10-14T16:54:15.399 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-10-14 16:47:21.464892287 +0000 2023-10-14T16:54:15.399 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-10-14 16:47:21.464892287 +0000 2023-10-14T16:54:15.399 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-10-14T16:54:15.399 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T16:54:15.461 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-10-14T16:54:15.462 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-10-14T16:54:15.462 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.00024162 s, 2.1 MB/s 2023-10-14T16:54:15.463 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T16:54:15.519 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2023-10-14T16:54:15.574 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T16:54:15.574 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T16:54:15.574 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 219589 Links: 1 2023-10-14T16:54:15.575 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T16:54:15.575 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T16:54:15.575 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-10-14 16:53:51.059064403 +0000 2023-10-14T16:54:15.575 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-10-14 16:47:21.981881971 +0000 2023-10-14T16:54:15.575 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-10-14 16:47:21.981881971 +0000 2023-10-14T16:54:15.576 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-10-14T16:54:15.576 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T16:54:15.637 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-10-14T16:54:15.638 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-10-14T16:54:15.638 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000254068 s, 2.0 MB/s 2023-10-14T16:54:15.639 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T16:54:15.695 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2023-10-14T16:54:15.749 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T16:54:15.750 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T16:54:15.750 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 218039 Links: 1 2023-10-14T16:54:15.750 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T16:54:15.750 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T16:54:15.751 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-10-14 16:53:51.059064403 +0000 2023-10-14T16:54:15.751 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-10-14 16:47:22.474872135 +0000 2023-10-14T16:54:15.751 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-10-14 16:47:22.474872135 +0000 2023-10-14T16:54:15.751 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-10-14T16:54:15.752 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T16:54:15.812 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-10-14T16:54:15.812 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-10-14T16:54:15.813 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000225544 s, 2.3 MB/s 2023-10-14T16:54:15.814 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T16:54:15.869 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2023-10-14T16:54:15.923 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T16:54:15.924 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T16:54:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 218640 Links: 1 2023-10-14T16:54:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T16:54:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T16:54:15.924 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-10-14 16:53:51.059064403 +0000 2023-10-14T16:54:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-10-14 16:47:22.949862658 +0000 2023-10-14T16:54:15.925 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-10-14 16:47:22.949862658 +0000 2023-10-14T16:54:15.925 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-10-14T16:54:15.925 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T16:54:15.986 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-10-14T16:54:15.986 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-10-14T16:54:15.987 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000198588 s, 2.6 MB/s 2023-10-14T16:54:15.988 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T16:54:16.043 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-10-14T16:54:16.043 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-10-14T16:54:16.044 INFO:tasks.ceph:Generating config... 2023-10-14T16:54:16.045 INFO:tasks.ceph:[client] debug client = 20 2023-10-14T16:54:16.045 INFO:tasks.ceph:[client] debug ms = 1 2023-10-14T16:54:16.046 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-14T16:54:16.046 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-14T16:54:16.046 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-14T16:54:16.046 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-14T16:54:16.047 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-14T16:54:16.047 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-14T16:54:16.047 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-14T16:54:16.047 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-14T16:54:16.048 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-14T16:54:16.048 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-14T16:54:16.048 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-14T16:54:16.048 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-14T16:54:16.049 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-14T16:54:16.049 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-14T16:54:16.049 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-14T16:54:16.049 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-14T16:54:16.050 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-14T16:54:16.050 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-14T16:54:16.050 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-14T16:54:16.050 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-14T16:54:16.051 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-14T16:54:16.051 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-14T16:54:16.051 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-10-14T16:54:16.052 INFO:tasks.ceph:Setting up mon.a... 2023-10-14T16:54:16.052 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-14T16:54:16.136 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.keyring 2023-10-14T16:54:16.138 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-14T16:54:16.183 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T16:54:16.250 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.8'), ('mon.b', '172.21.15.155'), ('mon.c', '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]')] 2023-10-14T16:54:16.251 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.8,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug ms': 1}} 2023-10-14T16:54:16.252 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:16.252 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T16:54:16.306 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.8 --add b 172.21.15.155 --addv c '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-14T16:54:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-14T16:54:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: generated fsid 95adc750-512b-4c1d-be1d-b471b9b365f8 2023-10-14T16:54:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = octopus 2023-10-14T16:54:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 0 2023-10-14T16:54:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:fsid 95adc750-512b-4c1d-be1d-b471b9b365f8 2023-10-14T16:54:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:last_changed 2023-10-14T16:54:16.391158+0000 2023-10-14T16:54:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-14T16:54:16.391158+0000 2023-10-14T16:54:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:min_mon_release 15 (octopus) 2023-10-14T16:54:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:election_strategy: 1 2023-10-14T16:54:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:0: [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon.a 2023-10-14T16:54:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2023-10-14T16:54:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:2: [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] mon.c 2023-10-14T16:54:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-14T16:54:16.395 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T16:54:16.409 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 95adc750-512b-4c1d-be1d-b471b9b365f8... 2023-10-14T16:54:16.411 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T16:54:16.452 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T16:54:16.454 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T16:54:16.494 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-10-14T16:54:16.494 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2023-10-14T16:54:16.494 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T16:54:16.495 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2023-10-14T16:54:16.495 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.495 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2023-10-14T16:54:16.495 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.496 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2023-10-14T16:54:16.496 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.496 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2023-10-14T16:54:16.496 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2023-10-14T16:54:16.496 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.497 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2023-10-14T16:54:16.497 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2023-10-14T16:54:16.497 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.497 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T16:54:16.498 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2023-10-14T16:54:16.498 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.498 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T16:54:16.498 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T16:54:16.499 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.499 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2023-10-14T16:54:16.499 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.499 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2023-10-14T16:54:16.500 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2023-10-14T16:54:16.500 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2023-10-14T16:54:16.500 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2023-10-14T16:54:16.500 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2023-10-14T16:54:16.500 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2023-10-14T16:54:16.501 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2023-10-14T16:54:16.501 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T16:54:16.501 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T16:54:16.501 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2023-10-14T16:54:16.502 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.503 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T16:54:16.503 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.503 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2023-10-14T16:54:16.503 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.503 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2023-10-14T16:54:16.504 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.504 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2023-10-14T16:54:16.504 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2023-10-14T16:54:16.504 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2023-10-14T16:54:16.504 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2023-10-14T16:54:16.505 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 95adc750-512b-4c1d-be1d-b471b9b365f8 2023-10-14T16:54:16.505 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.505 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2023-10-14T16:54:16.505 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2023-10-14T16:54:16.505 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.506 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2023-10-14T16:54:16.506 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2023-10-14T16:54:16.506 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2023-10-14T16:54:16.506 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.506 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2023-10-14T16:54:16.507 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2023-10-14T16:54:16.507 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.507 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2023-10-14T16:54:16.507 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2023-10-14T16:54:16.507 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2023-10-14T16:54:16.508 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.508 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2023-10-14T16:54:16.508 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2023-10-14T16:54:16.508 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.508 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2023-10-14T16:54:16.509 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.509 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2023-10-14T16:54:16.509 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.509 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2023-10-14T16:54:16.509 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.510 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2023-10-14T16:54:16.510 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2023-10-14T16:54:16.510 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.510 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2023-10-14T16:54:16.510 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2023-10-14T16:54:16.511 INFO:teuthology.orchestra.run.smithi008.stdout: bdev async discard = True 2023-10-14T16:54:16.511 INFO:teuthology.orchestra.run.smithi008.stdout: bdev enable discard = True 2023-10-14T16:54:16.511 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore allocator = bitmap 2023-10-14T16:54:16.511 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2023-10-14T16:54:16.511 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2023-10-14T16:54:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 20 2023-10-14T16:54:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 20 2023-10-14T16:54:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-14T16:54:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2023-10-14T16:54:16.512 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 10 2023-10-14T16:54:16.513 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T16:54:16.513 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2023-10-14T16:54:16.513 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2023-10-14T16:54:16.513 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2023-10-14T16:54:16.513 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2023-10-14T16:54:16.514 INFO:teuthology.orchestra.run.smithi008.stdout: osd shutdown pgref assert = True 2023-10-14T16:54:16.514 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.514 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2023-10-14T16:54:16.514 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-14T16:54:16.515 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2023-10-14T16:54:16.515 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-10-14T16:54:16.515 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-10-14T16:54:16.515 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-10-14T16:54:16.515 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-10-14T16:54:16.515 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2023-10-14T16:54:16.516 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.516 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2023-10-14T16:54:16.516 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-14T16:54:16.516 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2023-10-14T16:54:16.516 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2023-10-14T16:54:16.517 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2023-10-14T16:54:16.517 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2023-10-14T16:54:16.517 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2023-10-14T16:54:16.517 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2023-10-14T16:54:16.517 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2023-10-14T16:54:16.517 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2023-10-14T16:54:16.518 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2023-10-14T16:54:16.518 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.518 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T16:54:16.518 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T16:54:16.518 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T16:54:16.519 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.519 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T16:54:16.519 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T16:54:16.519 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T16:54:16.519 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.520 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2023-10-14T16:54:16.520 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2023-10-14T16:54:16.520 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.520 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2023-10-14T16:54:16.520 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:16.520 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2023-10-14T16:54:16.521 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2023-10-14T16:54:16.521 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2023-10-14T16:54:16.521 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2023-10-14T16:54:16.521 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T16:54:16.521 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T16:54:16.522 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2023-10-14T16:54:16.522 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-14T16:54:16.522 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2023-10-14T16:54:16.522 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2023-10-14T16:54:16.522 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2023-10-14T16:54:16.523 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2023-10-14T16:54:16.523 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2023-10-14T16:54:16.523 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2023-10-14T16:54:16.523 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2023-10-14T16:54:16.523 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2023-10-14T16:54:16.526 INFO:teuthology.orchestra.run.smithi158.stdout:[global] 2023-10-14T16:54:16.526 INFO:teuthology.orchestra.run.smithi158.stdout: chdir = "" 2023-10-14T16:54:16.526 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T16:54:16.526 INFO:teuthology.orchestra.run.smithi158.stdout: auth supported = cephx 2023-10-14T16:54:16.527 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.527 INFO:teuthology.orchestra.run.smithi158.stdout: filestore xattr use omap = true 2023-10-14T16:54:16.527 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.527 INFO:teuthology.orchestra.run.smithi158.stdout: mon clock drift allowed = 1.000 2023-10-14T16:54:16.527 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.528 INFO:teuthology.orchestra.run.smithi158.stdout: osd crush chooseleaf type = 0 2023-10-14T16:54:16.528 INFO:teuthology.orchestra.run.smithi158.stdout: auth debug = true 2023-10-14T16:54:16.528 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.528 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on old message = true 2023-10-14T16:54:16.529 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on bug = true 2023-10-14T16:54:16.529 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.529 INFO:teuthology.orchestra.run.smithi158.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T16:54:16.529 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn max object skew = 0 2023-10-14T16:54:16.529 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.530 INFO:teuthology.orchestra.run.smithi158.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T16:54:16.530 INFO:teuthology.orchestra.run.smithi158.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T16:54:16.530 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.530 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default size = 2 2023-10-14T16:54:16.530 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.531 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow primary affinity = true 2023-10-14T16:54:16.531 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow pg remap = true 2023-10-14T16:54:16.531 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on legacy crush tunables = false 2023-10-14T16:54:16.531 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on crush straw calc version zero = false 2023-10-14T16:54:16.531 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on no sortbitwise = false 2023-10-14T16:54:16.532 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = false 2023-10-14T16:54:16.532 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on too few osds = false 2023-10-14T16:54:16.532 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T16:54:16.532 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T16:54:16.532 INFO:teuthology.orchestra.run.smithi158.stdout: mon_allow_pool_size_one = true 2023-10-14T16:54:16.533 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.533 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T16:54:16.533 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.533 INFO:teuthology.orchestra.run.smithi158.stdout: osd default data pool replay window = 5 2023-10-14T16:54:16.533 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.533 INFO:teuthology.orchestra.run.smithi158.stdout: mon allow pool delete = true 2023-10-14T16:54:16.534 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.534 INFO:teuthology.orchestra.run.smithi158.stdout: mon cluster log file level = debug 2023-10-14T16:54:16.534 INFO:teuthology.orchestra.run.smithi158.stdout: debug asserts on shutdown = true 2023-10-14T16:54:16.534 INFO:teuthology.orchestra.run.smithi158.stdout: mon health detail to clog = false 2023-10-14T16:54:16.534 INFO:teuthology.orchestra.run.smithi158.stdout: mon host = "172.21.15.8,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2023-10-14T16:54:16.535 INFO:teuthology.orchestra.run.smithi158.stdout: fsid = 95adc750-512b-4c1d-be1d-b471b9b365f8 2023-10-14T16:54:16.535 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.535 INFO:teuthology.orchestra.run.smithi158.stdout:[osd] 2023-10-14T16:54:16.535 INFO:teuthology.orchestra.run.smithi158.stdout: osd journal size = 100 2023-10-14T16:54:16.535 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.536 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub load threshold = 5.0 2023-10-14T16:54:16.536 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub max interval = 600 2023-10-14T16:54:16.536 INFO:teuthology.orchestra.run.smithi158.stdout: osd mclock profile = high_recovery_ops 2023-10-14T16:54:16.536 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.536 INFO:teuthology.orchestra.run.smithi158.stdout: osd recover clone overlap = true 2023-10-14T16:54:16.537 INFO:teuthology.orchestra.run.smithi158.stdout: osd recovery max chunk = 1048576 2023-10-14T16:54:16.537 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.537 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug shutdown = true 2023-10-14T16:54:16.537 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug op order = true 2023-10-14T16:54:16.537 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug verify stray on activate = true 2023-10-14T16:54:16.538 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.538 INFO:teuthology.orchestra.run.smithi158.stdout: osd open classes on start = true 2023-10-14T16:54:16.538 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug pg log writeout = true 2023-10-14T16:54:16.538 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.538 INFO:teuthology.orchestra.run.smithi158.stdout: osd deep scrub update digest min age = 30 2023-10-14T16:54:16.539 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.539 INFO:teuthology.orchestra.run.smithi158.stdout: osd map max advance = 10 2023-10-14T16:54:16.539 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.539 INFO:teuthology.orchestra.run.smithi158.stdout: journal zero on create = true 2023-10-14T16:54:16.539 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.539 INFO:teuthology.orchestra.run.smithi158.stdout: filestore ondisk finisher threads = 3 2023-10-14T16:54:16.540 INFO:teuthology.orchestra.run.smithi158.stdout: filestore apply finisher threads = 3 2023-10-14T16:54:16.540 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.540 INFO:teuthology.orchestra.run.smithi158.stdout: bdev debug aio = true 2023-10-14T16:54:16.540 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug misdirected ops = true 2023-10-14T16:54:16.540 INFO:teuthology.orchestra.run.smithi158.stdout: bdev async discard = True 2023-10-14T16:54:16.541 INFO:teuthology.orchestra.run.smithi158.stdout: bdev enable discard = True 2023-10-14T16:54:16.541 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore allocator = bitmap 2023-10-14T16:54:16.541 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore block size = 96636764160 2023-10-14T16:54:16.541 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore fsck on mount = True 2023-10-14T16:54:16.541 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluefs = 20 2023-10-14T16:54:16.542 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluestore = 20 2023-10-14T16:54:16.542 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-14T16:54:16.542 INFO:teuthology.orchestra.run.smithi158.stdout: debug osd = 20 2023-10-14T16:54:16.542 INFO:teuthology.orchestra.run.smithi158.stdout: debug rocksdb = 10 2023-10-14T16:54:16.542 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T16:54:16.543 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd full ratio = 0.9 2023-10-14T16:54:16.543 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd nearfull ratio = 0.8 2023-10-14T16:54:16.543 INFO:teuthology.orchestra.run.smithi158.stdout: osd failsafe full ratio = 0.95 2023-10-14T16:54:16.543 INFO:teuthology.orchestra.run.smithi158.stdout: osd objectstore = bluestore 2023-10-14T16:54:16.543 INFO:teuthology.orchestra.run.smithi158.stdout: osd shutdown pgref assert = True 2023-10-14T16:54:16.544 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.544 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr] 2023-10-14T16:54:16.544 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-14T16:54:16.544 INFO:teuthology.orchestra.run.smithi158.stdout: debug mgr = 20 2023-10-14T16:54:16.544 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-10-14T16:54:16.545 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-10-14T16:54:16.545 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-10-14T16:54:16.545 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-10-14T16:54:16.545 INFO:teuthology.orchestra.run.smithi158.stdout: mgr/telemetry/nag = false 2023-10-14T16:54:16.545 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.546 INFO:teuthology.orchestra.run.smithi158.stdout:[mon] 2023-10-14T16:54:16.546 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-14T16:54:16.546 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-10-14T16:54:16.546 INFO:teuthology.orchestra.run.smithi158.stdout: debug paxos = 20 2023-10-14T16:54:16.546 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-10-14T16:54:16.547 INFO:teuthology.orchestra.run.smithi158.stdout: mon data avail warn = 5 2023-10-14T16:54:16.547 INFO:teuthology.orchestra.run.smithi158.stdout: mon mgr mkfs grace = 240 2023-10-14T16:54:16.547 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-10-14T16:54:16.547 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd reporter subtree level = osd 2023-10-14T16:54:16.547 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd prime pg temp = true 2023-10-14T16:54:16.547 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-10-14T16:54:16.548 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.548 INFO:teuthology.orchestra.run.smithi158.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T16:54:16.548 INFO:teuthology.orchestra.run.smithi158.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T16:54:16.548 INFO:teuthology.orchestra.run.smithi158.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T16:54:16.548 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.549 INFO:teuthology.orchestra.run.smithi158.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T16:54:16.549 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T16:54:16.549 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T16:54:16.549 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.549 INFO:teuthology.orchestra.run.smithi158.stdout: # 1m isn't quite enough 2023-10-14T16:54:16.550 INFO:teuthology.orchestra.run.smithi158.stdout: mon_down_mkfs_grace = 2m 2023-10-14T16:54:16.550 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.550 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_filestore_osds = false 2023-10-14T16:54:16.550 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T16:54:16.550 INFO:teuthology.orchestra.run.smithi158.stdout:[client] 2023-10-14T16:54:16.551 INFO:teuthology.orchestra.run.smithi158.stdout: rgw cache enabled = true 2023-10-14T16:54:16.551 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable ops log = true 2023-10-14T16:54:16.551 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable usage log = true 2023-10-14T16:54:16.551 INFO:teuthology.orchestra.run.smithi158.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T16:54:16.551 INFO:teuthology.orchestra.run.smithi158.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T16:54:16.551 INFO:teuthology.orchestra.run.smithi158.stdout: debug client = 20 2023-10-14T16:54:16.552 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-14T16:54:16.552 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.a] 2023-10-14T16:54:16.552 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.b] 2023-10-14T16:54:16.552 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.c] 2023-10-14T16:54:16.552 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2023-10-14T16:54:16.553 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2023-10-14T16:54:16.553 INFO:teuthology.orchestra.run.smithi158.stdout:[mds] 2023-10-14T16:54:16.553 INFO:teuthology.orchestra.run.smithi158.stdout: debug mds = 20 2023-10-14T16:54:16.553 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-10-14T16:54:16.553 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2023-10-14T16:54:16.554 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2023-10-14T16:54:16.554 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T16:54:16.554 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2023-10-14T16:54:16.554 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.554 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2023-10-14T16:54:16.555 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.555 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2023-10-14T16:54:16.555 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.555 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2023-10-14T16:54:16.555 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2023-10-14T16:54:16.556 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.556 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2023-10-14T16:54:16.556 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2023-10-14T16:54:16.556 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.556 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T16:54:16.557 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2023-10-14T16:54:16.557 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.557 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T16:54:16.557 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T16:54:16.557 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.558 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2023-10-14T16:54:16.558 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.558 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2023-10-14T16:54:16.558 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2023-10-14T16:54:16.558 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2023-10-14T16:54:16.559 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2023-10-14T16:54:16.559 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2023-10-14T16:54:16.559 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2023-10-14T16:54:16.559 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2023-10-14T16:54:16.559 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T16:54:16.560 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T16:54:16.560 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2023-10-14T16:54:16.560 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.560 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T16:54:16.560 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.560 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2023-10-14T16:54:16.561 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.561 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2023-10-14T16:54:16.561 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.561 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2023-10-14T16:54:16.562 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2023-10-14T16:54:16.562 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2023-10-14T16:54:16.562 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.8,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2023-10-14T16:54:16.562 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 95adc750-512b-4c1d-be1d-b471b9b365f8 2023-10-14T16:54:16.562 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.562 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2023-10-14T16:54:16.563 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2023-10-14T16:54:16.563 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.563 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2023-10-14T16:54:16.564 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2023-10-14T16:54:16.564 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2023-10-14T16:54:16.564 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.564 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2023-10-14T16:54:16.564 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2023-10-14T16:54:16.565 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.565 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2023-10-14T16:54:16.565 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2023-10-14T16:54:16.565 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2023-10-14T16:54:16.565 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.565 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2023-10-14T16:54:16.566 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2023-10-14T16:54:16.567 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.567 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2023-10-14T16:54:16.567 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.567 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2023-10-14T16:54:16.567 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.568 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2023-10-14T16:54:16.568 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.568 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2023-10-14T16:54:16.568 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2023-10-14T16:54:16.568 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.569 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2023-10-14T16:54:16.569 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2023-10-14T16:54:16.569 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2023-10-14T16:54:16.569 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2023-10-14T16:54:16.569 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2023-10-14T16:54:16.569 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2023-10-14T16:54:16.570 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2023-10-14T16:54:16.570 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2023-10-14T16:54:16.570 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2023-10-14T16:54:16.570 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-10-14T16:54:16.570 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2023-10-14T16:54:16.571 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2023-10-14T16:54:16.571 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T16:54:16.571 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2023-10-14T16:54:16.571 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2023-10-14T16:54:16.571 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2023-10-14T16:54:16.572 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2023-10-14T16:54:16.572 INFO:teuthology.orchestra.run.smithi155.stdout: osd shutdown pgref assert = True 2023-10-14T16:54:16.572 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.572 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2023-10-14T16:54:16.572 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-10-14T16:54:16.573 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2023-10-14T16:54:16.573 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2023-10-14T16:54:16.573 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2023-10-14T16:54:16.573 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2023-10-14T16:54:16.573 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2023-10-14T16:54:16.574 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2023-10-14T16:54:16.574 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.574 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2023-10-14T16:54:16.574 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-10-14T16:54:16.575 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2023-10-14T16:54:16.575 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2023-10-14T16:54:16.575 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2023-10-14T16:54:16.575 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2023-10-14T16:54:16.575 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2023-10-14T16:54:16.575 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2023-10-14T16:54:16.576 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2023-10-14T16:54:16.576 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2023-10-14T16:54:16.576 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2023-10-14T16:54:16.576 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.576 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T16:54:16.577 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T16:54:16.577 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T16:54:16.577 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.577 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T16:54:16.577 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T16:54:16.578 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T16:54:16.578 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.578 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2023-10-14T16:54:16.578 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2023-10-14T16:54:16.578 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.579 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2023-10-14T16:54:16.579 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T16:54:16.579 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2023-10-14T16:54:16.579 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2023-10-14T16:54:16.579 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2023-10-14T16:54:16.579 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2023-10-14T16:54:16.580 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T16:54:16.580 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T16:54:16.580 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2023-10-14T16:54:16.580 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-10-14T16:54:16.580 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2023-10-14T16:54:16.581 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2023-10-14T16:54:16.581 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2023-10-14T16:54:16.581 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2023-10-14T16:54:16.581 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2023-10-14T16:54:16.581 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2023-10-14T16:54:16.582 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2023-10-14T16:54:16.582 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-10-14T16:54:16.582 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-14T16:54:16.583 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-14T16:54:16.636 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-14T16:54:16.636 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:16.637 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-14T16:54:16.652 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:16.652 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-14T16:54:16.707 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T16:54:16.707 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:16.708 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T16:54:16.708 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T16:54:16.782 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:16.782 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T16:54:16.837 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2023-10-14T16:54:16.838 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:16.838 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T16:54:16.839 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T16:54:16.873 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:16.873 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T16:54:16.927 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi158.front.sepia.ceph.com 2023-10-14T16:54:16.927 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-14T16:54:16.928 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T16:54:16.928 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T16:54:16.967 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-14T16:54:16.967 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T16:54:17.022 INFO:tasks.ceph:Setting up mon nodes... 2023-10-14T16:54:17.023 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-14T16:54:17.023 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T16:54:17.072 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T16:54:17.075 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T16:54:17.153 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T16:54:17.156 INFO:tasks.ceph:Setting up mds nodes... 2023-10-14T16:54:17.157 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T16:54:17.206 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T16:54:17.208 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-14T16:54:17.233 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T16:54:17.281 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T16:54:17.284 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-14T16:54:17.308 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-14T16:54:17.309 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T16:54:17.366 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-14T16:54:17.379 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-14T16:54:17.379 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-10-14T16:54:17.380 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-14T16:54:17.405 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-10-14T16:54:17.406 INFO:tasks.ceph:role: osd.0 2023-10-14T16:54:17.406 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T16:54:17.406 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T16:54:17.470 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T16:54:17.470 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T16:54:17.471 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T16:54:17.471 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 2023-10-14T16:54:17.471 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T16:54:17.471 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-10-14T16:54:17.471 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T16:54:17.472 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T16:54:17.472 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T16:54:17.472 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T16:54:17.492 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-10-14T16:54:17.494 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-10-14T16:54:17.494 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-14T16:54:17.573 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-14T16:54:17.644 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-14T16:54:17.709 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-10-14T16:54:17.710 INFO:tasks.ceph:role: osd.1 2023-10-14T16:54:17.710 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T16:54:17.710 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T16:54:17.774 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T16:54:17.774 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T16:54:17.774 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T16:54:17.775 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 2023-10-14T16:54:17.775 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T16:54:17.775 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2023-10-14T16:54:17.775 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T16:54:17.775 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T16:54:17.776 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T16:54:17.776 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T16:54:17.797 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2023-10-14T16:54:17.799 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2023-10-14T16:54:17.799 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-14T16:54:17.877 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-14T16:54:17.945 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T16:54:18.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:18.049+0000 7f9b23548540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-14T16:54:18.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:18.049+0000 7f9b23548540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-14T16:54:18.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:18.049+0000 7f9b23548540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T16:54:18.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:18.049+0000 7f9b23548540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T16:54:18.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:18.049+0000 7f9b23548540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T16:54:18.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:18.049+0000 7f9b23548540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-14T16:54:18.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:18.571+0000 7f9b23548540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T16:54:19.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:19.333+0000 7f9b23548540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T16:54:20.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:20.096+0000 7f9b23548540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T16:54:20.895 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-14T16:54:20.925 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T16:54:21.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:21.012+0000 7f0839f85540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-14T16:54:21.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:21.012+0000 7f0839f85540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-14T16:54:21.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:21.012+0000 7f0839f85540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T16:54:21.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:21.012+0000 7f0839f85540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T16:54:21.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:21.012+0000 7f0839f85540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T16:54:21.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:21.012+0000 7f0839f85540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-14T16:54:21.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:21.535+0000 7f0839f85540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T16:54:22.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:22.298+0000 7f0839f85540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T16:54:23.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:23.061+0000 7f0839f85540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T16:54:23.860 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-14T16:54:23.890 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-14T16:54:23.917 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-10-14T16:54:23.917 INFO:tasks.ceph:role: osd.2 2023-10-14T16:54:23.918 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2023-10-14T16:54:23.918 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T16:54:23.990 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T16:54:23.990 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T16:54:23.991 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T16:54:23.991 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2023-10-14T16:54:23.991 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T16:54:23.991 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-10-14T16:54:23.991 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T16:54:23.992 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T16:54:23.992 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T16:54:23.992 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T16:54:24.431 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-10-14T16:54:24.432 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-10-14T16:54:24.433 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-10-14T16:54:24.595 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-14T16:54:24.627 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-14T16:54:24.693 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-10-14T16:54:24.693 INFO:tasks.ceph:role: osd.3 2023-10-14T16:54:24.693 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2023-10-14T16:54:24.694 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T16:54:24.764 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T16:54:24.765 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T16:54:24.765 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T16:54:24.766 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 2023-10-14T16:54:24.766 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T16:54:24.766 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-10-14T16:54:24.767 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T16:54:24.767 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T16:54:24.767 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T16:54:24.767 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T16:54:25.195 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-10-14T16:54:25.197 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-10-14T16:54:25.197 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2023-10-14T16:54:25.299 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-14T16:54:25.327 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T16:54:25.412 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:25.411+0000 7fb98596a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-14T16:54:25.414 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:25.413+0000 7fb98596a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-14T16:54:25.414 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:25.413+0000 7fb98596a540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T16:54:25.414 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:25.413+0000 7fb98596a540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T16:54:25.414 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:25.413+0000 7fb98596a540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T16:54:25.417 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:25.416+0000 7fb98596a540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-14T16:54:25.944 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:25.943+0000 7fb98596a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T16:54:26.702 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:26.702+0000 7fb98596a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T16:54:27.465 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:27.464+0000 7fb98596a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T16:54:28.260 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-14T16:54:28.286 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T16:54:28.369 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:28.368+0000 7fcee58b2540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-14T16:54:28.369 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:28.368+0000 7fcee58b2540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-14T16:54:28.369 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:28.368+0000 7fcee58b2540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T16:54:28.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:28.368+0000 7fcee58b2540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T16:54:28.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:28.368+0000 7fcee58b2540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T16:54:28.370 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:28.368+0000 7fcee58b2540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-14T16:54:28.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:28.892+0000 7fcee58b2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T16:54:29.658 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:29.657+0000 7fcee58b2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T16:54:30.427 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:30.426+0000 7fcee58b2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-14T16:54:31.223 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-14T16:54:31.287 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-14T16:54:31.288 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:31.288 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-14T16:54:31.318 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:31.319 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-14T16:54:31.387 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:31.387 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-14T16:54:31.457 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:31.458 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-14T16:54:31.526 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:31.526 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-14T16:54:31.551 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:31.552 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-14T16:54:31.615 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:31.616 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-14T16:54:31.680 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:31.680 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-14T16:54:31.743 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-14T16:54:31.743 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-14T16:54:31.759 INFO:tasks.ceph:Adding keys to all mons... 2023-10-14T16:54:31.759 DEBUG:teuthology.orchestra.run.smithi008:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T16:54:31.762 DEBUG:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T16:54:31.786 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.x] 2023-10-14T16:54:31.787 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC5xyplke5dBBAAPCIXLzAKUKgbUYCBOHAkNg== 2023-10-14T16:54:31.787 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2023-10-14T16:54:31.787 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC5xyplVV5ZDBAAXSsn62v38sYAE8CXPKGX5w== 2023-10-14T16:54:31.787 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.0] 2023-10-14T16:54:31.788 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC6xyplLbMBAxAA6Xz+80DiGM1BAPEmzoFNTw== 2023-10-14T16:54:31.788 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.1] 2023-10-14T16:54:31.788 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC9xyplrIjNABAAU91rNoSvuihsTvn8X+NU7g== 2023-10-14T16:54:31.788 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.y] 2023-10-14T16:54:31.788 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC5xyplZHUzCRAANuw3fDERvPwobzcI/H1oAA== 2023-10-14T16:54:31.789 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2023-10-14T16:54:31.789 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC5xypl/YrSEBAAVzXy53lhlqGx18z6w2v0lg== 2023-10-14T16:54:31.789 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.2] 2023-10-14T16:54:31.789 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDBxypltn2gGBAATpKwOzzGvjal5UClQNvnNQ== 2023-10-14T16:54:31.789 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.3] 2023-10-14T16:54:31.790 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDExyplzpAEFhAA7/qYCQZqTgdmk4Ph7S8iAg== 2023-10-14T16:54:31.790 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-10-14T16:54:31.790 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQC5xyplDPjbFRAAGPDUZTFGPRmxelZ+Yx9YDA== 2023-10-14T16:54:31.806 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2023-10-14T16:54:31.806 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQC5xyplke5dBBAAPCIXLzAKUKgbUYCBOHAkNg== 2023-10-14T16:54:31.807 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2023-10-14T16:54:31.807 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQC5xyplVV5ZDBAAXSsn62v38sYAE8CXPKGX5w== 2023-10-14T16:54:31.807 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2023-10-14T16:54:31.807 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQC6xyplLbMBAxAA6Xz+80DiGM1BAPEmzoFNTw== 2023-10-14T16:54:31.807 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2023-10-14T16:54:31.808 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQC9xyplrIjNABAAU91rNoSvuihsTvn8X+NU7g== 2023-10-14T16:54:31.808 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2023-10-14T16:54:31.808 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQC5xyplZHUzCRAANuw3fDERvPwobzcI/H1oAA== 2023-10-14T16:54:31.808 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2023-10-14T16:54:31.808 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQC5xypl/YrSEBAAVzXy53lhlqGx18z6w2v0lg== 2023-10-14T16:54:31.809 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2023-10-14T16:54:31.809 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDBxypltn2gGBAATpKwOzzGvjal5UClQNvnNQ== 2023-10-14T16:54:31.809 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2023-10-14T16:54:31.809 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQDExyplzpAEFhAA7/qYCQZqTgdmk4Ph7S8iAg== 2023-10-14T16:54:31.809 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2023-10-14T16:54:31.809 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQC5xyplDPjbFRAAGPDUZTFGPRmxelZ+Yx9YDA== 2023-10-14T16:54:31.810 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T16:54:31.834 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T16:54:31.897 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T16:54:31.900 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T16:54:31.951 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T16:54:31.954 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T16:54:32.001 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T16:54:32.003 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T16:54:32.051 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T16:54:32.053 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T16:54:32.100 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T16:54:32.102 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T16:54:32.152 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T16:54:32.154 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T16:54:32.202 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T16:54:32.204 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T16:54:32.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T16:54:32.258 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T16:54:32.308 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-14T16:54:32.308 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-14T16:54:32.333 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T16:54:32.425 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-14T16:54:32.450 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-14T16:54:32.475 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T16:54:32.566 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-14T16:54:32.591 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-14T16:54:32.655 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T16:54:32.746 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-14T16:54:32.771 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T16:54:32.773 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T16:54:32.825 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-14T16:54:32.826 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-14T16:54:32.826 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-14T16:54:32.828 INFO:tasks.ceph.mon.a:Started 2023-10-14T16:54:32.829 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-14T16:54:32.829 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-14T16:54:32.870 INFO:tasks.ceph.mon.b:Started 2023-10-14T16:54:32.870 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-14T16:54:32.871 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-14T16:54:32.872 INFO:tasks.ceph.mon.c:Started 2023-10-14T16:54:32.873 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-14T16:54:32.873 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-14T16:54:32.874 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-14T16:54:32.876 INFO:tasks.ceph.mgr.x:Started 2023-10-14T16:54:32.876 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-14T16:54:32.877 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-14T16:54:32.879 INFO:tasks.ceph.mgr.y:Started 2023-10-14T16:54:32.879 INFO:tasks.ceph:Setting crush tunables to default 2023-10-14T16:54:32.879 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd crush tunables default 2023-10-14T16:54:32.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.998+0000 7f605ad2e700 1 Processor -- start 2023-10-14T16:54:32.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.998+0000 7f605ad2e700 1 -- start start 2023-10-14T16:54:33.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f605ad2e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:33.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f605ad2e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:33.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f605ad2e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60540a28a0 con 0x7f6054133f50 2023-10-14T16:54:33.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f605ad2e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6054133880 con 0x7f60541343d0 2023-10-14T16:54:33.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f605ad2e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605406d770 con 0x7f60540a3630 2023-10-14T16:54:33.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f60592cb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:33.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f6053fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6054133f50 0x7f60540a15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.8:46170/0 (socket says 172.21.15.8:46170) 2023-10-14T16:54:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f60592cb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57552/0 (socket says 172.21.15.8:57552) 2023-10-14T16:54:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f6053fff700 1 -- 172.21.15.8:0/1684966735 learned_addr learned my addr 172.21.15.8:0/1684966735 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f60592cb700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 msgr2=0x7f60540a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T16:54:33.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f60592cb700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 msgr2=0x7f60540a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T16:54:33.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f60592cb700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T16:54:33.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f60592cb700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T16:54:33.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 msgr2=0x7f605406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T16:54:33.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 msgr2=0x7f605406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T16:54:33.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T16:54:33.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:32.999+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T16:54:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.200+0000 7f60592cb700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.200+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:33.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.200+0000 7f60592cb700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 msgr2=0x7f60540a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T16:54:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.200+0000 7f60592cb700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 msgr2=0x7f60540a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T16:54:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.200+0000 7f60592cb700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T16:54:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.200+0000 7f60592cb700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T16:54:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.200+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 msgr2=0x7f605406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T16:54:33.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.200+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 msgr2=0x7f605406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T16:54:33.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.200+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T16:54:33.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.200+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T16:54:33.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.601+0000 7f60592cb700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:33.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.601+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:33.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.601+0000 7f60592cb700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 msgr2=0x7f60540a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T16:54:33.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.601+0000 7f60592cb700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 msgr2=0x7f60540a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T16:54:33.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.601+0000 7f60592cb700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T16:54:33.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.601+0000 7f60592cb700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T16:54:33.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.601+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 msgr2=0x7f605406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T16:54:33.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.601+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 msgr2=0x7f605406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T16:54:33.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.601+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T16:54:33.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:33.601+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T16:54:34.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:34.402+0000 7f60592cb700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:34.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:34.402+0000 7f60592cb700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 msgr2=0x7f60540a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T16:54:34.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:34.402+0000 7f60592cb700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 msgr2=0x7f60540a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T16:54:34.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:34.402+0000 7f60592cb700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T16:54:34.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:34.402+0000 7f60592cb700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T16:54:34.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:34.402+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:34.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:34.402+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 msgr2=0x7f605406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T16:54:34.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:34.402+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 msgr2=0x7f605406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T16:54:34.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:34.402+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T16:54:34.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:34.402+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T16:54:36.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f60527fc700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 msgr2=0x7f605406bef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T16:54:36.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f60527fc700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.155:3300/0 conn(0x7f60540a3630 0x7f605406bef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:36.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f60527fc700 1 -- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 msgr2=0x7f60540a1cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T16:54:36.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f60527fc700 1 --2- 172.21.15.8:0/1684966735 >> v2:172.21.15.8:3300/0 conn(0x7f60541343d0 0x7f60540a1cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:36.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f60527fc700 1 -- 172.21.15.8:0/1684966735 >> v1:172.21.15.155:6789/0 conn(0x7f6054133f50 legacy=0x7f60540a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:36.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f60527fc700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:36.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f60527fc700 1 -- 172.21.15.8:0/1684966735 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6054133b00 con 0x7f6038006250 2023-10-14T16:54:36.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f60527fc700 1 -- 172.21.15.8:0/1684966735 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6054133880 con 0x7f6038003700 2023-10-14T16:54:36.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:36.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 msgr2=0x7f6038005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T16:54:36.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 msgr2=0x7f6038005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T16:54:36.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T16:54:36.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:35.999+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T16:54:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:36.200+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:36.200+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 msgr2=0x7f6038005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T16:54:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:36.200+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 msgr2=0x7f6038005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T16:54:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:36.200+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T16:54:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:36.200+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T16:54:36.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:36.601+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:36.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:36.601+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 msgr2=0x7f6038005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T16:54:36.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:36.601+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 msgr2=0x7f6038005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T16:54:36.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:36.601+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T16:54:36.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:36.601+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T16:54:37.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:37.403+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:37.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:37.403+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 msgr2=0x7f6038005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T16:54:37.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:37.403+0000 7f6058aca700 1 -- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 msgr2=0x7f6038005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T16:54:37.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:37.403+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T16:54:37.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:37.403+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T16:54:38.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686123428 0 0) 0x7f6054133b00 con 0x7f6038006250 2023-10-14T16:54:38.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6044003570 con 0x7f6038006250 2023-10-14T16:54:38.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 785712496 0 0) 0x7f6044003570 con 0x7f6038006250 2023-10-14T16:54:38.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 msgr2=0x7f6038005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T16:54:38.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038003700 0x7f6038005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603800b020 con 0x7f6038006250 2023-10-14T16:54:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f60400014f0 con 0x7f6038006250 2023-10-14T16:54:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 >> v1:172.21.15.8:6789/0 conn(0x7f6038006250 legacy=0x7f60380086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60592cb700 1 -- 172.21.15.8:0/1684966735 reap_dead start 2023-10-14T16:54:38.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6044003a60 0x7f6044003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 0x7f6044004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60440052e0 0x7f604400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6054133880 con 0x7f6044004810 2023-10-14T16:54:38.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604400c250 con 0x7f60440052e0 2023-10-14T16:54:38.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604400c410 con 0x7f6044003a60 2023-10-14T16:54:38.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f6053fff700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 0x7f6044004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.201+0000 7f6058aca700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6044003a60 0x7f6044003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.202+0000 7f60592cb700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60440052e0 0x7f604400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.202+0000 7f6053fff700 1 -- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6044003a60 msgr2=0x7f6044003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:38.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.202+0000 7f6053fff700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6044003a60 0x7f6044003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.202+0000 7f6053fff700 1 -- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60440052e0 msgr2=0x7f604400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:38.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.202+0000 7f6053fff700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60440052e0 0x7f604400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.202+0000 7f6053fff700 1 -- 172.21.15.8:0/1684966735 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6044003570 con 0x7f6044004810 2023-10-14T16:54:38.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.202+0000 7f6053fff700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 0x7f6044004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f604000c3c0 tx=0x7f6040001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9272388f47f829be server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.202+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604000cc90 con 0x7f6044004810 2023-10-14T16:54:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.202+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604000ce10 con 0x7f6044004810 2023-10-14T16:54:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.202+0000 7f60537fe700 1 -- 172.21.15.8:0/1684966735 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040004b40 con 0x7f6044004810 2023-10-14T16:54:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.203+0000 7f605ad2e700 1 -- 172.21.15.8:0/1684966735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 msgr2=0x7f6044004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.203+0000 7f605ad2e700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 0x7f6044004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f604000c3c0 tx=0x7f6040001e70 comp rx=0 tx=0).stop 2023-10-14T16:54:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.203+0000 7f605ad2e700 1 -- 172.21.15.8:0/1684966735 shutdown_connections 2023-10-14T16:54:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.203+0000 7f605ad2e700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60440052e0 0x7f604400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.203+0000 7f605ad2e700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 0x7f6044004c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.203+0000 7f605ad2e700 1 --2- 172.21.15.8:0/1684966735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6044003a60 0x7f6044003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.203+0000 7f605ad2e700 1 -- 172.21.15.8:0/1684966735 >> 172.21.15.8:0/1684966735 conn(0x7f605406f500 msgr2=0x7f60540701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:38.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.203+0000 7f605ad2e700 1 -- 172.21.15.8:0/1684966735 shutdown_connections 2023-10-14T16:54:38.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.203+0000 7f605ad2e700 1 -- 172.21.15.8:0/1684966735 wait complete. 2023-10-14T16:54:38.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.204+0000 7f605ad2e700 1 Processor -- start 2023-10-14T16:54:38.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.205+0000 7f605ad2e700 1 -- start start 2023-10-14T16:54:38.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.205+0000 7f605ad2e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6044003a60 0x7f6054145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.205+0000 7f605ad2e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 0x7f6054146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.205+0000 7f605ad2e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60440052e0 0x7f6054146a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.205+0000 7f605ad2e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605409de80 con 0x7f6044004810 2023-10-14T16:54:38.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.205+0000 7f605ad2e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60540a0000 con 0x7f60440052e0 2023-10-14T16:54:38.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.205+0000 7f605ad2e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60540a0530 con 0x7f6044003a60 2023-10-14T16:54:38.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.205+0000 7f6053fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 0x7f6054146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.205+0000 7f6053fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 0x7f6054146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47164/0 (socket says 172.21.15.8:47164) 2023-10-14T16:54:38.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f6053fff700 1 -- 172.21.15.8:0/378767858 learned_addr learned my addr 172.21.15.8:0/378767858 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:38.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f60592cb700 1 --2- 172.21.15.8:0/378767858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60440052e0 0x7f6054146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f6058aca700 1 --2- 172.21.15.8:0/378767858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6044003a60 0x7f6054145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f6053fff700 1 -- 172.21.15.8:0/378767858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6044003a60 msgr2=0x7f6054145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f6053fff700 1 --2- 172.21.15.8:0/378767858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6044003a60 0x7f6054145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f6053fff700 1 -- 172.21.15.8:0/378767858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60440052e0 msgr2=0x7f6054146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f6053fff700 1 --2- 172.21.15.8:0/378767858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60440052e0 0x7f6054146a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f6053fff700 1 -- 172.21.15.8:0/378767858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605409f3a0 con 0x7f6044004810 2023-10-14T16:54:38.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f60592cb700 1 --2- 172.21.15.8:0/378767858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60440052e0 0x7f6054146a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:38.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f6053fff700 1 --2- 172.21.15.8:0/378767858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 0x7f6054146530 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f604400c220 tx=0x7f6040015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:38.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f6050ff9700 1 -- 172.21.15.8:0/378767858 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040023070 con 0x7f6044004810 2023-10-14T16:54:38.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f6050ff9700 1 -- 172.21.15.8:0/378767858 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604000cc90 con 0x7f6044004810 2023-10-14T16:54:38.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f605ad2e700 1 -- 172.21.15.8:0/378767858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605409c360 con 0x7f6044004810 2023-10-14T16:54:38.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.206+0000 7f6050ff9700 1 -- 172.21.15.8:0/378767858 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040014670 con 0x7f6044004810 2023-10-14T16:54:38.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.207+0000 7f605ad2e700 1 -- 172.21.15.8:0/378767858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60541310e0 con 0x7f6044004810 2023-10-14T16:54:38.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.207+0000 7f6050ff9700 1 -- 172.21.15.8:0/378767858 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6040014ca0 con 0x7f6044004810 2023-10-14T16:54:38.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.207+0000 7f6050ff9700 1 -- 172.21.15.8:0/378767858 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6040028410 con 0x7f6044004810 2023-10-14T16:54:38.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.208+0000 7f605ad2e700 1 -- 172.21.15.8:0/378767858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605406f900 con 0x7f6044004810 2023-10-14T16:54:38.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.210+0000 7f6050ff9700 1 -- 172.21.15.8:0/378767858 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6040028620 con 0x7f6044004810 2023-10-14T16:54:38.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.289+0000 7f605ad2e700 1 -- 172.21.15.8:0/378767858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f605406f900 con 0x7f6044004810 2023-10-14T16:54:38.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.291+0000 7f6050ff9700 1 -- 172.21.15.8:0/378767858 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f60400287c0 con 0x7f6044004810 2023-10-14T16:54:38.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.292+0000 7f605ad2e700 1 -- 172.21.15.8:0/378767858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 msgr2=0x7f6054146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.292+0000 7f605ad2e700 1 --2- 172.21.15.8:0/378767858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 0x7f6054146530 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f604400c220 tx=0x7f6040015000 comp rx=0 tx=0).stop 2023-10-14T16:54:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.292+0000 7f605ad2e700 1 -- 172.21.15.8:0/378767858 shutdown_connections 2023-10-14T16:54:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.292+0000 7f605ad2e700 1 --2- 172.21.15.8:0/378767858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60440052e0 0x7f6054146a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.292+0000 7f605ad2e700 1 --2- 172.21.15.8:0/378767858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6044003a60 0x7f6054145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.292+0000 7f605ad2e700 1 --2- 172.21.15.8:0/378767858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6044004810 0x7f6054146530 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.292+0000 7f605ad2e700 1 -- 172.21.15.8:0/378767858 >> 172.21.15.8:0/378767858 conn(0x7f605406f500 msgr2=0x7f605406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.293+0000 7f605ad2e700 1 -- 172.21.15.8:0/378767858 shutdown_connections 2023-10-14T16:54:38.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:38.293+0000 7f605ad2e700 1 -- 172.21.15.8:0/378767858 wait complete. 2023-10-14T16:54:38.297 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2023-10-14T16:54:38.306 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-14T16:54:38.307 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:38.308 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-14T16:54:38.335 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-14T16:54:38.336 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-14T16:54:38.400 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:38.401 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-14T16:54:38.432 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-14T16:54:38.432 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-14T16:54:38.499 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 18a7026e-e2a8-4830-8249-a048158018b7 0 2023-10-14T16:54:38.657 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.657+0000 7ff606bd1700 1 Processor -- start 2023-10-14T16:54:38.657 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.657+0000 7ff606bd1700 1 -- start start 2023-10-14T16:54:38.662 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff606bd1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 0x7ff600133cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.663 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff606bd1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff600134200 0x7ff600029f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.663 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff606bd1700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60006c770 con 0x7ff60002a4a0 2023-10-14T16:54:38.663 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff606bd1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff600133680 con 0x7ff600134200 2023-10-14T16:54:38.663 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff606bd1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6001345f0 con 0x7ff60006c2e0 2023-10-14T16:54:38.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff6053ce700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff600134200 0x7ff600029f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff605bcf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 0x7ff600133cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff605bcf700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 0x7ff600133cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56558/0 (socket says 172.21.15.155:56558) 2023-10-14T16:54:38.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff6053ce700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff600134200 0x7ff600029f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45078/0 (socket says 172.21.15.155:45078) 2023-10-14T16:54:38.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff605bcf700 1 -- 172.21.15.155:0/811341839 learned_addr learned my addr 172.21.15.155:0/811341839 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-14T16:54:38.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff605bcf700 1 -- 172.21.15.155:0/811341839 >> v2:172.21.15.155:3300/0 conn(0x7ff600134200 msgr2=0x7ff600029f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:38.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff605bcf700 1 --2- 172.21.15.155:0/811341839 >> v2:172.21.15.155:3300/0 conn(0x7ff600134200 0x7ff600029f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff605bcf700 1 -- 172.21.15.155:0/811341839 >> v1:172.21.15.8:6789/0 conn(0x7ff60002a4a0 legacy=0x7ff60013e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff605bcf700 1 -- 172.21.15.155:0/811341839 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff600133870 con 0x7ff60006c2e0 2023-10-14T16:54:38.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff6053ce700 1 --2- 172.21.15.155:0/811341839 >> v2:172.21.15.155:3300/0 conn(0x7ff600134200 0x7ff600029f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:38.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff605bcf700 1 --2- 172.21.15.155:0/811341839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 0x7ff600133cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0099b0 tx=0x7ff5fc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=425fc65a3230aeb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:38.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff604bcd700 1 -- 172.21.15.155:0/811341839 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc009ea0 con 0x7ff60006c2e0 2023-10-14T16:54:38.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff604bcd700 1 -- 172.21.15.155:0/811341839 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc00b860 con 0x7ff60006c2e0 2023-10-14T16:54:38.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.658+0000 7ff604bcd700 1 -- 172.21.15.155:0/811341839 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00bc00 con 0x7ff60006c2e0 2023-10-14T16:54:38.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.659+0000 7ff606bd1700 1 -- 172.21.15.155:0/811341839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 msgr2=0x7ff600133cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.659+0000 7ff606bd1700 1 --2- 172.21.15.155:0/811341839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 0x7ff600133cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0099b0 tx=0x7ff5fc009250 comp rx=0 tx=0).stop 2023-10-14T16:54:38.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.659+0000 7ff606bd1700 1 -- 172.21.15.155:0/811341839 shutdown_connections 2023-10-14T16:54:38.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.659+0000 7ff606bd1700 1 --2- 172.21.15.155:0/811341839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 0x7ff600133cc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.668 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.659+0000 7ff606bd1700 1 --2- 172.21.15.155:0/811341839 >> v2:172.21.15.155:3300/0 conn(0x7ff600134200 0x7ff600029f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.668 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.659+0000 7ff606bd1700 1 -- 172.21.15.155:0/811341839 >> 172.21.15.155:0/811341839 conn(0x7ff60006a760 msgr2=0x7ff6000701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:38.668 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.659+0000 7ff606bd1700 1 -- 172.21.15.155:0/811341839 shutdown_connections 2023-10-14T16:54:38.669 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.659+0000 7ff606bd1700 1 -- 172.21.15.155:0/811341839 wait complete. 2023-10-14T16:54:38.669 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.660+0000 7ff606bd1700 1 Processor -- start 2023-10-14T16:54:38.669 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.660+0000 7ff606bd1700 1 -- start start 2023-10-14T16:54:38.669 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.660+0000 7ff606bd1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff60002a4a0 0x7ff600146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.669 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.660+0000 7ff606bd1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 0x7ff600147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.669 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.660+0000 7ff606bd1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff600134200 0x7ff600147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.670 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.660+0000 7ff606bd1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6001312c0 con 0x7ff600134200 2023-10-14T16:54:38.670 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.660+0000 7ff606bd1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60009fd90 con 0x7ff60002a4a0 2023-10-14T16:54:38.670 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.660+0000 7ff606bd1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000a29b0 con 0x7ff60006c2e0 2023-10-14T16:54:38.670 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff605bcf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff60002a4a0 0x7ff600146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.671 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff6053ce700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 0x7ff600147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.671 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff605bcf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff60002a4a0 0x7ff600146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45090/0 (socket says 172.21.15.155:45090) 2023-10-14T16:54:38.671 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff605bcf700 1 -- 172.21.15.155:0/2864369409 learned_addr learned my addr 172.21.15.155:0/2864369409 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-14T16:54:38.671 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff6063d0700 1 --2- 172.21.15.155:0/2864369409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff600134200 0x7ff600147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff605bcf700 1 -- 172.21.15.155:0/2864369409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 msgr2=0x7ff600147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff605bcf700 1 --2- 172.21.15.155:0/2864369409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 0x7ff600147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff605bcf700 1 -- 172.21.15.155:0/2864369409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff600134200 msgr2=0x7ff600147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff605bcf700 1 --2- 172.21.15.155:0/2864369409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff600134200 0x7ff600147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff605bcf700 1 -- 172.21.15.155:0/2864369409 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f0009420 con 0x7ff60002a4a0 2023-10-14T16:54:38.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff6053ce700 1 --2- 172.21.15.155:0/2864369409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 0x7ff600147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:38.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff605bcf700 1 --2- 172.21.15.155:0/2864369409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff60002a4a0 0x7ff600146ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc006fd0 tx=0x7ff5fc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:38.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff5f5ffb700 1 -- 172.21.15.155:0/2864369409 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00bbe0 con 0x7ff60002a4a0 2023-10-14T16:54:38.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff5f5ffb700 1 -- 172.21.15.155:0/2864369409 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc000c90 con 0x7ff60002a4a0 2023-10-14T16:54:38.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff606bd1700 1 -- 172.21.15.155:0/2864369409 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc0094f0 con 0x7ff60002a4a0 2023-10-14T16:54:38.674 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff5f5ffb700 1 -- 172.21.15.155:0/2864369409 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc011650 con 0x7ff60002a4a0 2023-10-14T16:54:38.674 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff606bd1700 1 -- 172.21.15.155:0/2864369409 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6000a0c50 con 0x7ff60002a4a0 2023-10-14T16:54:38.674 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.661+0000 7ff5f5ffb700 1 -- 172.21.15.155:0/2864369409 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff5fc011a40 con 0x7ff60002a4a0 2023-10-14T16:54:38.674 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.662+0000 7ff5f5ffb700 1 -- 172.21.15.155:0/2864369409 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff5fc02d9b0 con 0x7ff60002a4a0 2023-10-14T16:54:38.674 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.662+0000 7ff606bd1700 1 -- 172.21.15.155:0/2864369409 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6000a25e0 con 0x7ff60002a4a0 2023-10-14T16:54:38.675 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.664+0000 7ff5f5ffb700 1 -- 172.21.15.155:0/2864369409 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff5fc028070 con 0x7ff60002a4a0 2023-10-14T16:54:38.745 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.745+0000 7ff606bd1700 1 -- 172.21.15.155:0/2864369409 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "18a7026e-e2a8-4830-8249-a048158018b7", "id": 0} v 0) v1 -- 0x7ff6000708d0 con 0x7ff60002a4a0 2023-10-14T16:54:38.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.748+0000 7ff5f5ffb700 1 -- 172.21.15.155:0/2864369409 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "18a7026e-e2a8-4830-8249-a048158018b7", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff5fc015020 con 0x7ff60002a4a0 2023-10-14T16:54:38.748 INFO:teuthology.orchestra.run.smithi155.stdout:0 2023-10-14T16:54:38.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.749+0000 7ff606bd1700 1 -- 172.21.15.155:0/2864369409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff60002a4a0 msgr2=0x7ff600146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.750 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.749+0000 7ff606bd1700 1 --2- 172.21.15.155:0/2864369409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff60002a4a0 0x7ff600146ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc006fd0 tx=0x7ff5fc017000 comp rx=0 tx=0).stop 2023-10-14T16:54:38.750 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.749+0000 7ff606bd1700 1 -- 172.21.15.155:0/2864369409 shutdown_connections 2023-10-14T16:54:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.749+0000 7ff606bd1700 1 --2- 172.21.15.155:0/2864369409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff600134200 0x7ff600147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.749+0000 7ff606bd1700 1 --2- 172.21.15.155:0/2864369409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff60002a4a0 0x7ff600146ed0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.749+0000 7ff606bd1700 1 --2- 172.21.15.155:0/2864369409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff60006c2e0 0x7ff600147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.749+0000 7ff606bd1700 1 -- 172.21.15.155:0/2864369409 >> 172.21.15.155:0/2864369409 conn(0x7ff60006a760 msgr2=0x7ff6001315f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.749+0000 7ff606bd1700 1 -- 172.21.15.155:0/2864369409 shutdown_connections 2023-10-14T16:54:38.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.749+0000 7ff606bd1700 1 -- 172.21.15.155:0/2864369409 wait complete. 2023-10-14T16:54:38.761 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 59b26170-a84b-41fb-9ecd-0cbd6daf418b 1 2023-10-14T16:54:38.873 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.873+0000 7f3383c93700 1 Processor -- start 2023-10-14T16:54:38.873 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.873+0000 7f3383c93700 1 -- start start 2023-10-14T16:54:38.884 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3383c93700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f337c097210 0x7f337c137280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3383c93700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c1377c0 0x7f337c133710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3383c93700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f337c133c50 0x7f337c1340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3383c93700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337c134610 con 0x7f337c133c50 2023-10-14T16:54:38.885 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3383c93700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337c137bf0 con 0x7f337c097210 2023-10-14T16:54:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3383c93700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0a63b0 con 0x7f337c1377c0 2023-10-14T16:54:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f338122e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c1377c0 0x7f337c133710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.886 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3381a2f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f337c097210 0x7f337c137280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3381a2f700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f337c097210 0x7f337c137280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45096/0 (socket says 172.21.15.155:45096) 2023-10-14T16:54:38.887 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f338122e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c1377c0 0x7f337c133710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56582/0 (socket says 172.21.15.155:56582) 2023-10-14T16:54:38.888 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3381a2f700 1 -- 172.21.15.155:0/902395800 learned_addr learned my addr 172.21.15.155:0/902395800 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-14T16:54:38.888 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3382230700 1 --2- 172.21.15.155:0/902395800 >> v2:172.21.15.8:3300/0 conn(0x7f337c133c50 0x7f337c1340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3381a2f700 1 -- 172.21.15.155:0/902395800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c1377c0 msgr2=0x7f337c133710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:38.889 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3381a2f700 1 --2- 172.21.15.155:0/902395800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c1377c0 0x7f337c133710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3381a2f700 1 -- 172.21.15.155:0/902395800 >> v2:172.21.15.8:3300/0 conn(0x7f337c133c50 msgr2=0x7f337c1340d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:38.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3381a2f700 1 --2- 172.21.15.155:0/902395800 >> v2:172.21.15.8:3300/0 conn(0x7f337c133c50 0x7f337c1340d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.890 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3381a2f700 1 -- 172.21.15.155:0/902395800 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c095a70 con 0x7f337c097210 2023-10-14T16:54:38.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3382230700 1 --2- 172.21.15.155:0/902395800 >> v2:172.21.15.8:3300/0 conn(0x7f337c133c50 0x7f337c1340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:54:38.891 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f338122e700 1 --2- 172.21.15.155:0/902395800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c1377c0 0x7f337c133710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:38.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3381a2f700 1 --2- 172.21.15.155:0/902395800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f337c097210 0x7f337c137280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f337c0a7040 tx=0x7f3378009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26cecca10a7e34a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:38.892 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3380a2d700 1 -- 172.21.15.155:0/902395800 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378009e70 con 0x7f337c097210 2023-10-14T16:54:38.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3380a2d700 1 -- 172.21.15.155:0/902395800 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337800b860 con 0x7f337c097210 2023-10-14T16:54:38.893 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.874+0000 7f3380a2d700 1 -- 172.21.15.155:0/902395800 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337800bc00 con 0x7f337c097210 2023-10-14T16:54:38.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.875+0000 7f3383c93700 1 -- 172.21.15.155:0/902395800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f337c097210 msgr2=0x7f337c137280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.875+0000 7f3383c93700 1 --2- 172.21.15.155:0/902395800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f337c097210 0x7f337c137280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f337c0a7040 tx=0x7f3378009250 comp rx=0 tx=0).stop 2023-10-14T16:54:38.894 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.875+0000 7f3383c93700 1 -- 172.21.15.155:0/902395800 shutdown_connections 2023-10-14T16:54:38.895 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.875+0000 7f3383c93700 1 --2- 172.21.15.155:0/902395800 >> v2:172.21.15.8:3300/0 conn(0x7f337c133c50 0x7f337c1340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.895 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.875+0000 7f3383c93700 1 --2- 172.21.15.155:0/902395800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f337c097210 0x7f337c137280 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.895 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.875+0000 7f3383c93700 1 --2- 172.21.15.155:0/902395800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c1377c0 0x7f337c133710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.895 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.875+0000 7f3383c93700 1 -- 172.21.15.155:0/902395800 >> 172.21.15.155:0/902395800 conn(0x7f337c06ab90 msgr2=0x7f337c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:38.896 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.875+0000 7f3383c93700 1 -- 172.21.15.155:0/902395800 shutdown_connections 2023-10-14T16:54:38.896 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.875+0000 7f3383c93700 1 -- 172.21.15.155:0/902395800 wait complete. 2023-10-14T16:54:38.896 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f3383c93700 1 Processor -- start 2023-10-14T16:54:38.896 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f3383c93700 1 -- start start 2023-10-14T16:54:38.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f3383c93700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c097210 0x7f337c130a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f3383c93700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c133c50 0x7f337c130f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f3383c93700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f337c1377c0 0x7f337c146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:38.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f3383c93700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0980e0 con 0x7f337c097210 2023-10-14T16:54:38.897 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f3383c93700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c09cb90 con 0x7f337c1377c0 2023-10-14T16:54:38.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f3383c93700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c09ba10 con 0x7f337c133c50 2023-10-14T16:54:38.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f338122e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c133c50 0x7f337c130f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f3382230700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f337c1377c0 0x7f337c146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.898 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f338122e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c133c50 0x7f337c130f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56588/0 (socket says 172.21.15.155:56588) 2023-10-14T16:54:38.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f338122e700 1 -- 172.21.15.155:0/4208215512 learned_addr learned my addr 172.21.15.155:0/4208215512 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-14T16:54:38.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.876+0000 7f3381a2f700 1 --2- 172.21.15.155:0/4208215512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c097210 0x7f337c130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:38.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3382230700 1 -- 172.21.15.155:0/4208215512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c133c50 msgr2=0x7f337c130f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.899 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3382230700 1 --2- 172.21.15.155:0/4208215512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c133c50 0x7f337c130f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.900 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3382230700 1 -- 172.21.15.155:0/4208215512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c097210 msgr2=0x7f337c130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.900 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3382230700 1 --2- 172.21.15.155:0/4208215512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c097210 0x7f337c130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.900 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3382230700 1 -- 172.21.15.155:0/4208215512 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c009420 con 0x7f337c1377c0 2023-10-14T16:54:38.900 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3382230700 1 --2- 172.21.15.155:0/4208215512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f337c1377c0 0x7f337c146800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3374009fa0 tx=0x7f3374009990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:38.900 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3371ffb700 1 -- 172.21.15.155:0/4208215512 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337400dbb0 con 0x7f337c1377c0 2023-10-14T16:54:38.901 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3371ffb700 1 -- 172.21.15.155:0/4208215512 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337400f040 con 0x7f337c1377c0 2023-10-14T16:54:38.901 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3383c93700 1 -- 172.21.15.155:0/4208215512 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33780094f0 con 0x7f337c1377c0 2023-10-14T16:54:38.901 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3371ffb700 1 -- 172.21.15.155:0/4208215512 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374015440 con 0x7f337c1377c0 2023-10-14T16:54:38.901 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3383c93700 1 -- 172.21.15.155:0/4208215512 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c1314c0 con 0x7f337c1377c0 2023-10-14T16:54:38.902 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3371ffb700 1 -- 172.21.15.155:0/4208215512 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3374015830 con 0x7f337c1377c0 2023-10-14T16:54:38.902 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.877+0000 7f3371ffb700 1 -- 172.21.15.155:0/4208215512 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f337401fa50 con 0x7f337c1377c0 2023-10-14T16:54:38.902 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.878+0000 7f3383c93700 1 -- 172.21.15.155:0/4208215512 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337c0708d0 con 0x7f337c1377c0 2023-10-14T16:54:38.902 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.880+0000 7f3371ffb700 1 -- 172.21.15.155:0/4208215512 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f337401a070 con 0x7f337c1377c0 2023-10-14T16:54:38.961 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.962+0000 7f3383c93700 1 -- 172.21.15.155:0/4208215512 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "59b26170-a84b-41fb-9ecd-0cbd6daf418b", "id": 1} v 0) v1 -- 0x7f337c136d90 con 0x7f337c1377c0 2023-10-14T16:54:38.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.964+0000 7f3371ffb700 1 -- 172.21.15.155:0/4208215512 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "59b26170-a84b-41fb-9ecd-0cbd6daf418b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3374015c70 con 0x7f337c1377c0 2023-10-14T16:54:38.965 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-10-14T16:54:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.965+0000 7f3383c93700 1 -- 172.21.15.155:0/4208215512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f337c1377c0 msgr2=0x7f337c146800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.965+0000 7f3383c93700 1 --2- 172.21.15.155:0/4208215512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f337c1377c0 0x7f337c146800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3374009fa0 tx=0x7f3374009990 comp rx=0 tx=0).stop 2023-10-14T16:54:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.965+0000 7f3383c93700 1 -- 172.21.15.155:0/4208215512 shutdown_connections 2023-10-14T16:54:38.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.965+0000 7f3383c93700 1 --2- 172.21.15.155:0/4208215512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f337c1377c0 0x7f337c146800 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.965+0000 7f3383c93700 1 --2- 172.21.15.155:0/4208215512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f337c097210 0x7f337c130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.965+0000 7f3383c93700 1 --2- 172.21.15.155:0/4208215512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f337c133c50 0x7f337c130f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.965+0000 7f3383c93700 1 -- 172.21.15.155:0/4208215512 >> 172.21.15.155:0/4208215512 conn(0x7f337c06ab90 msgr2=0x7f337c0a81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:38.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.965+0000 7f3383c93700 1 -- 172.21.15.155:0/4208215512 shutdown_connections 2023-10-14T16:54:38.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:38.965+0000 7f3383c93700 1 -- 172.21.15.155:0/4208215512 wait complete. 2023-10-14T16:54:38.977 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 2357fcd3-7aa9-4bb0-a7a6-64449296dac8 2 2023-10-14T16:54:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.093+0000 7efcf92a3700 1 Processor -- start 2023-10-14T16:54:39.101 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.093+0000 7efcf92a3700 1 -- start start 2023-10-14T16:54:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf92a3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf40a3600 0x7efcf41370d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf92a3700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efcf4137610 0x7efcf4067d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.102 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf92a3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40a2b80 con 0x7efcf406bf50 2023-10-14T16:54:39.103 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf92a3700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf406c470 con 0x7efcf4137610 2023-10-14T16:54:39.103 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf92a3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40a3b00 con 0x7efcf40a3600 2023-10-14T16:54:39.103 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf2ffd700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf40a3600 0x7efcf41370d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.104 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf27fc700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7efcf406bf50 0x7efcf4067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:59006/0 (socket says 172.21.15.155:59006) 2023-10-14T16:54:39.104 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf27fc700 1 -- 172.21.15.155:0/907606539 learned_addr learned my addr 172.21.15.155:0/907606539 (peer_addr_for_me v1:172.21.15.155:0/0) 2023-10-14T16:54:39.104 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf37fe700 1 --2- 172.21.15.155:0/907606539 >> v2:172.21.15.8:3300/0 conn(0x7efcf4137610 0x7efcf4067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.104 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf1ffb700 1 -- 172.21.15.155:0/907606539 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682020897 0 0) 0x7efcf40a2b80 con 0x7efcf406bf50 2023-10-14T16:54:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf2ffd700 1 -- 172.21.15.155:0/907606539 >> v2:172.21.15.8:3300/0 conn(0x7efcf4137610 msgr2=0x7efcf4067d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf2ffd700 1 --2- 172.21.15.155:0/907606539 >> v2:172.21.15.8:3300/0 conn(0x7efcf4137610 0x7efcf4067d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf2ffd700 1 -- 172.21.15.155:0/907606539 >> v1:172.21.15.155:6789/0 conn(0x7efcf406bf50 legacy=0x7efcf4067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf2ffd700 1 -- 172.21.15.155:0/907606539 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4136c80 con 0x7efcf40a3600 2023-10-14T16:54:39.105 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf2ffd700 1 --2- 172.21.15.155:0/907606539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf40a3600 0x7efcf41370d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efce40098e0 tx=0x7efce40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c9587a6c7a510d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:39.106 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf1ffb700 1 -- 172.21.15.155:0/907606539 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4009e80 con 0x7efcf40a3600 2023-10-14T16:54:39.106 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf1ffb700 1 -- 172.21.15.155:0/907606539 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce400b860 con 0x7efcf40a3600 2023-10-14T16:54:39.106 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.094+0000 7efcf1ffb700 1 -- 172.21.15.155:0/907606539 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce400bbe0 con 0x7efcf40a3600 2023-10-14T16:54:39.107 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.095+0000 7efcf92a3700 1 -- 172.21.15.155:0/907606539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf40a3600 msgr2=0x7efcf41370d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.107 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.095+0000 7efcf92a3700 1 --2- 172.21.15.155:0/907606539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf40a3600 0x7efcf41370d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efce40098e0 tx=0x7efce40091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.107 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.095+0000 7efcf92a3700 1 -- 172.21.15.155:0/907606539 shutdown_connections 2023-10-14T16:54:39.108 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.095+0000 7efcf92a3700 1 --2- 172.21.15.155:0/907606539 >> v2:172.21.15.8:3300/0 conn(0x7efcf4137610 0x7efcf4067d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.108 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.095+0000 7efcf92a3700 1 --2- 172.21.15.155:0/907606539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf40a3600 0x7efcf41370d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.109 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.095+0000 7efcf92a3700 1 -- 172.21.15.155:0/907606539 >> 172.21.15.155:0/907606539 conn(0x7efcf406f500 msgr2=0x7efcf40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:39.109 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.095+0000 7efcf92a3700 1 -- 172.21.15.155:0/907606539 shutdown_connections 2023-10-14T16:54:39.109 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.095+0000 7efcf92a3700 1 -- 172.21.15.155:0/907606539 wait complete. 2023-10-14T16:54:39.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.096+0000 7efcf92a3700 1 Processor -- start 2023-10-14T16:54:39.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.096+0000 7efcf92a3700 1 -- start start 2023-10-14T16:54:39.110 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.096+0000 7efcf92a3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcf406bf50 0x7efcf409a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.111 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf92a3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf4137610 0x7efcf41432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.111 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf92a3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf409c1d0 0x7efcf41437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf92a3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4133fc0 con 0x7efcf406bf50 2023-10-14T16:54:39.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf92a3700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4143000 con 0x7efcf4137610 2023-10-14T16:54:39.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf92a3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf409b7a0 con 0x7efcf409c1d0 2023-10-14T16:54:39.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf27fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf4137610 0x7efcf41432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf37fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf409c1d0 0x7efcf41437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf27fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf4137610 0x7efcf41432a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45152/0 (socket says 172.21.15.155:45152) 2023-10-14T16:54:39.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf27fc700 1 -- 172.21.15.155:0/1752783348 learned_addr learned my addr 172.21.15.155:0/1752783348 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-14T16:54:39.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf2ffd700 1 --2- 172.21.15.155:0/1752783348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcf406bf50 0x7efcf409a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf27fc700 1 -- 172.21.15.155:0/1752783348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf409c1d0 msgr2=0x7efcf41437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf27fc700 1 --2- 172.21.15.155:0/1752783348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf409c1d0 0x7efcf41437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf27fc700 1 -- 172.21.15.155:0/1752783348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcf406bf50 msgr2=0x7efcf409a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf27fc700 1 --2- 172.21.15.155:0/1752783348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcf406bf50 0x7efcf409a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf27fc700 1 -- 172.21.15.155:0/1752783348 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4009420 con 0x7efcf4137610 2023-10-14T16:54:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf27fc700 1 --2- 172.21.15.155:0/1752783348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf4137610 0x7efcf41432a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efce800c840 tx=0x7efce8007db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcdaffd700 1 -- 172.21.15.155:0/1752783348 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8005c00 con 0x7efcf4137610 2023-10-14T16:54:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcdaffd700 1 -- 172.21.15.155:0/1752783348 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce8005d60 con 0x7efcf4137610 2023-10-14T16:54:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcdaffd700 1 -- 172.21.15.155:0/1752783348 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8007300 con 0x7efcf4137610 2023-10-14T16:54:39.116 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf92a3700 1 -- 172.21.15.155:0/1752783348 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf409ba60 con 0x7efcf4137610 2023-10-14T16:54:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcf92a3700 1 -- 172.21.15.155:0/1752783348 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf4143d20 con 0x7efcf4137610 2023-10-14T16:54:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.097+0000 7efcdaffd700 1 -- 172.21.15.155:0/1752783348 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7efce801c6c0 con 0x7efcf4137610 2023-10-14T16:54:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.098+0000 7efcdaffd700 1 -- 172.21.15.155:0/1752783348 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7efce80076f0 con 0x7efcf4137610 2023-10-14T16:54:39.117 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.098+0000 7efcf92a3700 1 -- 172.21.15.155:0/1752783348 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf4143f40 con 0x7efcf4137610 2023-10-14T16:54:39.118 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.102+0000 7efcdaffd700 1 -- 172.21.15.155:0/1752783348 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7efce8017070 con 0x7efcf4137610 2023-10-14T16:54:39.185 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.185+0000 7efcf92a3700 1 -- 172.21.15.155:0/1752783348 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2357fcd3-7aa9-4bb0-a7a6-64449296dac8", "id": 2} v 0) v1 -- 0x7efcf406f900 con 0x7efcf4137610 2023-10-14T16:54:39.188 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.189+0000 7efcdaffd700 1 -- 172.21.15.155:0/1752783348 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2357fcd3-7aa9-4bb0-a7a6-64449296dac8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7efce801cb50 con 0x7efcf4137610 2023-10-14T16:54:39.189 INFO:teuthology.orchestra.run.smithi155.stdout:2 2023-10-14T16:54:39.190 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.190+0000 7efcf92a3700 1 -- 172.21.15.155:0/1752783348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf4137610 msgr2=0x7efcf41432a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.190 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.190+0000 7efcf92a3700 1 --2- 172.21.15.155:0/1752783348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf4137610 0x7efcf41432a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efce800c840 tx=0x7efce8007db0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.190 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.190+0000 7efcf92a3700 1 -- 172.21.15.155:0/1752783348 shutdown_connections 2023-10-14T16:54:39.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.190+0000 7efcf92a3700 1 --2- 172.21.15.155:0/1752783348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf409c1d0 0x7efcf41437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.190+0000 7efcf92a3700 1 --2- 172.21.15.155:0/1752783348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcf406bf50 0x7efcf409a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.190+0000 7efcf92a3700 1 --2- 172.21.15.155:0/1752783348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf4137610 0x7efcf41432a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.190+0000 7efcf92a3700 1 -- 172.21.15.155:0/1752783348 >> 172.21.15.155:0/1752783348 conn(0x7efcf406f500 msgr2=0x7efcf406c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:39.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.190+0000 7efcf92a3700 1 -- 172.21.15.155:0/1752783348 shutdown_connections 2023-10-14T16:54:39.192 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.190+0000 7efcf92a3700 1 -- 172.21.15.155:0/1752783348 wait complete. 2023-10-14T16:54:39.203 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new f8e9141f-9815-4410-bbd0-2af26e034a9f 3 2023-10-14T16:54:39.320 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.320+0000 7f1c1be9f700 1 Processor -- start 2023-10-14T16:54:39.321 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.320+0000 7f1c1be9f700 1 -- start start 2023-10-14T16:54:39.323 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c1be9f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1c14097210 0x7f1c14137280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.323 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c1be9f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c141377c0 0x7f1c14133710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.323 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c1be9f700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c14137bf0 con 0x7f1c14133c50 2023-10-14T16:54:39.324 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c1be9f700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c140a63b0 con 0x7f1c14097210 2023-10-14T16:54:39.324 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c1be9f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c14095a70 con 0x7f1c141377c0 2023-10-14T16:54:39.324 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c1943a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c141377c0 0x7f1c14133710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.324 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c1943a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c141377c0 0x7f1c14133710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56634/0 (socket says 172.21.15.155:56634) 2023-10-14T16:54:39.324 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c1943a700 1 -- 172.21.15.155:0/772008406 learned_addr learned my addr 172.21.15.155:0/772008406 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-14T16:54:39.325 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c19c3b700 1 --2- 172.21.15.155:0/772008406 >> v2:172.21.15.8:3300/0 conn(0x7f1c14097210 0x7f1c14137280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.325 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c1943a700 1 -- 172.21.15.155:0/772008406 >> v2:172.21.15.8:3300/0 conn(0x7f1c14097210 msgr2=0x7f1c14137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:39.325 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c1943a700 1 --2- 172.21.15.155:0/772008406 >> v2:172.21.15.8:3300/0 conn(0x7f1c14097210 0x7f1c14137280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.325 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c1943a700 1 -- 172.21.15.155:0/772008406 >> v1:172.21.15.8:6789/0 conn(0x7f1c14133c50 legacy=0x7f1c1413e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.325 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.321+0000 7f1c1943a700 1 -- 172.21.15.155:0/772008406 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14136d90 con 0x7f1c141377c0 2023-10-14T16:54:39.325 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.322+0000 7f1c1943a700 1 --2- 172.21.15.155:0/772008406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c141377c0 0x7f1c14133710 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1c100099b0 tx=0x7f1c10009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80bb88802d114497 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:39.326 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.322+0000 7f1c18c39700 1 -- 172.21.15.155:0/772008406 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10009ea0 con 0x7f1c141377c0 2023-10-14T16:54:39.326 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.322+0000 7f1c18c39700 1 -- 172.21.15.155:0/772008406 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1000b860 con 0x7f1c141377c0 2023-10-14T16:54:39.326 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.322+0000 7f1c18c39700 1 -- 172.21.15.155:0/772008406 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1000bc00 con 0x7f1c141377c0 2023-10-14T16:54:39.326 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.322+0000 7f1c1be9f700 1 -- 172.21.15.155:0/772008406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c141377c0 msgr2=0x7f1c14133710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.327 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.322+0000 7f1c1be9f700 1 --2- 172.21.15.155:0/772008406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c141377c0 0x7f1c14133710 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1c100099b0 tx=0x7f1c10009250 comp rx=0 tx=0).stop 2023-10-14T16:54:39.327 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.322+0000 7f1c1be9f700 1 -- 172.21.15.155:0/772008406 shutdown_connections 2023-10-14T16:54:39.327 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.322+0000 7f1c1be9f700 1 --2- 172.21.15.155:0/772008406 >> v2:172.21.15.8:3300/0 conn(0x7f1c14097210 0x7f1c14137280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.327 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.322+0000 7f1c1be9f700 1 --2- 172.21.15.155:0/772008406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c141377c0 0x7f1c14133710 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.327 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.322+0000 7f1c1be9f700 1 -- 172.21.15.155:0/772008406 >> 172.21.15.155:0/772008406 conn(0x7f1c1406ab90 msgr2=0x7f1c140701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:39.327 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.323+0000 7f1c1be9f700 1 -- 172.21.15.155:0/772008406 shutdown_connections 2023-10-14T16:54:39.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.323+0000 7f1c1be9f700 1 -- 172.21.15.155:0/772008406 wait complete. 2023-10-14T16:54:39.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.323+0000 7f1c1be9f700 1 Processor -- start 2023-10-14T16:54:39.328 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.323+0000 7f1c1be9f700 1 -- start start 2023-10-14T16:54:39.330 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1be9f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c14097210 0x7f1c141307a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.331 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1be9f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c14133c50 0x7f1c14130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.331 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1be9f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c141377c0 0x7f1c1409b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.331 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1be9f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140a0740 con 0x7f1c14133c50 2023-10-14T16:54:39.331 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1be9f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1409fa60 con 0x7f1c141377c0 2023-10-14T16:54:39.332 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1be9f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1409f220 con 0x7f1c14097210 2023-10-14T16:54:39.332 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c19c3b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c14097210 0x7f1c141307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.332 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c19c3b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c14097210 0x7f1c141307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56640/0 (socket says 172.21.15.155:56640) 2023-10-14T16:54:39.332 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c19c3b700 1 -- 172.21.15.155:0/3285724802 learned_addr learned my addr 172.21.15.155:0/3285724802 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-14T16:54:39.332 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1a43c700 1 --2- 172.21.15.155:0/3285724802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c141377c0 0x7f1c1409b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1943a700 1 --2- 172.21.15.155:0/3285724802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c14133c50 0x7f1c14130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1a43c700 1 -- 172.21.15.155:0/3285724802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c14097210 msgr2=0x7f1c141307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1a43c700 1 --2- 172.21.15.155:0/3285724802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c14097210 0x7f1c141307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1a43c700 1 -- 172.21.15.155:0/3285724802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c14133c50 msgr2=0x7f1c14130ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1a43c700 1 --2- 172.21.15.155:0/3285724802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c14133c50 0x7f1c14130ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1a43c700 1 -- 172.21.15.155:0/3285724802 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100094f0 con 0x7f1c141377c0 2023-10-14T16:54:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c19c3b700 1 --2- 172.21.15.155:0/3285724802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c14097210 0x7f1c141307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1943a700 1 --2- 172.21.15.155:0/3285724802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c14133c50 0x7f1c14130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.324+0000 7f1c1a43c700 1 --2- 172.21.15.155:0/3285724802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c141377c0 0x7f1c1409b9f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00c830 tx=0x7f1c0c001690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.325+0000 7f1c09ffb700 1 -- 172.21.15.155:0/3285724802 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c012630 con 0x7f1c141377c0 2023-10-14T16:54:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.325+0000 7f1c09ffb700 1 -- 172.21.15.155:0/3285724802 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c0127b0 con 0x7f1c141377c0 2023-10-14T16:54:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.325+0000 7f1c1be9f700 1 -- 172.21.15.155:0/3285724802 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c140a3240 con 0x7f1c141377c0 2023-10-14T16:54:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.325+0000 7f1c09ffb700 1 -- 172.21.15.155:0/3285724802 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c012b70 con 0x7f1c141377c0 2023-10-14T16:54:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.325+0000 7f1c09ffb700 1 -- 172.21.15.155:0/3285724802 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1c0c003030 con 0x7f1c141377c0 2023-10-14T16:54:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.325+0000 7f1c1be9f700 1 -- 172.21.15.155:0/3285724802 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c140a4280 con 0x7f1c141377c0 2023-10-14T16:54:39.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.325+0000 7f1c09ffb700 1 -- 172.21.15.155:0/3285724802 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f1c0c011380 con 0x7f1c141377c0 2023-10-14T16:54:39.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.326+0000 7f1c1be9f700 1 -- 172.21.15.155:0/3285724802 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c140a09e0 con 0x7f1c141377c0 2023-10-14T16:54:39.336 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.328+0000 7f1c09ffb700 1 -- 172.21.15.155:0/3285724802 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1c0c01b860 con 0x7f1c141377c0 2023-10-14T16:54:39.411 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.411+0000 7f1c1be9f700 1 -- 172.21.15.155:0/3285724802 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f8e9141f-9815-4410-bbd0-2af26e034a9f", "id": 3} v 0) v1 -- 0x7f1c1409fe20 con 0x7f1c141377c0 2023-10-14T16:54:39.413 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.413+0000 7f1c09ffb700 1 -- 172.21.15.155:0/3285724802 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f8e9141f-9815-4410-bbd0-2af26e034a9f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1c0c01ba80 con 0x7f1c141377c0 2023-10-14T16:54:39.413 INFO:teuthology.orchestra.run.smithi155.stdout:3 2023-10-14T16:54:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.414+0000 7f1c1be9f700 1 -- 172.21.15.155:0/3285724802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c141377c0 msgr2=0x7f1c1409b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.414+0000 7f1c1be9f700 1 --2- 172.21.15.155:0/3285724802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c141377c0 0x7f1c1409b9f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00c830 tx=0x7f1c0c001690 comp rx=0 tx=0).stop 2023-10-14T16:54:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.415+0000 7f1c1be9f700 1 -- 172.21.15.155:0/3285724802 shutdown_connections 2023-10-14T16:54:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.415+0000 7f1c1be9f700 1 --2- 172.21.15.155:0/3285724802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c141377c0 0x7f1c1409b9f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.415 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.415+0000 7f1c1be9f700 1 --2- 172.21.15.155:0/3285724802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c14097210 0x7f1c141307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.415+0000 7f1c1be9f700 1 --2- 172.21.15.155:0/3285724802 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c14133c50 0x7f1c14130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.415+0000 7f1c1be9f700 1 -- 172.21.15.155:0/3285724802 >> 172.21.15.155:0/3285724802 conn(0x7f1c1406ab90 msgr2=0x7f1c14134e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.415+0000 7f1c1be9f700 1 -- 172.21.15.155:0/3285724802 shutdown_connections 2023-10-14T16:54:39.416 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-14T16:54:39.415+0000 7f1c1be9f700 1 -- 172.21.15.155:0/3285724802 wait complete. 2023-10-14T16:54:39.425 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:39.425+0000 7fcea011d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T16:54:39.427 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-14T16:54:39.427 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-14T16:54:39.430 INFO:tasks.ceph.osd.0:Started 2023-10-14T16:54:39.430 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-14T16:54:39.431 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-14T16:54:39.433 INFO:tasks.ceph.osd.1:Started 2023-10-14T16:54:39.433 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-14T16:54:39.433 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-14T16:54:39.435 INFO:tasks.ceph.osd.2:Started 2023-10-14T16:54:39.436 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-14T16:54:39.436 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-14T16:54:39.439 INFO:tasks.ceph.osd.3:Started 2023-10-14T16:54:39.439 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T16:54:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.563+0000 7f4ef9308700 1 Processor -- start 2023-10-14T16:54:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.563+0000 7f4ef9308700 1 -- start start 2023-10-14T16:54:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.563+0000 7f4ef9308700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ef40a1310 0x7f4ef413f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.563+0000 7f4ef9308700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef40a2df0 con 0x7f4ef40a25c0 2023-10-14T16:54:39.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.563+0000 7f4ef9308700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef4133ae0 con 0x7f4ef40a6940 2023-10-14T16:54:39.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.563+0000 7f4ef9308700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef41338f0 con 0x7f4ef40a1310 2023-10-14T16:54:39.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.563+0000 7f4ef27fc700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4ef40a25c0 0x7f4ef413c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47776/0 (socket says 172.21.15.8:47776) 2023-10-14T16:54:39.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.563+0000 7f4ef27fc700 1 -- 172.21.15.8:0/1341448113 learned_addr learned my addr 172.21.15.8:0/1341448113 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:39.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef37fe700 1 --2- 172.21.15.8:0/1341448113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ef40a1310 0x7f4ef413f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef1ffb700 1 -- 172.21.15.8:0/1341448113 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203569192 0 0) 0x7f4ef40a2df0 con 0x7f4ef40a25c0 2023-10-14T16:54:39.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef1ffb700 1 -- 172.21.15.8:0/1341448113 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4edc003570 con 0x7f4ef40a25c0 2023-10-14T16:54:39.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef1ffb700 1 -- 172.21.15.8:0/1341448113 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467429365 0 0) 0x7f4ef4133ae0 con 0x7f4ef40a6940 2023-10-14T16:54:39.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef1ffb700 1 -- 172.21.15.8:0/1341448113 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef40a2df0 con 0x7f4ef40a6940 2023-10-14T16:54:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef1ffb700 1 -- 172.21.15.8:0/1341448113 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 703528419 0 0) 0x7f4edc003570 con 0x7f4ef40a25c0 2023-10-14T16:54:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef37fe700 1 -- 172.21.15.8:0/1341448113 >> v1:172.21.15.155:6789/0 conn(0x7f4ef40a6940 legacy=0x7f4ef4133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef37fe700 1 -- 172.21.15.8:0/1341448113 >> v1:172.21.15.8:6789/0 conn(0x7f4ef40a25c0 legacy=0x7f4ef413c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef37fe700 1 -- 172.21.15.8:0/1341448113 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef40a1720 con 0x7f4ef40a1310 2023-10-14T16:54:39.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef37fe700 1 --2- 172.21.15.8:0/1341448113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ef40a1310 0x7f4ef413f8d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009e90 tx=0x7f4eec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=494dfac697df62ab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef1ffb700 1 -- 172.21.15.8:0/1341448113 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec00e070 con 0x7f4ef40a1310 2023-10-14T16:54:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef1ffb700 1 -- 172.21.15.8:0/1341448113 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec00b870 con 0x7f4ef40a1310 2023-10-14T16:54:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.564+0000 7f4ef1ffb700 1 -- 172.21.15.8:0/1341448113 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8001470 con 0x7f4ef40a1310 2023-10-14T16:54:39.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.565+0000 7f4ef9308700 1 -- 172.21.15.8:0/1341448113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ef40a1310 msgr2=0x7f4ef413f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.565+0000 7f4ef9308700 1 --2- 172.21.15.8:0/1341448113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ef40a1310 0x7f4ef413f8d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009e90 tx=0x7f4eec009780 comp rx=0 tx=0).stop 2023-10-14T16:54:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.565+0000 7f4ef9308700 1 -- 172.21.15.8:0/1341448113 shutdown_connections 2023-10-14T16:54:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.565+0000 7f4ef9308700 1 --2- 172.21.15.8:0/1341448113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ef40a1310 0x7f4ef413f8d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.565+0000 7f4ef9308700 1 -- 172.21.15.8:0/1341448113 >> 172.21.15.8:0/1341448113 conn(0x7f4ef406acd0 msgr2=0x7f4ef40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:39.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.565+0000 7f4ef9308700 1 -- 172.21.15.8:0/1341448113 shutdown_connections 2023-10-14T16:54:39.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.565+0000 7f4ef9308700 1 -- 172.21.15.8:0/1341448113 wait complete. 2023-10-14T16:54:39.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.566+0000 7f4ef9308700 1 Processor -- start 2023-10-14T16:54:39.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.566+0000 7f4ef9308700 1 -- start start 2023-10-14T16:54:39.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.566+0000 7f4ef9308700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ef40a1310 0x7f4ef4146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.566+0000 7f4ef9308700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ef40a25c0 0x7f4ef4146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.566+0000 7f4ef9308700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ef4097920 0x7f4ef41470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:39.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.566+0000 7f4ef9308700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4095a70 con 0x7f4ef4097920 2023-10-14T16:54:39.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.566+0000 7f4ef9308700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4131760 con 0x7f4ef40a25c0 2023-10-14T16:54:39.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.566+0000 7f4ef9308700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4098b20 con 0x7f4ef40a1310 2023-10-14T16:54:39.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.566+0000 7f4ef37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ef4097920 0x7f4ef41470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ef4097920 0x7f4ef41470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47190/0 (socket says 172.21.15.8:47190) 2023-10-14T16:54:39.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef37fe700 1 -- 172.21.15.8:0/3643153813 learned_addr learned my addr 172.21.15.8:0/3643153813 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:39.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef27fc700 1 --2- 172.21.15.8:0/3643153813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ef40a25c0 0x7f4ef4146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef2ffd700 1 --2- 172.21.15.8:0/3643153813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ef40a1310 0x7f4ef4146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:39.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef37fe700 1 -- 172.21.15.8:0/3643153813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ef40a1310 msgr2=0x7f4ef4146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef37fe700 1 --2- 172.21.15.8:0/3643153813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ef40a1310 0x7f4ef4146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef37fe700 1 -- 172.21.15.8:0/3643153813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ef40a25c0 msgr2=0x7f4ef4146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef37fe700 1 --2- 172.21.15.8:0/3643153813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ef40a25c0 0x7f4ef4146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef37fe700 1 -- 172.21.15.8:0/3643153813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec009a20 con 0x7f4ef4097920 2023-10-14T16:54:39.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef27fc700 1 --2- 172.21.15.8:0/3643153813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ef40a25c0 0x7f4ef4146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:39.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef37fe700 1 --2- 172.21.15.8:0/3643153813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ef4097920 0x7f4ef41470f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0097c0 tx=0x7f4eec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:39.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4edaffd700 1 -- 172.21.15.8:0/3643153813 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec012b70 con 0x7f4ef4097920 2023-10-14T16:54:39.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4edaffd700 1 -- 172.21.15.8:0/3643153813 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec012cd0 con 0x7f4ef4097920 2023-10-14T16:54:39.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef9308700 1 -- 172.21.15.8:0/3643153813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef40aa010 con 0x7f4ef4097920 2023-10-14T16:54:39.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4edaffd700 1 -- 172.21.15.8:0/3643153813 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec01e680 con 0x7f4ef4097920 2023-10-14T16:54:39.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4ef9308700 1 -- 172.21.15.8:0/3643153813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef4098e90 con 0x7f4ef4097920 2023-10-14T16:54:39.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4edaffd700 1 -- 172.21.15.8:0/3643153813 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4eec01ea70 con 0x7f4ef4097920 2023-10-14T16:54:39.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.567+0000 7f4edaffd700 1 -- 172.21.15.8:0/3643153813 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f4eec026a50 con 0x7f4ef4097920 2023-10-14T16:54:39.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.568+0000 7f4ef9308700 1 -- 172.21.15.8:0/3643153813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef40995c0 con 0x7f4ef4097920 2023-10-14T16:54:39.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.572+0000 7f4edaffd700 1 -- 172.21.15.8:0/3643153813 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4eec016020 con 0x7f4ef4097920 2023-10-14T16:54:39.581 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:39.575+0000 7fcea011d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T16:54:39.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.642+0000 7f4ef9308700 1 -- 172.21.15.8:0/3643153813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ef40708d0 con 0x7f4ef4097920 2023-10-14T16:54:39.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.643+0000 7f4edaffd700 1 -- 172.21.15.8:0/3643153813 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7f4eec026540 con 0x7f4ef4097920 2023-10-14T16:54:39.646 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:39.647 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":6,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:39.412080+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:54:39.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.644+0000 7f4ef9308700 1 -- 172.21.15.8:0/3643153813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ef4097920 msgr2=0x7f4ef41470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.644+0000 7f4ef9308700 1 --2- 172.21.15.8:0/3643153813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ef4097920 0x7f4ef41470f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0097c0 tx=0x7f4eec017000 comp rx=0 tx=0).stop 2023-10-14T16:54:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.644+0000 7f4ef9308700 1 -- 172.21.15.8:0/3643153813 shutdown_connections 2023-10-14T16:54:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.644+0000 7f4ef9308700 1 --2- 172.21.15.8:0/3643153813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4ef4097920 0x7f4ef41470f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.644+0000 7f4ef9308700 1 --2- 172.21.15.8:0/3643153813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ef40a1310 0x7f4ef4146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.644+0000 7f4ef9308700 1 --2- 172.21.15.8:0/3643153813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ef40a25c0 0x7f4ef4146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.644+0000 7f4ef9308700 1 -- 172.21.15.8:0/3643153813 >> 172.21.15.8:0/3643153813 conn(0x7f4ef406acd0 msgr2=0x7f4ef4138f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.644+0000 7f4ef9308700 1 -- 172.21.15.8:0/3643153813 shutdown_connections 2023-10-14T16:54:39.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:39.644+0000 7f4ef9308700 1 -- 172.21.15.8:0/3643153813 wait complete. 2023-10-14T16:54:39.656 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:39.655+0000 7fcea011d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T16:54:39.657 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-14T16:54:39.657 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-14T16:54:39.848 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:39.848+0000 7fcea011d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T16:54:40.021 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-10-14T16:54:40.021+0000 7fce98708540 -1 Falling back to public interface 2023-10-14T16:54:40.024 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-10-14T16:54:40.023+0000 7f90fc0e6540 -1 Falling back to public interface 2023-10-14T16:54:40.024 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-10-14T16:54:40.023+0000 7f834a97e540 -1 Falling back to public interface 2023-10-14T16:54:40.026 INFO:tasks.ceph.osd.3.smithi155.stderr:2023-10-14T16:54:40.026+0000 7fcd772f8540 -1 Falling back to public interface 2023-10-14T16:54:40.030 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:40.030+0000 7fcea011d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T16:54:40.060 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T16:54:40.112 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:40.111+0000 7fcea011d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T16:54:40.139 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:40.139+0000 7f3dfc5c8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T16:54:40.172 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.171+0000 7ff5a8dd2700 1 Processor -- start 2023-10-14T16:54:40.172 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.171+0000 7ff5a8dd2700 1 -- start start 2023-10-14T16:54:40.175 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a8dd2700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff5a40a16e0 0x7ff5a413c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:40.175 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a8dd2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5a41379d0 0x7ff5a413e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:40.175 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a8dd2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a40a1ef0 con 0x7ff5a4067af0 2023-10-14T16:54:40.175 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a8dd2700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a40a1030 con 0x7ff5a40a16e0 2023-10-14T16:54:40.176 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a8dd2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40a6040 con 0x7ff5a41379d0 2023-10-14T16:54:40.176 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a1d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff5a40a16e0 0x7ff5a413c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:40.176 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a1d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff5a40a16e0 0x7ff5a413c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47192/0 (socket says 172.21.15.8:47192) 2023-10-14T16:54:40.176 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a1d9b700 1 -- 172.21.15.8:0/2184015645 learned_addr learned my addr 172.21.15.8:0/2184015645 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:40.176 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a2d9d700 1 --2- 172.21.15.8:0/2184015645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5a41379d0 0x7ff5a413e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:40.177 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a1d9b700 1 -- 172.21.15.8:0/2184015645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5a41379d0 msgr2=0x7ff5a413e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:40.177 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a1d9b700 1 --2- 172.21.15.8:0/2184015645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5a41379d0 0x7ff5a413e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:40.177 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a1d9b700 1 -- 172.21.15.8:0/2184015645 >> v1:172.21.15.155:6789/0 conn(0x7ff5a4067af0 legacy=0x7ff5a41372c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:40.177 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a1d9b700 1 -- 172.21.15.8:0/2184015645 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40a1c30 con 0x7ff5a40a16e0 2023-10-14T16:54:40.177 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a159a700 1 -- 172.21.15.8:0/2184015645 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836850222 0 0) 0x7ff5a40a1ef0 con 0x7ff5a4067af0 2023-10-14T16:54:40.178 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.172+0000 7ff5a1d9b700 1 --2- 172.21.15.8:0/2184015645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5a40a16e0 0x7ff5a413c1b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff5940099b0 tx=0x7ff594009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec31cc1cc1db5a26 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:40.178 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.173+0000 7ff5a159a700 1 -- 172.21.15.8:0/2184015645 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594009ea0 con 0x7ff5a40a16e0 2023-10-14T16:54:40.178 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.173+0000 7ff5a159a700 1 -- 172.21.15.8:0/2184015645 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59400b860 con 0x7ff5a40a16e0 2023-10-14T16:54:40.178 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.173+0000 7ff5a159a700 1 -- 172.21.15.8:0/2184015645 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400bc20 con 0x7ff5a40a16e0 2023-10-14T16:54:40.178 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.173+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/2184015645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5a40a16e0 msgr2=0x7ff5a413c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:40.179 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.173+0000 7ff5a8dd2700 1 --2- 172.21.15.8:0/2184015645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5a40a16e0 0x7ff5a413c1b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff5940099b0 tx=0x7ff594009250 comp rx=0 tx=0).stop 2023-10-14T16:54:40.179 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.173+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/2184015645 shutdown_connections 2023-10-14T16:54:40.180 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.173+0000 7ff5a8dd2700 1 --2- 172.21.15.8:0/2184015645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5a41379d0 0x7ff5a413e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:40.180 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.173+0000 7ff5a8dd2700 1 --2- 172.21.15.8:0/2184015645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5a40a16e0 0x7ff5a413c1b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:40.180 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.173+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/2184015645 >> 172.21.15.8:0/2184015645 conn(0x7ff5a40a68b0 msgr2=0x7ff5a40a6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:40.180 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.173+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/2184015645 shutdown_connections 2023-10-14T16:54:40.181 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.173+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/2184015645 wait complete. 2023-10-14T16:54:40.181 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.174+0000 7ff5a8dd2700 1 Processor -- start 2023-10-14T16:54:40.181 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.174+0000 7ff5a8dd2700 1 -- start start 2023-10-14T16:54:40.183 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a8dd2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5a4067af0 0x7ff5a41305c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:40.184 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a8dd2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5a40a16e0 0x7ff5a4130b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:40.184 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a8dd2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a41379d0 0x7ff5a4131040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:40.184 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a8dd2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4099ab0 con 0x7ff5a40a16e0 2023-10-14T16:54:40.184 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a8dd2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4099ca0 con 0x7ff5a41379d0 2023-10-14T16:54:40.184 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a8dd2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40a0500 con 0x7ff5a4067af0 2023-10-14T16:54:40.185 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5a40a16e0 0x7ff5a4130b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:40.185 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5a40a16e0 0x7ff5a4130b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47196/0 (socket says 172.21.15.8:47196) 2023-10-14T16:54:40.185 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a259c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5a4067af0 0x7ff5a41305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:40.185 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a2d9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a41379d0 0x7ff5a4131040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:40.185 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a1d9b700 1 -- 172.21.15.8:0/1257537174 learned_addr learned my addr 172.21.15.8:0/1257537174 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:40.186 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a1d9b700 1 -- 172.21.15.8:0/1257537174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5a4067af0 msgr2=0x7ff5a41305c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:40.186 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a1d9b700 1 --2- 172.21.15.8:0/1257537174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5a4067af0 0x7ff5a41305c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:40.186 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a1d9b700 1 -- 172.21.15.8:0/1257537174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a41379d0 msgr2=0x7ff5a4131040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:40.186 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a1d9b700 1 --2- 172.21.15.8:0/1257537174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a41379d0 0x7ff5a4131040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:40.186 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a1d9b700 1 -- 172.21.15.8:0/1257537174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5940094f0 con 0x7ff5a40a16e0 2023-10-14T16:54:40.187 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5a1d9b700 1 --2- 172.21.15.8:0/1257537174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5a40a16e0 0x7ff5a4130b00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff594006fd0 tx=0x7ff594017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:40.187 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.175+0000 7ff5927fc700 1 -- 172.21.15.8:0/1257537174 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59401f070 con 0x7ff5a40a16e0 2023-10-14T16:54:40.187 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.176+0000 7ff5927fc700 1 -- 172.21.15.8:0/1257537174 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594006af0 con 0x7ff5a40a16e0 2023-10-14T16:54:40.187 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.176+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/1257537174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a4098b20 con 0x7ff5a40a16e0 2023-10-14T16:54:40.187 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.176+0000 7ff5927fc700 1 -- 172.21.15.8:0/1257537174 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400bc00 con 0x7ff5a40a16e0 2023-10-14T16:54:40.187 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.176+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/1257537174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a4097790 con 0x7ff5a40a16e0 2023-10-14T16:54:40.188 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.176+0000 7ff5927fc700 1 -- 172.21.15.8:0/1257537174 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff5940118b0 con 0x7ff5a40a16e0 2023-10-14T16:54:40.188 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.176+0000 7ff5927fc700 1 -- 172.21.15.8:0/1257537174 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7ff594023920 con 0x7ff5a40a16e0 2023-10-14T16:54:40.188 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.176+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/1257537174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a404c3c0 con 0x7ff5a40a16e0 2023-10-14T16:54:40.188 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.181+0000 7ff5927fc700 1 -- 172.21.15.8:0/1257537174 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff594028070 con 0x7ff5a40a16e0 2023-10-14T16:54:40.253 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.252+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/1257537174 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5a4136ca0 con 0x7ff5a40a16e0 2023-10-14T16:54:40.253 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.253+0000 7ff5927fc700 1 -- 172.21.15.8:0/1257537174 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7ff594015020 con 0x7ff5a40a16e0 2023-10-14T16:54:40.254 INFO:teuthology.misc.health.smithi008.stdout: 2023-10-14T16:54:40.254 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":6,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:39.412080+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:54:40.257 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.254+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/1257537174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5a40a16e0 msgr2=0x7ff5a4130b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:40.258 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.254+0000 7ff5a8dd2700 1 --2- 172.21.15.8:0/1257537174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5a40a16e0 0x7ff5a4130b00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff594006fd0 tx=0x7ff594017000 comp rx=0 tx=0).stop 2023-10-14T16:54:40.258 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.254+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/1257537174 shutdown_connections 2023-10-14T16:54:40.258 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.254+0000 7ff5a8dd2700 1 --2- 172.21.15.8:0/1257537174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a41379d0 0x7ff5a4131040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:40.259 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.254+0000 7ff5a8dd2700 1 --2- 172.21.15.8:0/1257537174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5a4067af0 0x7ff5a41305c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:40.259 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.254+0000 7ff5a8dd2700 1 --2- 172.21.15.8:0/1257537174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5a40a16e0 0x7ff5a4130b00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:40.259 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.254+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/1257537174 >> 172.21.15.8:0/1257537174 conn(0x7ff5a40a68b0 msgr2=0x7ff5a4138210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:40.259 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.254+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/1257537174 shutdown_connections 2023-10-14T16:54:40.259 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:40.254+0000 7ff5a8dd2700 1 -- 172.21.15.8:0/1257537174 wait complete. 2023-10-14T16:54:40.260 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:40.256+0000 7fcea011d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T16:54:40.265 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-10-14T16:54:40.270 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:40.270+0000 7f3dfc5c8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T16:54:40.347 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:40.347+0000 7f3dfc5c8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T16:54:40.357 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:40.357+0000 7fcea011d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T16:54:40.530 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:40.530+0000 7f3dfc5c8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T16:54:40.704 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:40.704+0000 7f3dfc5c8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T16:54:40.780 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:40.781+0000 7f3dfc5c8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T16:54:40.898 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:40.897+0000 7fcea011d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T16:54:40.917 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:40.917+0000 7f3dfc5c8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T16:54:40.978 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:40.978+0000 7fcea011d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T16:54:41.011 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:41.011+0000 7f3dfc5c8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T16:54:41.059 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:41.058+0000 7fcea011d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T16:54:41.533 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:41.534+0000 7f3dfc5c8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T16:54:41.609 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:41.609+0000 7f3dfc5c8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T16:54:41.668 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:41.668+0000 7fcea011d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T16:54:41.688 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:41.688+0000 7f3dfc5c8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T16:54:41.812 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:41.812+0000 7fcea011d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T16:54:41.915 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:41.914+0000 7fcea011d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T16:54:42.172 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:42.171+0000 7fcea011d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T16:54:42.253 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:42.252+0000 7fcea011d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T16:54:42.267 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:42.267+0000 7f3dfc5c8180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T16:54:42.403 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:42.403+0000 7f3dfc5c8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T16:54:42.496 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:42.496+0000 7f3dfc5c8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T16:54:42.745 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:42.745+0000 7f3dfc5c8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T16:54:42.844 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:42.844+0000 7f3dfc5c8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T16:54:43.169 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:43.169+0000 7fcea011d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T16:54:43.246 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:43.245+0000 7fcea011d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T16:54:43.329 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:43.328+0000 7fcea011d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T16:54:43.468 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:43.467+0000 7fcea011d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T16:54:43.541 INFO:tasks.ceph.osd.3.smithi155.stderr:2023-10-14T16:54:43.539+0000 7fcd772f8540 -1 osd.3 0 log_to_monitors true 2023-10-14T16:54:43.542 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-10-14T16:54:43.539+0000 7fce98708540 -1 osd.2 0 log_to_monitors true 2023-10-14T16:54:43.542 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-10-14T16:54:43.540+0000 7f834a97e540 -1 osd.1 0 log_to_monitors true 2023-10-14T16:54:43.555 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-10-14T16:54:43.554+0000 7f90fc0e6540 -1 osd.0 0 log_to_monitors true 2023-10-14T16:54:43.564 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:43.563+0000 7fcea011d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T16:54:43.683 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:43.683+0000 7f3dfc5c8180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T16:54:43.723 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:43.722+0000 7fcea011d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T16:54:43.756 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:43.756+0000 7f3dfc5c8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T16:54:43.802 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:43.802+0000 7fcea011d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T16:54:43.829 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:43.830+0000 7f3dfc5c8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T16:54:43.882 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:43.881+0000 7fcea011d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T16:54:43.961 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:43.961+0000 7f3dfc5c8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T16:54:43.962 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:43.960+0000 7fcea011d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T16:54:44.048 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:44.049+0000 7f3dfc5c8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T16:54:44.200 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:44.200+0000 7f3dfc5c8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T16:54:44.275 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:44.275+0000 7f3dfc5c8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T16:54:44.348 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:44.349+0000 7f3dfc5c8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T16:54:44.422 INFO:tasks.ceph.mgr.y.smithi155.stderr:2023-10-14T16:54:44.422+0000 7f3dfc5c8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T16:54:44.474 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:44.477 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:44.479 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:45.047 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:45.047+0000 7fce5951b700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-14T16:54:45.054 INFO:tasks.ceph.mgr.x.smithi008.stderr:2023-10-14T16:54:45.053+0000 7fce5951b700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-14T16:54:45.698 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-10-14T16:54:45.698+0000 7f834159f700 -1 osd.1 0 waiting for initial osdmap 2023-10-14T16:54:45.701 INFO:tasks.ceph.osd.1.smithi008.stderr:2023-10-14T16:54:45.701+0000 7f833a396700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T16:54:45.706 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-10-14T16:54:45.706+0000 7f90f2d07700 -1 osd.0 0 waiting for initial osdmap 2023-10-14T16:54:45.710 INFO:tasks.ceph.osd.0.smithi008.stderr:2023-10-14T16:54:45.710+0000 7f90ebafe700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T16:54:46.105 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-10-14T16:54:46.103+0000 7fce90b2c700 -1 osd.2 0 waiting for initial osdmap 2023-10-14T16:54:46.107 INFO:tasks.ceph.osd.2.smithi155.stderr:2023-10-14T16:54:46.106+0000 7fce88120700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T16:54:46.145 INFO:tasks.ceph.osd.3.smithi155.stderr:2023-10-14T16:54:46.145+0000 7fcd6df19700 -1 osd.3 0 waiting for initial osdmap 2023-10-14T16:54:46.149 INFO:tasks.ceph.osd.3.smithi155.stderr:2023-10-14T16:54:46.148+0000 7fcd66d10700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T16:54:46.669 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T16:54:46.801 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.792+0000 7f0b4b83b700 1 Processor -- start 2023-10-14T16:54:46.801 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.793+0000 7f0b4b83b700 1 -- start start 2023-10-14T16:54:46.801 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.793+0000 7f0b4b83b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0b44068ab0 0x7f0b44137220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:46.802 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.793+0000 7f0b4b83b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b44137760 0x7f0b44133580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:46.802 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.793+0000 7f0b4b83b700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b44136f60 con 0x7f0b44133ac0 2023-10-14T16:54:46.802 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.793+0000 7f0b4b83b700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b440a2ad0 con 0x7f0b44068ab0 2023-10-14T16:54:46.802 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.793+0000 7f0b4b83b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b44069ad0 con 0x7f0b44137760 2023-10-14T16:54:46.803 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.793+0000 7f0b495d7700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0b44068ab0 0x7f0b44137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:46.803 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.793+0000 7f0b495d7700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0b44068ab0 0x7f0b44137220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47310/0 (socket says 172.21.15.8:47310) 2023-10-14T16:54:46.803 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.793+0000 7f0b49dd8700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0b44133ac0 0x7f0b44133eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47790/0 (socket says 172.21.15.8:47790) 2023-10-14T16:54:46.803 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.793+0000 7f0b495d7700 1 -- 172.21.15.8:0/3452814052 learned_addr learned my addr 172.21.15.8:0/3452814052 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:46.803 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.794+0000 7f0b48dd6700 1 --2- 172.21.15.8:0/3452814052 >> v2:172.21.15.155:3300/0 conn(0x7f0b44137760 0x7f0b44133580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:46.804 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.794+0000 7f0b495d7700 1 -- 172.21.15.8:0/3452814052 >> v2:172.21.15.155:3300/0 conn(0x7f0b44137760 msgr2=0x7f0b44133580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:46.804 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.794+0000 7f0b495d7700 1 --2- 172.21.15.8:0/3452814052 >> v2:172.21.15.155:3300/0 conn(0x7f0b44137760 0x7f0b44133580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:46.804 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.794+0000 7f0b495d7700 1 -- 172.21.15.8:0/3452814052 >> v1:172.21.15.8:6789/0 conn(0x7f0b44133ac0 legacy=0x7f0b44133eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:46.804 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.794+0000 7f0b495d7700 1 -- 172.21.15.8:0/3452814052 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4406edb0 con 0x7f0b44068ab0 2023-10-14T16:54:46.804 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.794+0000 7f0b43fff700 1 -- 172.21.15.8:0/3452814052 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255487896 0 0) 0x7f0b44136f60 con 0x7f0b44133ac0 2023-10-14T16:54:46.805 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.794+0000 7f0b48dd6700 1 --2- 172.21.15.8:0/3452814052 >> v2:172.21.15.155:3300/0 conn(0x7f0b44137760 0x7f0b44133580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:54:46.805 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.794+0000 7f0b495d7700 1 --2- 172.21.15.8:0/3452814052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b44068ab0 0x7f0b44137220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0b44070fa0 tx=0x7f0b34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1761285379b8bc45 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:46.805 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.794+0000 7f0b43fff700 1 -- 172.21.15.8:0/3452814052 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3400e070 con 0x7f0b44068ab0 2023-10-14T16:54:46.805 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.794+0000 7f0b43fff700 1 -- 172.21.15.8:0/3452814052 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3400ba50 con 0x7f0b44068ab0 2023-10-14T16:54:46.805 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.794+0000 7f0b43fff700 1 -- 172.21.15.8:0/3452814052 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b340092e0 con 0x7f0b44068ab0 2023-10-14T16:54:46.806 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.795+0000 7f0b4b83b700 1 -- 172.21.15.8:0/3452814052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b44068ab0 msgr2=0x7f0b44137220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:46.806 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.795+0000 7f0b4b83b700 1 --2- 172.21.15.8:0/3452814052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b44068ab0 0x7f0b44137220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0b44070fa0 tx=0x7f0b34009840 comp rx=0 tx=0).stop 2023-10-14T16:54:46.806 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.795+0000 7f0b4b83b700 1 -- 172.21.15.8:0/3452814052 shutdown_connections 2023-10-14T16:54:46.806 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.795+0000 7f0b4b83b700 1 --2- 172.21.15.8:0/3452814052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b44068ab0 0x7f0b44137220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:46.807 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.795+0000 7f0b4b83b700 1 --2- 172.21.15.8:0/3452814052 >> v2:172.21.15.155:3300/0 conn(0x7f0b44137760 0x7f0b44133580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:46.807 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.795+0000 7f0b4b83b700 1 -- 172.21.15.8:0/3452814052 >> 172.21.15.8:0/3452814052 conn(0x7f0b440a6bb0 msgr2=0x7f0b440a6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:46.807 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.795+0000 7f0b4b83b700 1 -- 172.21.15.8:0/3452814052 shutdown_connections 2023-10-14T16:54:46.807 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.795+0000 7f0b4b83b700 1 -- 172.21.15.8:0/3452814052 wait complete. 2023-10-14T16:54:46.807 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.796+0000 7f0b4b83b700 1 Processor -- start 2023-10-14T16:54:46.808 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.796+0000 7f0b4b83b700 1 -- start start 2023-10-14T16:54:46.808 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b4b83b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b44068ab0 0x7f0b4411d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:46.808 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b4b83b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b44133ac0 0x7f0b44142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:46.808 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b4b83b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b44137760 0x7f0b44143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:46.808 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b4b83b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4411ea40 con 0x7f0b44068ab0 2023-10-14T16:54:46.809 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b4b83b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4411de60 con 0x7f0b44133ac0 2023-10-14T16:54:46.809 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b4b83b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4411e420 con 0x7f0b44137760 2023-10-14T16:54:46.809 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b495d7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b44068ab0 0x7f0b4411d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:46.809 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b495d7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b44068ab0 0x7f0b4411d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47324/0 (socket says 172.21.15.8:47324) 2023-10-14T16:54:46.809 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b495d7700 1 -- 172.21.15.8:0/4095076045 learned_addr learned my addr 172.21.15.8:0/4095076045 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:46.810 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b48dd6700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b44133ac0 0x7f0b44142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:46.810 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b49dd8700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b44137760 0x7f0b44143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:46.810 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b495d7700 1 -- 172.21.15.8:0/4095076045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b44137760 msgr2=0x7f0b44143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:46.810 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b495d7700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b44137760 0x7f0b44143260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:46.810 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b495d7700 1 -- 172.21.15.8:0/4095076045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b44133ac0 msgr2=0x7f0b44142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:46.811 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b495d7700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b44133ac0 0x7f0b44142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:46.811 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b495d7700 1 -- 172.21.15.8:0/4095076045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b34009ae0 con 0x7f0b44068ab0 2023-10-14T16:54:46.811 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.797+0000 7f0b495d7700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b44068ab0 0x7f0b4411d210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009ab0 tx=0x7f0b34018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:46.811 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.798+0000 7f0b417fa700 1 -- 172.21.15.8:0/4095076045 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b340078f0 con 0x7f0b44068ab0 2023-10-14T16:54:46.811 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.798+0000 7f0b417fa700 1 -- 172.21.15.8:0/4095076045 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b34007a50 con 0x7f0b44068ab0 2023-10-14T16:54:46.812 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.798+0000 7f0b4b83b700 1 -- 172.21.15.8:0/4095076045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4411e6e0 con 0x7f0b44068ab0 2023-10-14T16:54:46.812 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.798+0000 7f0b417fa700 1 -- 172.21.15.8:0/4095076045 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34007e10 con 0x7f0b44068ab0 2023-10-14T16:54:46.812 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.798+0000 7f0b4b83b700 1 -- 172.21.15.8:0/4095076045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4411db80 con 0x7f0b44068ab0 2023-10-14T16:54:46.812 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.799+0000 7f0b4b83b700 1 -- 172.21.15.8:0/4095076045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4409f520 con 0x7f0b44068ab0 2023-10-14T16:54:46.812 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.799+0000 7f0b417fa700 1 -- 172.21.15.8:0/4095076045 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 3) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f0b34003040 con 0x7f0b44068ab0 2023-10-14T16:54:46.813 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.799+0000 7f0b417fa700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0b30066d80 0x7f0b30069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:46.813 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.799+0000 7f0b417fa700 1 -- 172.21.15.8:0/4095076045 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2739+0+0 (secure 0 0 0) 0x7f0b34085080 con 0x7f0b44068ab0 2023-10-14T16:54:46.813 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.799+0000 7f0b48dd6700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0b30066d80 0x7f0b30069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:46.813 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.800+0000 7f0b48dd6700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0b30066d80 0x7f0b30069230 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0b440694f0 tx=0x7f0b38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:46.814 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.804+0000 7f0b417fa700 1 -- 172.21.15.8:0/4095076045 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b34053130 con 0x7f0b44068ab0 2023-10-14T16:54:46.932 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:46.931+0000 7f0b417fa700 1 -- 172.21.15.8:0/4095076045 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f0b34053500 con 0x7f0b44068ab0 2023-10-14T16:54:47.001 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.000+0000 7f0b4b83b700 1 -- 172.21.15.8:0/4095076045 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b4404c3c0 con 0x7f0b44068ab0 2023-10-14T16:54:47.001 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.001+0000 7f0b417fa700 1 -- 172.21.15.8:0/4095076045 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+5783 (secure 0 0 0) 0x7f0b34056bc0 con 0x7f0b44068ab0 2023-10-14T16:54:47.002 INFO:teuthology.misc.health.smithi008.stdout: 2023-10-14T16:54:47.002 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":9,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:46.708519+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:54:47.004 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.003+0000 7f0b4b83b700 1 -- 172.21.15.8:0/4095076045 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0b30066d80 msgr2=0x7f0b30069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:47.004 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.003+0000 7f0b4b83b700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0b30066d80 0x7f0b30069230 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0b440694f0 tx=0x7f0b38008040 comp rx=0 tx=0).stop 2023-10-14T16:54:47.004 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.003+0000 7f0b4b83b700 1 -- 172.21.15.8:0/4095076045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b44068ab0 msgr2=0x7f0b4411d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:47.004 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.003+0000 7f0b4b83b700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b44068ab0 0x7f0b4411d210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009ab0 tx=0x7f0b34018000 comp rx=0 tx=0).stop 2023-10-14T16:54:47.005 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.003+0000 7f0b4b83b700 1 -- 172.21.15.8:0/4095076045 shutdown_connections 2023-10-14T16:54:47.005 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.003+0000 7f0b4b83b700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0b30066d80 0x7f0b30069230 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:47.005 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.003+0000 7f0b4b83b700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b44137760 0x7f0b44143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:47.005 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.003+0000 7f0b4b83b700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b44068ab0 0x7f0b4411d210 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:47.005 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.003+0000 7f0b4b83b700 1 --2- 172.21.15.8:0/4095076045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b44133ac0 0x7f0b44142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:47.006 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.003+0000 7f0b4b83b700 1 -- 172.21.15.8:0/4095076045 >> 172.21.15.8:0/4095076045 conn(0x7f0b440a6bb0 msgr2=0x7f0b4406e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:47.006 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.003+0000 7f0b4b83b700 1 -- 172.21.15.8:0/4095076045 shutdown_connections 2023-10-14T16:54:47.006 INFO:teuthology.misc.health.smithi008.stderr:2023-10-14T16:54:47.003+0000 7f0b4b83b700 1 -- 172.21.15.8:0/4095076045 wait complete. 2023-10-14T16:54:47.014 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-10-14T16:54:47.015 INFO:tasks.ceph:Creating RBD pool 2023-10-14T16:54:47.015 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-14T16:54:47.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.132+0000 7f2030942700 1 Processor -- start 2023-10-14T16:54:47.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.132+0000 7f2030942700 1 -- start start 2023-10-14T16:54:47.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.133+0000 7f2030942700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f202c1343f0 0x7f202c13c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:47.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.133+0000 7f2030942700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c0a29c0 con 0x7f202c13c5d0 2023-10-14T16:54:47.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.133+0000 7f2030942700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c133890 con 0x7f202c0a9fe0 2023-10-14T16:54:47.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.133+0000 7f2030942700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c0a1be0 con 0x7f202c1343f0 2023-10-14T16:54:47.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.133+0000 7f202ad9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f202c13c5d0 0x7f202c13e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:47794/0 (socket says 172.21.15.8:47794) 2023-10-14T16:54:47.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.133+0000 7f202ad9d700 1 -- 172.21.15.8:0/3750876758 learned_addr learned my addr 172.21.15.8:0/3750876758 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:47.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.133+0000 7f2029d9b700 1 --2- 172.21.15.8:0/3750876758 >> v2:172.21.15.155:3300/0 conn(0x7f202c1343f0 0x7f202c13c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:47.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.133+0000 7f202959a700 1 -- 172.21.15.8:0/3750876758 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610771735 0 0) 0x7f202c0a29c0 con 0x7f202c13c5d0 2023-10-14T16:54:47.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.133+0000 7f202959a700 1 -- 172.21.15.8:0/3750876758 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2018003570 con 0x7f202c13c5d0 2023-10-14T16:54:47.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.133+0000 7f2029d9b700 1 -- 172.21.15.8:0/3750876758 >> v1:172.21.15.155:6789/0 conn(0x7f202c0a9fe0 legacy=0x7f202c133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:47.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.133+0000 7f2029d9b700 1 -- 172.21.15.8:0/3750876758 >> v1:172.21.15.8:6789/0 conn(0x7f202c13c5d0 legacy=0x7f202c13e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:47.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.133+0000 7f2029d9b700 1 -- 172.21.15.8:0/3750876758 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c0a1e10 con 0x7f202c1343f0 2023-10-14T16:54:47.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.134+0000 7f2029d9b700 1 --2- 172.21.15.8:0/3750876758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f202c1343f0 0x7f202c13c090 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f20140098e0 tx=0x7f20140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e309ddbdad6ff47 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:47.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.134+0000 7f202959a700 1 -- 172.21.15.8:0/3750876758 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201400b640 con 0x7f202c1343f0 2023-10-14T16:54:47.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.134+0000 7f202959a700 1 -- 172.21.15.8:0/3750876758 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201400b7a0 con 0x7f202c1343f0 2023-10-14T16:54:47.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.134+0000 7f202959a700 1 -- 172.21.15.8:0/3750876758 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201400bb40 con 0x7f202c1343f0 2023-10-14T16:54:47.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.134+0000 7f2030942700 1 -- 172.21.15.8:0/3750876758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f202c1343f0 msgr2=0x7f202c13c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:47.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.134+0000 7f2030942700 1 --2- 172.21.15.8:0/3750876758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f202c1343f0 0x7f202c13c090 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f20140098e0 tx=0x7f20140091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:47.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.134+0000 7f2030942700 1 -- 172.21.15.8:0/3750876758 shutdown_connections 2023-10-14T16:54:47.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.134+0000 7f2030942700 1 --2- 172.21.15.8:0/3750876758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f202c1343f0 0x7f202c13c090 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:47.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.134+0000 7f2030942700 1 -- 172.21.15.8:0/3750876758 >> 172.21.15.8:0/3750876758 conn(0x7f202c06ab20 msgr2=0x7f202c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:47.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.134+0000 7f2030942700 1 -- 172.21.15.8:0/3750876758 shutdown_connections 2023-10-14T16:54:47.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.134+0000 7f2030942700 1 -- 172.21.15.8:0/3750876758 wait complete. 2023-10-14T16:54:47.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.135+0000 7f2030942700 1 Processor -- start 2023-10-14T16:54:47.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.135+0000 7f2030942700 1 -- start start 2023-10-14T16:54:47.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f2030942700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f202c1343f0 0x7f202c146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:47.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f2030942700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f202c13c5d0 0x7f202c146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:47.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f2030942700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c1474c0 0x7f202c139fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:47.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f2030942700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c096470 con 0x7f202c1474c0 2023-10-14T16:54:47.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f2030942700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c097480 con 0x7f202c13c5d0 2023-10-14T16:54:47.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f2030942700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0978e0 con 0x7f202c1343f0 2023-10-14T16:54:47.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f202ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c1474c0 0x7f202c139fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:47.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f202ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c1474c0 0x7f202c139fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47332/0 (socket says 172.21.15.8:47332) 2023-10-14T16:54:47.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f202ad9d700 1 -- 172.21.15.8:0/2619995305 learned_addr learned my addr 172.21.15.8:0/2619995305 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:47.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f2029d9b700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f202c13c5d0 0x7f202c146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:47.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f202a59c700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f202c1343f0 0x7f202c146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:47.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f202ad9d700 1 -- 172.21.15.8:0/2619995305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f202c1343f0 msgr2=0x7f202c146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:47.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f202ad9d700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f202c1343f0 0x7f202c146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:47.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f202ad9d700 1 -- 172.21.15.8:0/2619995305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f202c13c5d0 msgr2=0x7f202c146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:47.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f202ad9d700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f202c13c5d0 0x7f202c146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:47.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f202ad9d700 1 -- 172.21.15.8:0/2619995305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014009420 con 0x7f202c1474c0 2023-10-14T16:54:47.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f202ad9d700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c1474c0 0x7f202c139fe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f201c001460 tx=0x7f201c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:47.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f20227fc700 1 -- 172.21.15.8:0/2619995305 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c00a950 con 0x7f202c1474c0 2023-10-14T16:54:47.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f20227fc700 1 -- 172.21.15.8:0/2619995305 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c00aab0 con 0x7f202c1474c0 2023-10-14T16:54:47.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f20227fc700 1 -- 172.21.15.8:0/2619995305 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c00ae30 con 0x7f202c1474c0 2023-10-14T16:54:47.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f2030942700 1 -- 172.21.15.8:0/2619995305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c0a65c0 con 0x7f202c1474c0 2023-10-14T16:54:47.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.136+0000 7f2030942700 1 -- 172.21.15.8:0/2619995305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c13bc70 con 0x7f202c1474c0 2023-10-14T16:54:47.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.137+0000 7f2030942700 1 -- 172.21.15.8:0/2619995305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c097720 con 0x7f202c1474c0 2023-10-14T16:54:47.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.138+0000 7f20227fc700 1 -- 172.21.15.8:0/2619995305 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f201c007300 con 0x7f202c1474c0 2023-10-14T16:54:47.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.138+0000 7f20227fc700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f200c066ea0 0x7f200c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:47.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.138+0000 7f20227fc700 1 -- 172.21.15.8:0/2619995305 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2739+0+0 (secure 0 0 0) 0x7f201c083d30 con 0x7f202c1474c0 2023-10-14T16:54:47.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.138+0000 7f202a59c700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f200c066ea0 0x7f200c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:47.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.139+0000 7f202a59c700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f200c066ea0 0x7f200c069350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2024003860 tx=0x7f2024009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:47.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.142+0000 7f20227fc700 1 -- 172.21.15.8:0/2619995305 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f201c088070 con 0x7f202c1474c0 2023-10-14T16:54:47.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:47.334+0000 7f2030942700 1 -- 172.21.15.8:0/2619995305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f202c06aef0 con 0x7f202c1474c0 2023-10-14T16:54:48.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.058+0000 7f20227fc700 1 -- 172.21.15.8:0/2619995305 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7f201c051c10 con 0x7f202c1474c0 2023-10-14T16:54:48.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.062+0000 7f2030942700 1 -- 172.21.15.8:0/2619995305 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f200c066ea0 msgr2=0x7f200c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:48.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.062+0000 7f2030942700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f200c066ea0 0x7f200c069350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2024003860 tx=0x7f2024009040 comp rx=0 tx=0).stop 2023-10-14T16:54:48.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.062+0000 7f2030942700 1 -- 172.21.15.8:0/2619995305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c1474c0 msgr2=0x7f202c139fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:48.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.062+0000 7f2030942700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c1474c0 0x7f202c139fe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f201c001460 tx=0x7f201c001a40 comp rx=0 tx=0).stop 2023-10-14T16:54:48.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.062+0000 7f2030942700 1 -- 172.21.15.8:0/2619995305 shutdown_connections 2023-10-14T16:54:48.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.062+0000 7f2030942700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f200c066ea0 0x7f200c069350 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:48.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.062+0000 7f2030942700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f202c1474c0 0x7f202c139fe0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:48.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.062+0000 7f2030942700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f202c1343f0 0x7f202c146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:48.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.062+0000 7f2030942700 1 --2- 172.21.15.8:0/2619995305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f202c13c5d0 0x7f202c146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:48.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.062+0000 7f2030942700 1 -- 172.21.15.8:0/2619995305 >> 172.21.15.8:0/2619995305 conn(0x7f202c06ab20 msgr2=0x7f202c1348f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:48.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.062+0000 7f2030942700 1 -- 172.21.15.8:0/2619995305 shutdown_connections 2023-10-14T16:54:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.062+0000 7f2030942700 1 -- 172.21.15.8:0/2619995305 wait complete. 2023-10-14T16:54:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'rbd' created 2023-10-14T16:54:48.079 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-14T16:54:48.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.206+0000 7f3485953700 1 Processor -- start 2023-10-14T16:54:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.206+0000 7f3485953700 1 -- start start 2023-10-14T16:54:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.206+0000 7f3485953700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f348012ee90 0x7f3480139c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.206+0000 7f3485953700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34800a1ad0 0x7f348013c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.206+0000 7f3485953700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34800a20a0 con 0x7f34800a2730 2023-10-14T16:54:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.206+0000 7f3485953700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348006ce50 con 0x7f348012ee90 2023-10-14T16:54:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.206+0000 7f3485953700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348006d620 con 0x7f34800a1ad0 2023-10-14T16:54:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.206+0000 7f347e7fc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f348012ee90 0x7f3480139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.206+0000 7f347effd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f34800a2730 0x7f348012e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41518/0 (socket says 172.21.15.8:41518) 2023-10-14T16:54:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.206+0000 7f347effd700 1 -- 172.21.15.8:0/2975645367 learned_addr learned my addr 172.21.15.8:0/2975645367 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.207+0000 7f347f7fe700 1 --2- 172.21.15.8:0/2975645367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34800a1ad0 0x7f348013c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.207+0000 7f347e7fc700 1 -- 172.21.15.8:0/2975645367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34800a1ad0 msgr2=0x7f348013c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.207+0000 7f347e7fc700 1 --2- 172.21.15.8:0/2975645367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34800a1ad0 0x7f348013c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:48.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.207+0000 7f347e7fc700 1 -- 172.21.15.8:0/2975645367 >> v1:172.21.15.8:6789/0 conn(0x7f34800a2730 legacy=0x7f348012e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:48.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.207+0000 7f347e7fc700 1 -- 172.21.15.8:0/2975645367 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348006d040 con 0x7f348012ee90 2023-10-14T16:54:48.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.207+0000 7f347dffb700 1 -- 172.21.15.8:0/2975645367 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242663833 0 0) 0x7f34800a20a0 con 0x7f34800a2730 2023-10-14T16:54:48.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.207+0000 7f347e7fc700 1 --2- 172.21.15.8:0/2975645367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348012ee90 0x7f3480139c90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f34680098e0 tx=0x7f34680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de80e63e472bbd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:48.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.207+0000 7f347dffb700 1 -- 172.21.15.8:0/2975645367 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468009e80 con 0x7f348012ee90 2023-10-14T16:54:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.207+0000 7f347dffb700 1 -- 172.21.15.8:0/2975645367 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346800b860 con 0x7f348012ee90 2023-10-14T16:54:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.207+0000 7f347dffb700 1 -- 172.21.15.8:0/2975645367 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346800bbe0 con 0x7f348012ee90 2023-10-14T16:54:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.208+0000 7f3485953700 1 -- 172.21.15.8:0/2975645367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348012ee90 msgr2=0x7f3480139c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.208+0000 7f3485953700 1 --2- 172.21.15.8:0/2975645367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348012ee90 0x7f3480139c90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f34680098e0 tx=0x7f34680091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.208+0000 7f3485953700 1 -- 172.21.15.8:0/2975645367 shutdown_connections 2023-10-14T16:54:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.208+0000 7f3485953700 1 --2- 172.21.15.8:0/2975645367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34800a1ad0 0x7f348013c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.208+0000 7f3485953700 1 --2- 172.21.15.8:0/2975645367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348012ee90 0x7f3480139c90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.208+0000 7f3485953700 1 -- 172.21.15.8:0/2975645367 >> 172.21.15.8:0/2975645367 conn(0x7f34800701c0 msgr2=0x7f34800705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.208+0000 7f3485953700 1 -- 172.21.15.8:0/2975645367 shutdown_connections 2023-10-14T16:54:48.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.208+0000 7f3485953700 1 -- 172.21.15.8:0/2975645367 wait complete. 2023-10-14T16:54:48.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.209+0000 7f3485953700 1 Processor -- start 2023-10-14T16:54:48.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.209+0000 7f3485953700 1 -- start start 2023-10-14T16:54:48.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.209+0000 7f3485953700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34800a1ad0 0x7f3480099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:48.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.209+0000 7f3485953700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348012ee90 0x7f3480144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:48.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.209+0000 7f3485953700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3480144db0 0x7f3480140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:48.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.209+0000 7f3485953700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3480145250 con 0x7f348012ee90 2023-10-14T16:54:48.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.209+0000 7f3485953700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348009a5b0 con 0x7f3480144db0 2023-10-14T16:54:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.209+0000 7f3485953700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348009aae0 con 0x7f34800a1ad0 2023-10-14T16:54:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.209+0000 7f347e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348012ee90 0x7f3480144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.209+0000 7f347e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348012ee90 0x7f3480144870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58412/0 (socket says 172.21.15.8:58412) 2023-10-14T16:54:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.209+0000 7f347e7fc700 1 -- 172.21.15.8:0/4157771137 learned_addr learned my addr 172.21.15.8:0/4157771137 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f347effd700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34800a1ad0 0x7f3480099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f347f7fe700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3480144db0 0x7f3480140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f347e7fc700 1 -- 172.21.15.8:0/4157771137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34800a1ad0 msgr2=0x7f3480099520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f347e7fc700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34800a1ad0 0x7f3480099520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f347e7fc700 1 -- 172.21.15.8:0/4157771137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3480144db0 msgr2=0x7f3480140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f347e7fc700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3480144db0 0x7f3480140d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f347e7fc700 1 -- 172.21.15.8:0/4157771137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3468009420 con 0x7f348012ee90 2023-10-14T16:54:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f347effd700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34800a1ad0 0x7f3480099520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:54:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f347e7fc700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348012ee90 0x7f3480144870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f348006a4f0 tx=0x7f3468017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:48.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f3476ffd700 1 -- 172.21.15.8:0/4157771137 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346800bbe0 con 0x7f348012ee90 2023-10-14T16:54:48.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f3476ffd700 1 -- 172.21.15.8:0/4157771137 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3468011420 con 0x7f348012ee90 2023-10-14T16:54:48.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f3485953700 1 -- 172.21.15.8:0/4157771137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3480144310 con 0x7f348012ee90 2023-10-14T16:54:48.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f3476ffd700 1 -- 172.21.15.8:0/4157771137 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34680117e0 con 0x7f348012ee90 2023-10-14T16:54:48.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.210+0000 7f3485953700 1 -- 172.21.15.8:0/4157771137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3480099060 con 0x7f348012ee90 2023-10-14T16:54:48.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.211+0000 7f3485953700 1 -- 172.21.15.8:0/4157771137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3480071420 con 0x7f348012ee90 2023-10-14T16:54:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.211+0000 7f3476ffd700 1 -- 172.21.15.8:0/4157771137 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f3468011bd0 con 0x7f348012ee90 2023-10-14T16:54:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.212+0000 7f3476ffd700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3460066ed0 0x7f3460069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.212+0000 7f3476ffd700 1 -- 172.21.15.8:0/4157771137 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 3456+0+0 (secure 0 0 0) 0x7f3468084b80 con 0x7f348012ee90 2023-10-14T16:54:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.212+0000 7f347effd700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3460066ed0 0x7f3460069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:48.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.212+0000 7f347effd700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3460066ed0 0x7f3460069380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f34780011e0 tx=0x7f3478009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:48.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.217+0000 7f3476ffd700 1 -- 172.21.15.8:0/4157771137 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34680527a0 con 0x7f348012ee90 2023-10-14T16:54:48.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:48.411+0000 7f3485953700 1 -- 172.21.15.8:0/4157771137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f348006d8e0 con 0x7f348012ee90 2023-10-14T16:54:49.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.059+0000 7f3476ffd700 1 -- 172.21.15.8:0/4157771137 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3468028020 con 0x7f348012ee90 2023-10-14T16:54:49.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.063+0000 7f3485953700 1 -- 172.21.15.8:0/4157771137 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3460066ed0 msgr2=0x7f3460069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.063+0000 7f3485953700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3460066ed0 0x7f3460069380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f34780011e0 tx=0x7f3478009040 comp rx=0 tx=0).stop 2023-10-14T16:54:49.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.063+0000 7f3485953700 1 -- 172.21.15.8:0/4157771137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348012ee90 msgr2=0x7f3480144870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.063+0000 7f3485953700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348012ee90 0x7f3480144870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f348006a4f0 tx=0x7f3468017000 comp rx=0 tx=0).stop 2023-10-14T16:54:49.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.063+0000 7f3485953700 1 -- 172.21.15.8:0/4157771137 shutdown_connections 2023-10-14T16:54:49.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.063+0000 7f3485953700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3460066ed0 0x7f3460069380 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.063+0000 7f3485953700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3480144db0 0x7f3480140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.063+0000 7f3485953700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34800a1ad0 0x7f3480099520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.063+0000 7f3485953700 1 --2- 172.21.15.8:0/4157771137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f348012ee90 0x7f3480144870 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.063+0000 7f3485953700 1 -- 172.21.15.8:0/4157771137 >> 172.21.15.8:0/4157771137 conn(0x7f34800701c0 msgr2=0x7f348012d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.063+0000 7f3485953700 1 -- 172.21.15.8:0/4157771137 shutdown_connections 2023-10-14T16:54:49.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.063+0000 7f3485953700 1 -- 172.21.15.8:0/4157771137 wait complete. 2023-10-14T16:54:49.069 INFO:teuthology.orchestra.run.smithi008.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-14T16:54:49.080 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T16:54:49.080 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T16:54:49.081 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T16:54:49.083 INFO:tasks.ceph.mds.a:Started 2023-10-14T16:54:49.083 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T16:54:49.084 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T16:54:49.087 INFO:tasks.ceph.mds.b:Started 2023-10-14T16:54:49.088 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-14T16:54:49.089 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T16:54:49.169 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-10-14T16:54:49.170 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2023-10-14T16:54:49.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.227+0000 7f976cf67700 1 Processor -- start 2023-10-14T16:54:49.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.227+0000 7f976cf67700 1 -- start start 2023-10-14T16:54:49.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f976cf67700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9768069390 0x7f976813bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f976cf67700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f976813c410 0x7f976813e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f976cf67700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9768136be0 con 0x7f97680a4970 2023-10-14T16:54:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f976cf67700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9768069ac0 con 0x7f976813c410 2023-10-14T16:54:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f976cf67700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9768137a30 con 0x7f9768069390 2023-10-14T16:54:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f9766d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f976813c410 0x7f976813e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f9766d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f976813c410 0x7f976813e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58460/0 (socket says 172.21.15.8:58460) 2023-10-14T16:54:49.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f9766d9d700 1 -- 172.21.15.8:0/1511346260 learned_addr learned my addr 172.21.15.8:0/1511346260 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:49.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f976659c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f97680a4970 0x7f9768137320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41540/0 (socket says 172.21.15.8:41540) 2023-10-14T16:54:49.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f9765d9b700 1 --2- 172.21.15.8:0/1511346260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9768069390 0x7f976813bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f9766d9d700 1 -- 172.21.15.8:0/1511346260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9768069390 msgr2=0x7f976813bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:49.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f9766d9d700 1 --2- 172.21.15.8:0/1511346260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9768069390 0x7f976813bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f9766d9d700 1 -- 172.21.15.8:0/1511346260 >> v1:172.21.15.8:6789/0 conn(0x7f97680a4970 legacy=0x7f9768137320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f9766d9d700 1 -- 172.21.15.8:0/1511346260 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680a42d0 con 0x7f976813c410 2023-10-14T16:54:49.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f976559a700 1 -- 172.21.15.8:0/1511346260 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350057981 0 0) 0x7f9768136be0 con 0x7f97680a4970 2023-10-14T16:54:49.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.228+0000 7f9766d9d700 1 --2- 172.21.15.8:0/1511346260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f976813c410 0x7f976813e7f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9760009f20 tx=0x7f9760009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d75cfabad542020 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:49.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.229+0000 7f976559a700 1 -- 172.21.15.8:0/1511346260 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976000e070 con 0x7f976813c410 2023-10-14T16:54:49.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.229+0000 7f976559a700 1 -- 172.21.15.8:0/1511346260 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976000b9d0 con 0x7f976813c410 2023-10-14T16:54:49.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.229+0000 7f976559a700 1 -- 172.21.15.8:0/1511346260 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600092e0 con 0x7f976813c410 2023-10-14T16:54:49.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.229+0000 7f976cf67700 1 -- 172.21.15.8:0/1511346260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f976813c410 msgr2=0x7f976813e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.229+0000 7f976cf67700 1 --2- 172.21.15.8:0/1511346260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f976813c410 0x7f976813e7f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9760009f20 tx=0x7f9760009840 comp rx=0 tx=0).stop 2023-10-14T16:54:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.229+0000 7f976cf67700 1 -- 172.21.15.8:0/1511346260 shutdown_connections 2023-10-14T16:54:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.229+0000 7f976cf67700 1 --2- 172.21.15.8:0/1511346260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f976813c410 0x7f976813e7f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.229+0000 7f976cf67700 1 --2- 172.21.15.8:0/1511346260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9768069390 0x7f976813bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.229+0000 7f976cf67700 1 -- 172.21.15.8:0/1511346260 >> 172.21.15.8:0/1511346260 conn(0x7f976806f840 msgr2=0x7f97680701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.229+0000 7f976cf67700 1 -- 172.21.15.8:0/1511346260 shutdown_connections 2023-10-14T16:54:49.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.229+0000 7f976cf67700 1 -- 172.21.15.8:0/1511346260 wait complete. 2023-10-14T16:54:49.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.230+0000 7f976cf67700 1 Processor -- start 2023-10-14T16:54:49.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.230+0000 7f976cf67700 1 -- start start 2023-10-14T16:54:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f976cf67700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9768069390 0x7f9768138c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f976cf67700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f976813c410 0x7f9768139190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f976cf67700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f976809b610 0x7f97681396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f976cf67700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976809afe0 con 0x7f976813c410 2023-10-14T16:54:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f976cf67700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680a8da0 con 0x7f976809b610 2023-10-14T16:54:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f976cf67700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976809a120 con 0x7f9768069390 2023-10-14T16:54:49.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f9765d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f976813c410 0x7f9768139190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f9765d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f976813c410 0x7f9768139190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58468/0 (socket says 172.21.15.8:58468) 2023-10-14T16:54:49.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f9765d9b700 1 -- 172.21.15.8:0/3154100494 learned_addr learned my addr 172.21.15.8:0/3154100494 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:49.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f9766d9d700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f976809b610 0x7f97681396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f976659c700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9768069390 0x7f9768138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f9765d9b700 1 -- 172.21.15.8:0/3154100494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9768069390 msgr2=0x7f9768138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f9765d9b700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9768069390 0x7f9768138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f9765d9b700 1 -- 172.21.15.8:0/3154100494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f976809b610 msgr2=0x7f97681396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f9765d9b700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f976809b610 0x7f97681396d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f9765d9b700 1 -- 172.21.15.8:0/3154100494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760009ae0 con 0x7f976813c410 2023-10-14T16:54:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f9765d9b700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f976813c410 0x7f9768139190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f975800ece0 tx=0x7f97580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f97567fc700 1 -- 172.21.15.8:0/3154100494 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975800c850 con 0x7f976813c410 2023-10-14T16:54:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f97567fc700 1 -- 172.21.15.8:0/3154100494 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975800c9b0 con 0x7f976813c410 2023-10-14T16:54:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f976cf67700 1 -- 172.21.15.8:0/3154100494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97680a3fa0 con 0x7f976813c410 2023-10-14T16:54:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f97567fc700 1 -- 172.21.15.8:0/3154100494 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975800cd50 con 0x7f976813c410 2023-10-14T16:54:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.231+0000 7f976cf67700 1 -- 172.21.15.8:0/3154100494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976809a350 con 0x7f976813c410 2023-10-14T16:54:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.232+0000 7f976cf67700 1 -- 172.21.15.8:0/3154100494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97680708d0 con 0x7f976813c410 2023-10-14T16:54:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.233+0000 7f97567fc700 1 -- 172.21.15.8:0/3154100494 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f9758013680 con 0x7f976813c410 2023-10-14T16:54:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.233+0000 7f97567fc700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9748066ea0 0x7f9748069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.233+0000 7f97567fc700 1 -- 172.21.15.8:0/3154100494 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f9758083d90 con 0x7f976813c410 2023-10-14T16:54:49.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.233+0000 7f976659c700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9748066ea0 0x7f9748069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.234+0000 7f976659c700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9748066ea0 0x7f9748069350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f975c007fd0 tx=0x7f975c007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:49.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.237+0000 7f97567fc700 1 -- 172.21.15.8:0/3154100494 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9758087030 con 0x7f976813c410 2023-10-14T16:54:49.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.437+0000 7f976cf67700 1 -- 172.21.15.8:0/3154100494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9768136e30 con 0x7f976813c410 2023-10-14T16:54:49.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.438+0000 7f97567fc700 1 -- 172.21.15.8:0/3154100494 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8967 (secure 0 0 0) 0x7f9758051990 con 0x7f976813c410 2023-10-14T16:54:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:49.439 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":11,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:49.057096+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:54:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.440+0000 7f976cf67700 1 -- 172.21.15.8:0/3154100494 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9748066ea0 msgr2=0x7f9748069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.440+0000 7f976cf67700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9748066ea0 0x7f9748069350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f975c007fd0 tx=0x7f975c007d50 comp rx=0 tx=0).stop 2023-10-14T16:54:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.440+0000 7f976cf67700 1 -- 172.21.15.8:0/3154100494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f976813c410 msgr2=0x7f9768139190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.440+0000 7f976cf67700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f976813c410 0x7f9768139190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f975800ece0 tx=0x7f97580091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.440+0000 7f976cf67700 1 -- 172.21.15.8:0/3154100494 shutdown_connections 2023-10-14T16:54:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.440+0000 7f976cf67700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9748066ea0 0x7f9748069350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.440+0000 7f976cf67700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f976809b610 0x7f97681396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.440+0000 7f976cf67700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9768069390 0x7f9768138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.440+0000 7f976cf67700 1 --2- 172.21.15.8:0/3154100494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f976813c410 0x7f9768139190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.440+0000 7f976cf67700 1 -- 172.21.15.8:0/3154100494 >> 172.21.15.8:0/3154100494 conn(0x7f976806f840 msgr2=0x7f97680a6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:49.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.440+0000 7f976cf67700 1 -- 172.21.15.8:0/3154100494 shutdown_connections 2023-10-14T16:54:49.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.440+0000 7f976cf67700 1 -- 172.21.15.8:0/3154100494 wait complete. 2023-10-14T16:54:49.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-14T16:54:47.365008+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-14T16:54:48.035513+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T16:54:49.453 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-14T16:54:49.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.577+0000 7ff94aa7b700 1 Processor -- start 2023-10-14T16:54:49.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.577+0000 7ff94aa7b700 1 -- start start 2023-10-14T16:54:49.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.577+0000 7ff94aa7b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff944137990 0x7ff94413c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.577+0000 7ff94aa7b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff94413c5c0 0x7ff94413e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.577+0000 7ff94aa7b700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9440a63b0 con 0x7ff944097210 2023-10-14T16:54:49.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.577+0000 7ff94aa7b700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff944095a70 con 0x7ff94413c5c0 2023-10-14T16:54:49.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.577+0000 7ff94aa7b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff944136d90 con 0x7ff944137990 2023-10-14T16:54:49.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.577+0000 7ff949018700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff94413c5c0 0x7ff94413e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.577+0000 7ff948817700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff944097210 0x7ff944137280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41554/0 (socket says 172.21.15.8:41554) 2023-10-14T16:54:49.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.577+0000 7ff948817700 1 -- 172.21.15.8:0/1236518602 learned_addr learned my addr 172.21.15.8:0/1236518602 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:49.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.578+0000 7ff943fff700 1 --2- 172.21.15.8:0/1236518602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff944137990 0x7ff94413c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.578+0000 7ff949018700 1 -- 172.21.15.8:0/1236518602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff944137990 msgr2=0x7ff94413c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:49.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.578+0000 7ff949018700 1 --2- 172.21.15.8:0/1236518602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff944137990 0x7ff94413c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.578+0000 7ff949018700 1 -- 172.21.15.8:0/1236518602 >> v1:172.21.15.8:6789/0 conn(0x7ff944097210 legacy=0x7ff944137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.578+0000 7ff9437fe700 1 -- 172.21.15.8:0/1236518602 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853808727 0 0) 0x7ff9440a63b0 con 0x7ff944097210 2023-10-14T16:54:49.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.578+0000 7ff949018700 1 -- 172.21.15.8:0/1236518602 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944096520 con 0x7ff94413c5c0 2023-10-14T16:54:49.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.578+0000 7ff949018700 1 --2- 172.21.15.8:0/1236518602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94413c5c0 0x7ff94413e9a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0098e0 tx=0x7ff92c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd679f4066756d54 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:49.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.578+0000 7ff9437fe700 1 -- 172.21.15.8:0/1236518602 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c00b640 con 0x7ff94413c5c0 2023-10-14T16:54:49.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.578+0000 7ff9437fe700 1 -- 172.21.15.8:0/1236518602 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c00b7a0 con 0x7ff94413c5c0 2023-10-14T16:54:49.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.578+0000 7ff9437fe700 1 -- 172.21.15.8:0/1236518602 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c00bb40 con 0x7ff94413c5c0 2023-10-14T16:54:49.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.579+0000 7ff94aa7b700 1 -- 172.21.15.8:0/1236518602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94413c5c0 msgr2=0x7ff94413e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.579+0000 7ff94aa7b700 1 --2- 172.21.15.8:0/1236518602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94413c5c0 0x7ff94413e9a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0098e0 tx=0x7ff92c0091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.579+0000 7ff94aa7b700 1 -- 172.21.15.8:0/1236518602 shutdown_connections 2023-10-14T16:54:49.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.579+0000 7ff94aa7b700 1 --2- 172.21.15.8:0/1236518602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94413c5c0 0x7ff94413e9a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.579+0000 7ff94aa7b700 1 --2- 172.21.15.8:0/1236518602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff944137990 0x7ff94413c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.579+0000 7ff94aa7b700 1 -- 172.21.15.8:0/1236518602 >> 172.21.15.8:0/1236518602 conn(0x7ff94406ab90 msgr2=0x7ff9440701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:49.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.579+0000 7ff94aa7b700 1 -- 172.21.15.8:0/1236518602 shutdown_connections 2023-10-14T16:54:49.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.579+0000 7ff94aa7b700 1 -- 172.21.15.8:0/1236518602 wait complete. 2023-10-14T16:54:49.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff94aa7b700 1 Processor -- start 2023-10-14T16:54:49.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff94aa7b700 1 -- start start 2023-10-14T16:54:49.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff94aa7b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff944097210 0x7ff944097810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff94aa7b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff944137990 0x7ff944097d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff94aa7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94413c5c0 0x7ff944098290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff94aa7b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94409a8a0 con 0x7ff94413c5c0 2023-10-14T16:54:49.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff94aa7b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440a3480 con 0x7ff944137990 2023-10-14T16:54:49.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff94aa7b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440a2f50 con 0x7ff944097210 2023-10-14T16:54:49.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff949018700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94413c5c0 0x7ff944098290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff949018700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94413c5c0 0x7ff944098290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58484/0 (socket says 172.21.15.8:58484) 2023-10-14T16:54:49.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff949018700 1 -- 172.21.15.8:0/3001207380 learned_addr learned my addr 172.21.15.8:0/3001207380 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:49.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff948817700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff944097210 0x7ff944097810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.580+0000 7ff943fff700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff944137990 0x7ff944097d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.581+0000 7ff949018700 1 -- 172.21.15.8:0/3001207380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff944097210 msgr2=0x7ff944097810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.581+0000 7ff949018700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff944097210 0x7ff944097810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.581+0000 7ff949018700 1 -- 172.21.15.8:0/3001207380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff944137990 msgr2=0x7ff944097d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.581+0000 7ff949018700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff944137990 0x7ff944097d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.581+0000 7ff949018700 1 -- 172.21.15.8:0/3001207380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c009420 con 0x7ff94413c5c0 2023-10-14T16:54:49.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.581+0000 7ff949018700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94413c5c0 0x7ff944098290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff92c013000 tx=0x7ff92c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:49.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.581+0000 7ff940ff9700 1 -- 172.21.15.8:0/3001207380 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c00bb20 con 0x7ff94413c5c0 2023-10-14T16:54:49.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.581+0000 7ff940ff9700 1 -- 172.21.15.8:0/3001207380 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c011420 con 0x7ff94413c5c0 2023-10-14T16:54:49.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.581+0000 7ff94aa7b700 1 -- 172.21.15.8:0/3001207380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94409b140 con 0x7ff94413c5c0 2023-10-14T16:54:49.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.581+0000 7ff940ff9700 1 -- 172.21.15.8:0/3001207380 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0117e0 con 0x7ff94413c5c0 2023-10-14T16:54:49.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.581+0000 7ff94aa7b700 1 -- 172.21.15.8:0/3001207380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94409a5e0 con 0x7ff94413c5c0 2023-10-14T16:54:49.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.582+0000 7ff94aa7b700 1 -- 172.21.15.8:0/3001207380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9440708d0 con 0x7ff94413c5c0 2023-10-14T16:54:49.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.582+0000 7ff940ff9700 1 -- 172.21.15.8:0/3001207380 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7ff92c011b50 con 0x7ff94413c5c0 2023-10-14T16:54:49.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.583+0000 7ff940ff9700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7ff924066ea0 0x7ff924069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.583+0000 7ff940ff9700 1 -- 172.21.15.8:0/3001207380 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 3478+0+0 (secure 0 0 0) 0x7ff92c085150 con 0x7ff94413c5c0 2023-10-14T16:54:49.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.583+0000 7ff948817700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7ff924066ea0 0x7ff924069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.583+0000 7ff948817700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7ff924066ea0 0x7ff924069350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff93c007240 tx=0x7ff93c001970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:49.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.587+0000 7ff940ff9700 1 -- 172.21.15.8:0/3001207380 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff92c052dd0 con 0x7ff94413c5c0 2023-10-14T16:54:49.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.784+0000 7ff94aa7b700 1 -- 172.21.15.8:0/3001207380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff9440a6650 con 0x7ff94413c5c0 2023-10-14T16:54:49.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.785+0000 7ff940ff9700 1 -- 172.21.15.8:0/3001207380 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v11) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff92c0563f0 con 0x7ff94413c5c0 2023-10-14T16:54:49.786 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-14T16:54:49.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.787+0000 7ff94aa7b700 1 -- 172.21.15.8:0/3001207380 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7ff924066ea0 msgr2=0x7ff924069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.787+0000 7ff94aa7b700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7ff924066ea0 0x7ff924069350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff93c007240 tx=0x7ff93c001970 comp rx=0 tx=0).stop 2023-10-14T16:54:49.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.787+0000 7ff94aa7b700 1 -- 172.21.15.8:0/3001207380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94413c5c0 msgr2=0x7ff944098290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.787+0000 7ff94aa7b700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94413c5c0 0x7ff944098290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff92c013000 tx=0x7ff92c017000 comp rx=0 tx=0).stop 2023-10-14T16:54:49.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.787+0000 7ff94aa7b700 1 -- 172.21.15.8:0/3001207380 shutdown_connections 2023-10-14T16:54:49.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.787+0000 7ff94aa7b700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7ff924066ea0 0x7ff924069350 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.787+0000 7ff94aa7b700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff94413c5c0 0x7ff944098290 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.787+0000 7ff94aa7b700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff944097210 0x7ff944097810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.787+0000 7ff94aa7b700 1 --2- 172.21.15.8:0/3001207380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff944137990 0x7ff944097d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.787+0000 7ff94aa7b700 1 -- 172.21.15.8:0/3001207380 >> 172.21.15.8:0/3001207380 conn(0x7ff94406ab90 msgr2=0x7ff944133700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:49.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.787+0000 7ff94aa7b700 1 -- 172.21.15.8:0/3001207380 shutdown_connections 2023-10-14T16:54:49.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.787+0000 7ff94aa7b700 1 -- 172.21.15.8:0/3001207380 wait complete. 2023-10-14T16:54:49.800 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T16:54:49.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.922+0000 7fe477236700 1 Processor -- start 2023-10-14T16:54:49.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.922+0000 7fe477236700 1 -- start start 2023-10-14T16:54:49.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.922+0000 7fe477236700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe470097210 0x7fe470137280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.922+0000 7fe477236700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe4701377c0 0x7fe470133710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.922+0000 7fe477236700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe470137bf0 con 0x7fe470133c50 2023-10-14T16:54:49.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.922+0000 7fe477236700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4700a63b0 con 0x7fe4701377c0 2023-10-14T16:54:49.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.922+0000 7fe477236700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe470095a70 con 0x7fe470097210 2023-10-14T16:54:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.922+0000 7fe4757d3700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe470133c50 0x7fe47013e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41570/0 (socket says 172.21.15.8:41570) 2023-10-14T16:54:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.922+0000 7fe4757d3700 1 -- 172.21.15.8:0/3797556054 learned_addr learned my addr 172.21.15.8:0/3797556054 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.922+0000 7fe474fd2700 1 --2- 172.21.15.8:0/3797556054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe470097210 0x7fe470137280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.922+0000 7fe46ffff700 1 --2- 172.21.15.8:0/3797556054 >> v2:172.21.15.155:3300/0 conn(0x7fe4701377c0 0x7fe470133710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.923+0000 7fe46f7fe700 1 -- 172.21.15.8:0/3797556054 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900233821 0 0) 0x7fe470137bf0 con 0x7fe470133c50 2023-10-14T16:54:49.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.923+0000 7fe46f7fe700 1 -- 172.21.15.8:0/3797556054 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe460003570 con 0x7fe470133c50 2023-10-14T16:54:49.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.923+0000 7fe46ffff700 1 -- 172.21.15.8:0/3797556054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe470097210 msgr2=0x7fe470137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:49.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.923+0000 7fe46ffff700 1 --2- 172.21.15.8:0/3797556054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe470097210 0x7fe470137280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.923+0000 7fe46ffff700 1 -- 172.21.15.8:0/3797556054 >> v1:172.21.15.8:6789/0 conn(0x7fe470133c50 legacy=0x7fe47013e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.923+0000 7fe46ffff700 1 -- 172.21.15.8:0/3797556054 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe470136d90 con 0x7fe4701377c0 2023-10-14T16:54:49.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.923+0000 7fe474fd2700 1 --2- 172.21.15.8:0/3797556054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe470097210 0x7fe470137280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:49.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.923+0000 7fe46ffff700 1 --2- 172.21.15.8:0/3797556054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4701377c0 0x7fe470133710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0098e0 tx=0x7fe45c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76e810c59fababcd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:49.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.923+0000 7fe46f7fe700 1 -- 172.21.15.8:0/3797556054 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c011630 con 0x7fe4701377c0 2023-10-14T16:54:49.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.923+0000 7fe46f7fe700 1 -- 172.21.15.8:0/3797556054 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45c011790 con 0x7fe4701377c0 2023-10-14T16:54:49.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.923+0000 7fe46f7fe700 1 -- 172.21.15.8:0/3797556054 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c011b10 con 0x7fe4701377c0 2023-10-14T16:54:49.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.924+0000 7fe477236700 1 -- 172.21.15.8:0/3797556054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4701377c0 msgr2=0x7fe470133710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.924+0000 7fe477236700 1 --2- 172.21.15.8:0/3797556054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4701377c0 0x7fe470133710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0098e0 tx=0x7fe45c0091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.924+0000 7fe477236700 1 -- 172.21.15.8:0/3797556054 shutdown_connections 2023-10-14T16:54:49.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.924+0000 7fe477236700 1 --2- 172.21.15.8:0/3797556054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe470097210 0x7fe470137280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.924+0000 7fe477236700 1 --2- 172.21.15.8:0/3797556054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4701377c0 0x7fe470133710 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.924+0000 7fe477236700 1 -- 172.21.15.8:0/3797556054 >> 172.21.15.8:0/3797556054 conn(0x7fe47006ab90 msgr2=0x7fe4700701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:49.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.924+0000 7fe477236700 1 -- 172.21.15.8:0/3797556054 shutdown_connections 2023-10-14T16:54:49.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.924+0000 7fe477236700 1 -- 172.21.15.8:0/3797556054 wait complete. 2023-10-14T16:54:49.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe477236700 1 Processor -- start 2023-10-14T16:54:49.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe477236700 1 -- start start 2023-10-14T16:54:49.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe477236700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe470097210 0x7fe47009c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe477236700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe470133c50 0x7fe470143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe477236700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4701377c0 0x7fe470146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe477236700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47009bd50 con 0x7fe470133c50 2023-10-14T16:54:49.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe477236700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47009cef0 con 0x7fe4701377c0 2023-10-14T16:54:49.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe477236700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47009c520 con 0x7fe470097210 2023-10-14T16:54:49.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe46ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe470133c50 0x7fe470143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe46ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe470133c50 0x7fe470143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58508/0 (socket says 172.21.15.8:58508) 2023-10-14T16:54:49.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe46ffff700 1 -- 172.21.15.8:0/1752196252 learned_addr learned my addr 172.21.15.8:0/1752196252 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe474fd2700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe470097210 0x7fe47009c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.925+0000 7fe4757d3700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4701377c0 0x7fe470146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.926+0000 7fe46ffff700 1 -- 172.21.15.8:0/1752196252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe470097210 msgr2=0x7fe47009c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.926+0000 7fe46ffff700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe470097210 0x7fe47009c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.926+0000 7fe46ffff700 1 -- 172.21.15.8:0/1752196252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4701377c0 msgr2=0x7fe470146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.926+0000 7fe46ffff700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4701377c0 0x7fe470146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.926+0000 7fe46ffff700 1 -- 172.21.15.8:0/1752196252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe464009420 con 0x7fe470133c50 2023-10-14T16:54:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.926+0000 7fe46ffff700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe470133c50 0x7fe470143c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe4700a7070 tx=0x7fe45c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.926+0000 7fe46cff9700 1 -- 172.21.15.8:0/1752196252 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c011900 con 0x7fe470133c50 2023-10-14T16:54:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.926+0000 7fe46cff9700 1 -- 172.21.15.8:0/1752196252 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45c011a60 con 0x7fe470133c50 2023-10-14T16:54:49.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.926+0000 7fe477236700 1 -- 172.21.15.8:0/1752196252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c009420 con 0x7fe470133c50 2023-10-14T16:54:49.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.926+0000 7fe46cff9700 1 -- 172.21.15.8:0/1752196252 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c01a680 con 0x7fe470133c50 2023-10-14T16:54:49.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.926+0000 7fe477236700 1 -- 172.21.15.8:0/1752196252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4700997a0 con 0x7fe470133c50 2023-10-14T16:54:49.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.927+0000 7fe477236700 1 -- 172.21.15.8:0/1752196252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4700708d0 con 0x7fe470133c50 2023-10-14T16:54:49.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.928+0000 7fe46cff9700 1 -- 172.21.15.8:0/1752196252 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fe45c01aa70 con 0x7fe470133c50 2023-10-14T16:54:49.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.928+0000 7fe46cff9700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe454066ea0 0x7fe454069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:49.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.928+0000 7fe46cff9700 1 -- 172.21.15.8:0/1752196252 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fe45c085530 con 0x7fe470133c50 2023-10-14T16:54:49.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.928+0000 7fe474fd2700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe454066ea0 0x7fe454069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:49.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.928+0000 7fe474fd2700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe454066ea0 0x7fe454069350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe464009f40 tx=0x7fe4640091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:49.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:49.933+0000 7fe46cff9700 1 -- 172.21.15.8:0/1752196252 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe45c053130 con 0x7fe470133c50 2023-10-14T16:54:50.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.128+0000 7fe477236700 1 -- 172.21.15.8:0/1752196252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe470096520 con 0x7fe470133c50 2023-10-14T16:54:50.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.129+0000 7fe46cff9700 1 -- 172.21.15.8:0/1752196252 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v12) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe45c015020 con 0x7fe470133c50 2023-10-14T16:54:50.131 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T16:54:50.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.131+0000 7fe477236700 1 -- 172.21.15.8:0/1752196252 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe454066ea0 msgr2=0x7fe454069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.131+0000 7fe477236700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe454066ea0 0x7fe454069350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe464009f40 tx=0x7fe4640091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.131+0000 7fe477236700 1 -- 172.21.15.8:0/1752196252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe470133c50 msgr2=0x7fe470143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.131+0000 7fe477236700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe470133c50 0x7fe470143c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe4700a7070 tx=0x7fe45c017000 comp rx=0 tx=0).stop 2023-10-14T16:54:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.131+0000 7fe477236700 1 -- 172.21.15.8:0/1752196252 shutdown_connections 2023-10-14T16:54:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.131+0000 7fe477236700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe454066ea0 0x7fe454069350 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.131+0000 7fe477236700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4701377c0 0x7fe470146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.131+0000 7fe477236700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe470097210 0x7fe47009c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.131+0000 7fe477236700 1 --2- 172.21.15.8:0/1752196252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe470133c50 0x7fe470143c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.131+0000 7fe477236700 1 -- 172.21.15.8:0/1752196252 >> 172.21.15.8:0/1752196252 conn(0x7fe47006ab90 msgr2=0x7fe47013a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.131+0000 7fe477236700 1 -- 172.21.15.8:0/1752196252 shutdown_connections 2023-10-14T16:54:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.131+0000 7fe477236700 1 -- 172.21.15.8:0/1752196252 wait complete. 2023-10-14T16:54:50.144 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T16:54:50.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.262+0000 7fba1759e700 1 Processor -- start 2023-10-14T16:54:50.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.262+0000 7fba1759e700 1 -- start start 2023-10-14T16:54:50.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.262+0000 7fba1759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba180a6a70 0x7fba180a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.262+0000 7fba1759e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba180a0d30 con 0x7fba180a5550 2023-10-14T16:54:50.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.262+0000 7fba1759e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba180a4850 con 0x7fba180a5180 2023-10-14T16:54:50.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.262+0000 7fba1759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba180a2a40 con 0x7fba180a6a70 2023-10-14T16:54:50.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba16d9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fba180a5550 0x7fba18137080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41578/0 (socket says 172.21.15.8:41578) 2023-10-14T16:54:50.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba16d9d700 1 -- 172.21.15.8:0/2542821370 learned_addr learned my addr 172.21.15.8:0/2542821370 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:50.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba1659c700 1 --2- 172.21.15.8:0/2542821370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba180a6a70 0x7fba180a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba1559a700 1 -- 172.21.15.8:0/2542821370 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024564921 0 0) 0x7fba180a0d30 con 0x7fba180a5550 2023-10-14T16:54:50.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba1559a700 1 -- 172.21.15.8:0/2542821370 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba00003570 con 0x7fba180a5550 2023-10-14T16:54:50.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba1559a700 1 -- 172.21.15.8:0/2542821370 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275110418 0 0) 0x7fba180a4850 con 0x7fba180a5180 2023-10-14T16:54:50.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba1559a700 1 -- 172.21.15.8:0/2542821370 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba180a0d30 con 0x7fba180a5180 2023-10-14T16:54:50.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba1659c700 1 -- 172.21.15.8:0/2542821370 >> v1:172.21.15.155:6789/0 conn(0x7fba180a5180 legacy=0x7fba18136970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba1659c700 1 -- 172.21.15.8:0/2542821370 >> v1:172.21.15.8:6789/0 conn(0x7fba180a5550 legacy=0x7fba18137080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba1659c700 1 -- 172.21.15.8:0/2542821370 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba180a18c0 con 0x7fba180a6a70 2023-10-14T16:54:50.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba1659c700 1 --2- 172.21.15.8:0/2542821370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba180a6a70 0x7fba180a4c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fba08009910 tx=0x7fba080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2710a65ed02fe4e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:50.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba1559a700 1 -- 172.21.15.8:0/2542821370 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08011630 con 0x7fba180a6a70 2023-10-14T16:54:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba1559a700 1 -- 172.21.15.8:0/2542821370 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08011790 con 0x7fba180a6a70 2023-10-14T16:54:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.263+0000 7fba1559a700 1 -- 172.21.15.8:0/2542821370 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08011b30 con 0x7fba180a6a70 2023-10-14T16:54:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.264+0000 7fba1759e700 1 -- 172.21.15.8:0/2542821370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba180a6a70 msgr2=0x7fba180a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.264+0000 7fba1759e700 1 --2- 172.21.15.8:0/2542821370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba180a6a70 0x7fba180a4c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fba08009910 tx=0x7fba080091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.264+0000 7fba1759e700 1 -- 172.21.15.8:0/2542821370 shutdown_connections 2023-10-14T16:54:50.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.264+0000 7fba1759e700 1 --2- 172.21.15.8:0/2542821370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba180a6a70 0x7fba180a4c40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.264+0000 7fba1759e700 1 -- 172.21.15.8:0/2542821370 >> 172.21.15.8:0/2542821370 conn(0x7fba1806a960 msgr2=0x7fba180701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:50.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.264+0000 7fba1759e700 1 -- 172.21.15.8:0/2542821370 shutdown_connections 2023-10-14T16:54:50.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.264+0000 7fba1759e700 1 -- 172.21.15.8:0/2542821370 wait complete. 2023-10-14T16:54:50.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.265+0000 7fba1759e700 1 Processor -- start 2023-10-14T16:54:50.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.265+0000 7fba1759e700 1 -- start start 2023-10-14T16:54:50.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.265+0000 7fba1759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba180a5180 0x7fba1809a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.265+0000 7fba1759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba180a5550 0x7fba1809af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.265+0000 7fba1759e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba1809f510 0x7fba1809b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.265+0000 7fba1759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1809c7b0 con 0x7fba180a5550 2023-10-14T16:54:50.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.265+0000 7fba1759e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1809eae0 con 0x7fba1809f510 2023-10-14T16:54:50.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.265+0000 7fba1759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1809edc0 con 0x7fba180a5180 2023-10-14T16:54:50.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.265+0000 7fba15d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba180a5550 0x7fba1809af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.265+0000 7fba15d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba180a5550 0x7fba1809af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58520/0 (socket says 172.21.15.8:58520) 2023-10-14T16:54:50.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.265+0000 7fba15d9b700 1 -- 172.21.15.8:0/2687806125 learned_addr learned my addr 172.21.15.8:0/2687806125 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:50.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba1659c700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba180a5180 0x7fba1809a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba16d9d700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba1809f510 0x7fba1809b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba15d9b700 1 -- 172.21.15.8:0/2687806125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba180a5180 msgr2=0x7fba1809a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba15d9b700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba180a5180 0x7fba1809a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba15d9b700 1 -- 172.21.15.8:0/2687806125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba1809f510 msgr2=0x7fba1809b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba15d9b700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba1809f510 0x7fba1809b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba15d9b700 1 -- 172.21.15.8:0/2687806125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08009420 con 0x7fba180a5550 2023-10-14T16:54:50.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba16d9d700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba1809f510 0x7fba1809b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:54:50.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba15d9b700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba180a5550 0x7fba1809af20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00c790 tx=0x7fba0c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:50.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba067fc700 1 -- 172.21.15.8:0/2687806125 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c010510 con 0x7fba180a5550 2023-10-14T16:54:50.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba067fc700 1 -- 172.21.15.8:0/2687806125 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c010670 con 0x7fba180a5550 2023-10-14T16:54:50.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba1759e700 1 -- 172.21.15.8:0/2687806125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1809e820 con 0x7fba180a5550 2023-10-14T16:54:50.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba067fc700 1 -- 172.21.15.8:0/2687806125 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c010a10 con 0x7fba180a5550 2023-10-14T16:54:50.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.266+0000 7fba1759e700 1 -- 172.21.15.8:0/2687806125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba180a0af0 con 0x7fba180a5550 2023-10-14T16:54:50.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.267+0000 7fba1759e700 1 -- 172.21.15.8:0/2687806125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba18135ed0 con 0x7fba180a5550 2023-10-14T16:54:50.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.267+0000 7fba067fc700 1 -- 172.21.15.8:0/2687806125 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fba0c01b400 con 0x7fba180a5550 2023-10-14T16:54:50.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.268+0000 7fba067fc700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fb9f8066ea0 0x7fb9f8069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.268+0000 7fba067fc700 1 -- 172.21.15.8:0/2687806125 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fba0c0839b0 con 0x7fba180a5550 2023-10-14T16:54:50.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.268+0000 7fba1659c700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fb9f8066ea0 0x7fb9f8069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.268+0000 7fba1659c700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fb9f8066ea0 0x7fb9f8069350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba08009860 tx=0x7fba08017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:50.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.272+0000 7fba067fc700 1 -- 172.21.15.8:0/2687806125 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba0c0515b0 con 0x7fba180a5550 2023-10-14T16:54:50.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.507+0000 7fba1759e700 1 -- 172.21.15.8:0/2687806125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba1809d870 con 0x7fba180a5550 2023-10-14T16:54:50.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.508+0000 7fba067fc700 1 -- 172.21.15.8:0/2687806125 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2012 (secure 0 0 0) 0x7fba0c054bd0 con 0x7fba180a5550 2023-10-14T16:54:50.509 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:50.509 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6817/3883908964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3883908964},{"type":"v1","addr":"172.21.15.155:6817","nonce":3883908964}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6819/3402040876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3402040876},{"type":"v1","addr":"172.21.15.8:6819","nonce":3402040876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-14T16:54:50.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.510+0000 7fba1759e700 1 -- 172.21.15.8:0/2687806125 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fb9f8066ea0 msgr2=0x7fb9f8069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.510+0000 7fba1759e700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fb9f8066ea0 0x7fb9f8069350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba08009860 tx=0x7fba08017000 comp rx=0 tx=0).stop 2023-10-14T16:54:50.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.510+0000 7fba1759e700 1 -- 172.21.15.8:0/2687806125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba180a5550 msgr2=0x7fba1809af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.510+0000 7fba1759e700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba180a5550 0x7fba1809af20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00c790 tx=0x7fba0c007e10 comp rx=0 tx=0).stop 2023-10-14T16:54:50.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.510+0000 7fba1759e700 1 -- 172.21.15.8:0/2687806125 shutdown_connections 2023-10-14T16:54:50.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.510+0000 7fba1759e700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fb9f8066ea0 0x7fb9f8069350 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.510+0000 7fba1759e700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba1809f510 0x7fba1809b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.510+0000 7fba1759e700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba180a5180 0x7fba1809a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.510+0000 7fba1759e700 1 --2- 172.21.15.8:0/2687806125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba180a5550 0x7fba1809af20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.510+0000 7fba1759e700 1 -- 172.21.15.8:0/2687806125 >> 172.21.15.8:0/2687806125 conn(0x7fba1806a960 msgr2=0x7fba180a8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.510+0000 7fba1759e700 1 -- 172.21.15.8:0/2687806125 shutdown_connections 2023-10-14T16:54:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.510+0000 7fba1759e700 1 -- 172.21.15.8:0/2687806125 wait complete. 2023-10-14T16:54:50.513 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2023-10-14T16:54:50.523 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T16:54:50.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.641+0000 7ff9f9394700 1 Processor -- start 2023-10-14T16:54:50.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.641+0000 7ff9f9394700 1 -- start start 2023-10-14T16:54:50.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.641+0000 7ff9f9394700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff9f413d440 0x7ff9f413f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.641+0000 7ff9f9394700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f40a2b20 con 0x7ff9f40a69c0 2023-10-14T16:54:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.641+0000 7ff9f9394700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f40a48c0 con 0x7ff9f40a5400 2023-10-14T16:54:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.641+0000 7ff9f9394700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f40a76a0 con 0x7ff9f413d440 2023-10-14T16:54:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.642+0000 7ff9f37fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff9f413d440 0x7ff9f413f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.642+0000 7ff9f37fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff9f413d440 0x7ff9f413f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58536/0 (socket says 172.21.15.8:58536) 2023-10-14T16:54:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.642+0000 7ff9f2ffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff9f40a69c0 0x7ff9f40a4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41588/0 (socket says 172.21.15.8:41588) 2023-10-14T16:54:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.642+0000 7ff9f37fe700 1 -- 172.21.15.8:0/4146244500 learned_addr learned my addr 172.21.15.8:0/4146244500 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.642+0000 7ff9f37fe700 1 -- 172.21.15.8:0/4146244500 >> v1:172.21.15.155:6789/0 conn(0x7ff9f40a5400 legacy=0x7ff9f413bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.642+0000 7ff9f37fe700 1 -- 172.21.15.8:0/4146244500 >> v1:172.21.15.8:6789/0 conn(0x7ff9f40a69c0 legacy=0x7ff9f40a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.642+0000 7ff9f37fe700 1 -- 172.21.15.8:0/4146244500 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f40a18c0 con 0x7ff9f413d440 2023-10-14T16:54:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.642+0000 7ff9f37fe700 1 --2- 172.21.15.8:0/4146244500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9f413d440 0x7ff9f413f820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009f20 tx=0x7ff9e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c632c44146fc61 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.642+0000 7ff9f1ffb700 1 -- 172.21.15.8:0/4146244500 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400e070 con 0x7ff9f413d440 2023-10-14T16:54:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.642+0000 7ff9f1ffb700 1 -- 172.21.15.8:0/4146244500 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e400ba80 con 0x7ff9f413d440 2023-10-14T16:54:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.642+0000 7ff9f1ffb700 1 -- 172.21.15.8:0/4146244500 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e40092e0 con 0x7ff9f413d440 2023-10-14T16:54:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.643+0000 7ff9f9394700 1 -- 172.21.15.8:0/4146244500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9f413d440 msgr2=0x7ff9f413f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.643+0000 7ff9f9394700 1 --2- 172.21.15.8:0/4146244500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9f413d440 0x7ff9f413f820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009f20 tx=0x7ff9e4009840 comp rx=0 tx=0).stop 2023-10-14T16:54:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.643+0000 7ff9f9394700 1 -- 172.21.15.8:0/4146244500 shutdown_connections 2023-10-14T16:54:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.643+0000 7ff9f9394700 1 --2- 172.21.15.8:0/4146244500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9f413d440 0x7ff9f413f820 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.643+0000 7ff9f9394700 1 -- 172.21.15.8:0/4146244500 >> 172.21.15.8:0/4146244500 conn(0x7ff9f406a8d0 msgr2=0x7ff9f40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.643+0000 7ff9f9394700 1 -- 172.21.15.8:0/4146244500 shutdown_connections 2023-10-14T16:54:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.643+0000 7ff9f9394700 1 -- 172.21.15.8:0/4146244500 wait complete. 2023-10-14T16:54:50.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f9394700 1 Processor -- start 2023-10-14T16:54:50.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f9394700 1 -- start start 2023-10-14T16:54:50.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f9394700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9f40a5400 0x7ff9f41336a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f9394700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9f413d440 0x7ff9f4133be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f9394700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f4134120 0x7ff9f4096120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f9394700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40a0aa0 con 0x7ff9f413d440 2023-10-14T16:54:50.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f9394700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f409a760 con 0x7ff9f40a5400 2023-10-14T16:54:50.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f9394700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f409aeb0 con 0x7ff9f4134120 2023-10-14T16:54:50.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9f413d440 0x7ff9f4133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9f413d440 0x7ff9f4133be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58538/0 (socket says 172.21.15.8:58538) 2023-10-14T16:54:50.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f27fc700 1 -- 172.21.15.8:0/2265742312 learned_addr learned my addr 172.21.15.8:0/2265742312 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:50.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f2ffd700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9f40a5400 0x7ff9f41336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.644+0000 7ff9f37fe700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f4134120 0x7ff9f4096120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.645+0000 7ff9f27fc700 1 -- 172.21.15.8:0/2265742312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f4134120 msgr2=0x7ff9f4096120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.645+0000 7ff9f27fc700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f4134120 0x7ff9f4096120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.645+0000 7ff9f27fc700 1 -- 172.21.15.8:0/2265742312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9f40a5400 msgr2=0x7ff9f41336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.645+0000 7ff9f27fc700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9f40a5400 0x7ff9f41336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.645+0000 7ff9f27fc700 1 -- 172.21.15.8:0/2265742312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e4009ae0 con 0x7ff9f413d440 2023-10-14T16:54:50.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.645+0000 7ff9f27fc700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9f413d440 0x7ff9f4133be0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00c790 tx=0x7ff9dc007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:50.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.645+0000 7ff9eaffd700 1 -- 172.21.15.8:0/2265742312 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc011590 con 0x7ff9f413d440 2023-10-14T16:54:50.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.645+0000 7ff9eaffd700 1 -- 172.21.15.8:0/2265742312 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc0116f0 con 0x7ff9f413d440 2023-10-14T16:54:50.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.645+0000 7ff9f9394700 1 -- 172.21.15.8:0/2265742312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f4099d30 con 0x7ff9f413d440 2023-10-14T16:54:50.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.645+0000 7ff9eaffd700 1 -- 172.21.15.8:0/2265742312 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc011ab0 con 0x7ff9f413d440 2023-10-14T16:54:50.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.645+0000 7ff9f9394700 1 -- 172.21.15.8:0/2265742312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f409a0a0 con 0x7ff9f413d440 2023-10-14T16:54:50.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.646+0000 7ff9f9394700 1 -- 172.21.15.8:0/2265742312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f402b440 con 0x7ff9f413d440 2023-10-14T16:54:50.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.646+0000 7ff9eaffd700 1 -- 172.21.15.8:0/2265742312 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9dc01b3b0 con 0x7ff9f413d440 2023-10-14T16:54:50.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.647+0000 7ff9eaffd700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7ff9d4066f30 0x7ff9d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.647+0000 7ff9eaffd700 1 -- 172.21.15.8:0/2265742312 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3478+0+0 (secure 0 0 0) 0x7ff9dc082f70 con 0x7ff9f413d440 2023-10-14T16:54:50.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.647+0000 7ff9f2ffd700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7ff9d4066f30 0x7ff9d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.647+0000 7ff9f2ffd700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7ff9d4066f30 0x7ff9d40693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec004fd0 tx=0x7ff9ec007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:50.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.651+0000 7ff9eaffd700 1 -- 172.21.15.8:0/2265742312 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9dc050a90 con 0x7ff9f413d440 2023-10-14T16:54:50.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.846+0000 7ff9f9394700 1 -- 172.21.15.8:0/2265742312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9f4135060 con 0x7ff9f413d440 2023-10-14T16:54:50.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.847+0000 7ff9eaffd700 1 -- 172.21.15.8:0/2265742312 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8941 (secure 0 0 0) 0x7ff9dc017030 con 0x7ff9f413d440 2023-10-14T16:54:50.848 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:50.848 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":12,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:50.058726+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:54:50.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.848+0000 7ff9f9394700 1 -- 172.21.15.8:0/2265742312 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7ff9d4066f30 msgr2=0x7ff9d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.848+0000 7ff9f9394700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7ff9d4066f30 0x7ff9d40693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec004fd0 tx=0x7ff9ec007eb0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.848+0000 7ff9f9394700 1 -- 172.21.15.8:0/2265742312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9f413d440 msgr2=0x7ff9f4133be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.848+0000 7ff9f9394700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9f413d440 0x7ff9f4133be0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00c790 tx=0x7ff9dc007f40 comp rx=0 tx=0).stop 2023-10-14T16:54:50.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.848+0000 7ff9f9394700 1 -- 172.21.15.8:0/2265742312 shutdown_connections 2023-10-14T16:54:50.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.848+0000 7ff9f9394700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7ff9d4066f30 0x7ff9d40693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.848+0000 7ff9f9394700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f4134120 0x7ff9f4096120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.848+0000 7ff9f9394700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9f40a5400 0x7ff9f41336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.848+0000 7ff9f9394700 1 --2- 172.21.15.8:0/2265742312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9f413d440 0x7ff9f4133be0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.848+0000 7ff9f9394700 1 -- 172.21.15.8:0/2265742312 >> 172.21.15.8:0/2265742312 conn(0x7ff9f406a8d0 msgr2=0x7ff9f40a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:50.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.849+0000 7ff9f9394700 1 -- 172.21.15.8:0/2265742312 shutdown_connections 2023-10-14T16:54:50.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.849+0000 7ff9f9394700 1 -- 172.21.15.8:0/2265742312 wait complete. 2023-10-14T16:54:50.861 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-14T16:54:47.365008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-14T16:54:48.035513+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T16:54:50.862 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-14T16:54:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.982+0000 7f428359e700 1 Processor -- start 2023-10-14T16:54:50.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.982+0000 7f428359e700 1 -- start start 2023-10-14T16:54:50.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.982+0000 7f428359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42840a6990 0x7f42840a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.982+0000 7f428359e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f428413bc90 0x7f428413e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.982+0000 7f428359e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42840972a0 con 0x7f4284096b50 2023-10-14T16:54:50.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.982+0000 7f428359e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4284096120 con 0x7f428413bc90 2023-10-14T16:54:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.982+0000 7f428359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4284097000 con 0x7f42840a6990 2023-10-14T16:54:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f4281d9b700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4284096b50 0x7f42840a50c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41604/0 (socket says 172.21.15.8:41604) 2023-10-14T16:54:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f4281d9b700 1 -- 172.21.15.8:0/1831305121 learned_addr learned my addr 172.21.15.8:0/1831305121 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f4282d9d700 1 --2- 172.21.15.8:0/1831305121 >> v2:172.21.15.155:3300/0 conn(0x7f428413bc90 0x7f428413e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428259c700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42840a6990 0x7f42840a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524111178 0 0) 0x7f42840972a0 con 0x7f4284096b50 2023-10-14T16:54:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f426c003570 con 0x7f4284096b50 2023-10-14T16:54:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1203423366 0 0) 0x7f426c003570 con 0x7f4284096b50 2023-10-14T16:54:50.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42840a6990 msgr2=0x7f42840a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:50.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42840a6990 0x7f42840a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 >> v2:172.21.15.155:3300/0 conn(0x7f428413bc90 msgr2=0x7f428413e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:50.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 --2- 172.21.15.8:0/1831305121 >> v2:172.21.15.155:3300/0 conn(0x7f428413bc90 0x7f428413e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42840a4750 con 0x7f4284096b50 2023-10-14T16:54:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f4278001470 con 0x7f4284096b50 2023-10-14T16:54:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 >> v1:172.21.15.8:6789/0 conn(0x7f4284096b50 legacy=0x7f42840a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c003a60 0x7f426c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f426c004810 0x7f426c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c0051c0 0x7f426c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4284096120 con 0x7f426c004810 2023-10-14T16:54:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4284097000 con 0x7f426c0051c0 2023-10-14T16:54:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c00bfa0 con 0x7f426c003a60 2023-10-14T16:54:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428259c700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42840a6990 0x7f42840a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f4282d9d700 1 --2- 172.21.15.8:0/1831305121 >> v2:172.21.15.155:3300/0 conn(0x7f428413bc90 0x7f428413e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f4281d9b700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f426c004810 0x7f426c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f4282d9d700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c0051c0 0x7f426c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.983+0000 7f428259c700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c003a60 0x7f426c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.984+0000 7f4281d9b700 1 -- 172.21.15.8:0/1831305121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c003a60 msgr2=0x7f426c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.984+0000 7f4281d9b700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f426c003a60 0x7f426c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.984+0000 7f4281d9b700 1 -- 172.21.15.8:0/1831305121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c0051c0 msgr2=0x7f426c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.984+0000 7f4281d9b700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c0051c0 0x7f426c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.984+0000 7f4281d9b700 1 -- 172.21.15.8:0/1831305121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c003570 con 0x7f426c004810 2023-10-14T16:54:50.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.984+0000 7f4281d9b700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f426c004810 0x7f426c004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f427800c3f0 tx=0x7f42840a48e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5581d4a82af80b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:50.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.984+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800cc20 con 0x7f426c004810 2023-10-14T16:54:50.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.984+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427800cdc0 con 0x7f426c004810 2023-10-14T16:54:50.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.984+0000 7f428159a700 1 -- 172.21.15.8:0/1831305121 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278005b70 con 0x7f426c004810 2023-10-14T16:54:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.984+0000 7f428359e700 1 -- 172.21.15.8:0/1831305121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f426c004810 msgr2=0x7f426c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.984+0000 7f428359e700 1 --2- 172.21.15.8:0/1831305121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f426c004810 0x7f426c004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f427800c3f0 tx=0x7f42840a48e0 comp rx=0 tx=0).stop 2023-10-14T16:54:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.984+0000 7f4282d9d700 1 -- 172.21.15.8:0/1831305121 reap_dead start 2023-10-14T16:54:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.985+0000 7f428359e700 1 -- 172.21.15.8:0/1831305121 shutdown_connections 2023-10-14T16:54:50.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.985+0000 7f428359e700 1 -- 172.21.15.8:0/1831305121 >> 172.21.15.8:0/1831305121 conn(0x7f428406a840 msgr2=0x7f42840701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:51.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.985+0000 7f428359e700 1 -- 172.21.15.8:0/1831305121 shutdown_connections 2023-10-14T16:54:51.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.985+0000 7f428359e700 1 -- 172.21.15.8:0/1831305121 wait complete. 2023-10-14T16:54:51.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.985+0000 7f428359e700 1 Processor -- start 2023-10-14T16:54:51.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.985+0000 7f428359e700 1 -- start start 2023-10-14T16:54:51.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f428359e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c004810 0x7f4284132830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f428359e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f428409b490 0x7f4284132d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f428359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428409d340 0x7f42841461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f428359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428409c270 con 0x7f428409d340 2023-10-14T16:54:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f428359e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428409cc80 con 0x7f426c004810 2023-10-14T16:54:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f428359e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428409c6e0 con 0x7f428409b490 2023-10-14T16:54:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f4282d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428409d340 0x7f42841461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f4282d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428409d340 0x7f42841461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58560/0 (socket says 172.21.15.8:58560) 2023-10-14T16:54:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f4282d9d700 1 -- 172.21.15.8:0/3653690147 learned_addr learned my addr 172.21.15.8:0/3653690147 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f4281d9b700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f428409b490 0x7f4284132d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f428259c700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c004810 0x7f4284132830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f4282d9d700 1 -- 172.21.15.8:0/3653690147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f428409b490 msgr2=0x7f4284132d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f4282d9d700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f428409b490 0x7f4284132d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f4282d9d700 1 -- 172.21.15.8:0/3653690147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c004810 msgr2=0x7f4284132830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f4282d9d700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c004810 0x7f4284132830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f4282d9d700 1 -- 172.21.15.8:0/3653690147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42840a31c0 con 0x7f428409d340 2023-10-14T16:54:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.986+0000 7f428259c700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c004810 0x7f4284132830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:54:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.987+0000 7f4282d9d700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428409d340 0x7f42841461e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4284096a30 tx=0x7f427c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.987+0000 7f42727fc700 1 -- 172.21.15.8:0/3653690147 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c00e040 con 0x7f428409d340 2023-10-14T16:54:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.987+0000 7f42727fc700 1 -- 172.21.15.8:0/3653690147 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c00f040 con 0x7f428409d340 2023-10-14T16:54:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.987+0000 7f428359e700 1 -- 172.21.15.8:0/3653690147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428409c9a0 con 0x7f428409d340 2023-10-14T16:54:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.987+0000 7f42727fc700 1 -- 172.21.15.8:0/3653690147 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c015430 con 0x7f428409d340 2023-10-14T16:54:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.987+0000 7f428359e700 1 -- 172.21.15.8:0/3653690147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428409a5d0 con 0x7f428409d340 2023-10-14T16:54:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.988+0000 7f428359e700 1 -- 172.21.15.8:0/3653690147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428406ac10 con 0x7f428409d340 2023-10-14T16:54:51.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.988+0000 7f42727fc700 1 -- 172.21.15.8:0/3653690147 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f427c015820 con 0x7f428409d340 2023-10-14T16:54:51.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.988+0000 7f42727fc700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4264066f60 0x7f4264069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.989+0000 7f42727fc700 1 -- 172.21.15.8:0/3653690147 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f427c084750 con 0x7f428409d340 2023-10-14T16:54:51.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.989+0000 7f428259c700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4264066f60 0x7f4264069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.989+0000 7f428259c700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4264066f60 0x7f4264069410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4274006dc0 tx=0x7f4274008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:51.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:50.993+0000 7f42727fc700 1 -- 172.21.15.8:0/3653690147 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f427c052270 con 0x7f428409d340 2023-10-14T16:54:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.182+0000 7f428359e700 1 -- 172.21.15.8:0/3653690147 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42840963e0 con 0x7f428409d340 2023-10-14T16:54:51.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.182+0000 7f42727fc700 1 -- 172.21.15.8:0/3653690147 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7f427c055890 con 0x7f428409d340 2023-10-14T16:54:51.184 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-14T16:54:51.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.184+0000 7f428359e700 1 -- 172.21.15.8:0/3653690147 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4264066f60 msgr2=0x7f4264069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.184+0000 7f428359e700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4264066f60 0x7f4264069410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4274006dc0 tx=0x7f4274008040 comp rx=0 tx=0).stop 2023-10-14T16:54:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.184+0000 7f428359e700 1 -- 172.21.15.8:0/3653690147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428409d340 msgr2=0x7f42841461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.184+0000 7f428359e700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428409d340 0x7f42841461e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4284096a30 tx=0x7f427c00b040 comp rx=0 tx=0).stop 2023-10-14T16:54:51.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.184+0000 7f428359e700 1 -- 172.21.15.8:0/3653690147 shutdown_connections 2023-10-14T16:54:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.184+0000 7f428359e700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4264066f60 0x7f4264069410 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.184+0000 7f428359e700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f428409d340 0x7f42841461e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.184+0000 7f428359e700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f426c004810 0x7f4284132830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.184+0000 7f428359e700 1 --2- 172.21.15.8:0/3653690147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f428409b490 0x7f4284132d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.184+0000 7f428359e700 1 -- 172.21.15.8:0/3653690147 >> 172.21.15.8:0/3653690147 conn(0x7f428406a840 msgr2=0x7f4284133790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.184+0000 7f428359e700 1 -- 172.21.15.8:0/3653690147 shutdown_connections 2023-10-14T16:54:51.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.184+0000 7f428359e700 1 -- 172.21.15.8:0/3653690147 wait complete. 2023-10-14T16:54:51.197 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T16:54:51.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.318+0000 7f5abac3a700 1 Processor -- start 2023-10-14T16:54:51.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.318+0000 7f5abac3a700 1 -- start start 2023-10-14T16:54:51.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.318+0000 7f5abac3a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ab4096b50 0x7f5ab40a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.318+0000 7f5abac3a700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5ab413bc90 0x7f5ab413e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.318+0000 7f5abac3a700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab40972a0 con 0x7f5ab40a6990 2023-10-14T16:54:51.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.318+0000 7f5abac3a700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab4096120 con 0x7f5ab413bc90 2023-10-14T16:54:51.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.318+0000 7f5abac3a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4097000 con 0x7f5ab4096b50 2023-10-14T16:54:51.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.318+0000 7f5aba439700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5ab413bc90 0x7f5ab413e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.318+0000 7f5ab9c38700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5ab40a6990 0x7f5ab40a4b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41616/0 (socket says 172.21.15.8:41616) 2023-10-14T16:54:51.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.318+0000 7f5ab9c38700 1 -- 172.21.15.8:0/1864483814 learned_addr learned my addr 172.21.15.8:0/1864483814 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:51.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.319+0000 7f5ab9437700 1 --2- 172.21.15.8:0/1864483814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ab4096b50 0x7f5ab40a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.319+0000 7f5aba439700 1 -- 172.21.15.8:0/1864483814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ab4096b50 msgr2=0x7f5ab40a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:51.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.319+0000 7f5aba439700 1 --2- 172.21.15.8:0/1864483814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ab4096b50 0x7f5ab40a5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.319+0000 7f5aba439700 1 -- 172.21.15.8:0/1864483814 >> v1:172.21.15.8:6789/0 conn(0x7f5ab40a6990 legacy=0x7f5ab40a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.319+0000 7f5ab8c36700 1 -- 172.21.15.8:0/1864483814 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473576727 0 0) 0x7f5ab40972a0 con 0x7f5ab40a6990 2023-10-14T16:54:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.319+0000 7f5aba439700 1 -- 172.21.15.8:0/1864483814 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab40a4750 con 0x7f5ab413bc90 2023-10-14T16:54:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.319+0000 7f5aba439700 1 --2- 172.21.15.8:0/1864483814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab413bc90 0x7f5ab413e070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009e60 tx=0x7f5aa4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d13ddde92479ef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.319+0000 7f5ab8c36700 1 -- 172.21.15.8:0/1864483814 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa400e070 con 0x7f5ab413bc90 2023-10-14T16:54:51.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.319+0000 7f5ab8c36700 1 -- 172.21.15.8:0/1864483814 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa400bb60 con 0x7f5ab413bc90 2023-10-14T16:54:51.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.319+0000 7f5ab8c36700 1 -- 172.21.15.8:0/1864483814 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4012430 con 0x7f5ab413bc90 2023-10-14T16:54:51.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.320+0000 7f5abac3a700 1 -- 172.21.15.8:0/1864483814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab413bc90 msgr2=0x7f5ab413e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.320+0000 7f5abac3a700 1 --2- 172.21.15.8:0/1864483814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab413bc90 0x7f5ab413e070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009e60 tx=0x7f5aa4009780 comp rx=0 tx=0).stop 2023-10-14T16:54:51.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.320+0000 7f5abac3a700 1 -- 172.21.15.8:0/1864483814 shutdown_connections 2023-10-14T16:54:51.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.320+0000 7f5abac3a700 1 --2- 172.21.15.8:0/1864483814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab413bc90 0x7f5ab413e070 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.320+0000 7f5abac3a700 1 --2- 172.21.15.8:0/1864483814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ab4096b50 0x7f5ab40a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.320+0000 7f5abac3a700 1 -- 172.21.15.8:0/1864483814 >> 172.21.15.8:0/1864483814 conn(0x7f5ab406a840 msgr2=0x7f5ab40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:51.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.320+0000 7f5abac3a700 1 -- 172.21.15.8:0/1864483814 shutdown_connections 2023-10-14T16:54:51.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.320+0000 7f5abac3a700 1 -- 172.21.15.8:0/1864483814 wait complete. 2023-10-14T16:54:51.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5abac3a700 1 Processor -- start 2023-10-14T16:54:51.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5abac3a700 1 -- start start 2023-10-14T16:54:51.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5abac3a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab4096b50 0x7f5ab4146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5abac3a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab413bc90 0x7f5ab41466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5abac3a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ab409d2a0 0x7f5ab4146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5abac3a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab409a530 con 0x7f5ab413bc90 2023-10-14T16:54:51.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5abac3a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab409cbe0 con 0x7f5ab4096b50 2023-10-14T16:54:51.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5abac3a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab409c640 con 0x7f5ab409d2a0 2023-10-14T16:54:51.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5ab9437700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab413bc90 0x7f5ab41466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5ab9437700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab413bc90 0x7f5ab41466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58582/0 (socket says 172.21.15.8:58582) 2023-10-14T16:54:51.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5ab9437700 1 -- 172.21.15.8:0/963879107 learned_addr learned my addr 172.21.15.8:0/963879107 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:51.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5aba439700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ab409d2a0 0x7f5ab4146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5ab9c38700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab4096b50 0x7f5ab4146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5ab9437700 1 -- 172.21.15.8:0/963879107 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ab409d2a0 msgr2=0x7f5ab4146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5ab9437700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ab409d2a0 0x7f5ab4146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5ab9437700 1 -- 172.21.15.8:0/963879107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab4096b50 msgr2=0x7f5ab4146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5ab9437700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab4096b50 0x7f5ab4146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.321+0000 7f5ab9437700 1 -- 172.21.15.8:0/963879107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa4009a20 con 0x7f5ab413bc90 2023-10-14T16:54:51.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.322+0000 7f5ab9c38700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab4096b50 0x7f5ab4146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:54:51.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.322+0000 7f5ab9437700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab413bc90 0x7f5ab41466b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800ec80 tx=0x7f5aa80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:51.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.322+0000 7f5ab1ffb700 1 -- 172.21.15.8:0/963879107 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa800c850 con 0x7f5ab413bc90 2023-10-14T16:54:51.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.322+0000 7f5ab1ffb700 1 -- 172.21.15.8:0/963879107 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa800c9d0 con 0x7f5ab413bc90 2023-10-14T16:54:51.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.322+0000 7f5abac3a700 1 -- 172.21.15.8:0/963879107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab40a3110 con 0x7f5ab413bc90 2023-10-14T16:54:51.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.322+0000 7f5ab1ffb700 1 -- 172.21.15.8:0/963879107 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa800cd90 con 0x7f5ab413bc90 2023-10-14T16:54:51.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.322+0000 7f5abac3a700 1 -- 172.21.15.8:0/963879107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab409d830 con 0x7f5ab413bc90 2023-10-14T16:54:51.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.323+0000 7f5abac3a700 1 -- 172.21.15.8:0/963879107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab406ac10 con 0x7f5ab413bc90 2023-10-14T16:54:51.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.323+0000 7f5ab1ffb700 1 -- 172.21.15.8:0/963879107 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5aa8013680 con 0x7f5ab413bc90 2023-10-14T16:54:51.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.324+0000 7f5ab1ffb700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5aa0066f60 0x7f5aa0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.324+0000 7f5ab1ffb700 1 -- 172.21.15.8:0/963879107 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f5aa8083f30 con 0x7f5ab413bc90 2023-10-14T16:54:51.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.324+0000 7f5ab9c38700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5aa0066f60 0x7f5aa0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.324+0000 7f5ab9c38700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5aa0066f60 0x7f5aa0069410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0011e0 tx=0x7f5aac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:51.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.328+0000 7f5ab1ffb700 1 -- 172.21.15.8:0/963879107 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5aa8051a50 con 0x7f5ab413bc90 2023-10-14T16:54:51.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.519+0000 7f5abac3a700 1 -- 172.21.15.8:0/963879107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ab4135cb0 con 0x7f5ab413bc90 2023-10-14T16:54:51.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.519+0000 7f5ab1ffb700 1 -- 172.21.15.8:0/963879107 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v12) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5aa8055070 con 0x7f5ab413bc90 2023-10-14T16:54:51.587 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T16:54:51.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.521+0000 7f5abac3a700 1 -- 172.21.15.8:0/963879107 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5aa0066f60 msgr2=0x7f5aa0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.521+0000 7f5abac3a700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5aa0066f60 0x7f5aa0069410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0011e0 tx=0x7f5aac009040 comp rx=0 tx=0).stop 2023-10-14T16:54:51.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.521+0000 7f5abac3a700 1 -- 172.21.15.8:0/963879107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab413bc90 msgr2=0x7f5ab41466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.521+0000 7f5abac3a700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab413bc90 0x7f5ab41466b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800ec80 tx=0x7f5aa80091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.522+0000 7f5abac3a700 1 -- 172.21.15.8:0/963879107 shutdown_connections 2023-10-14T16:54:51.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.522+0000 7f5abac3a700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5aa0066f60 0x7f5aa0069410 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.522+0000 7f5abac3a700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ab409d2a0 0x7f5ab4146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.522+0000 7f5abac3a700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab4096b50 0x7f5ab4146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.522+0000 7f5abac3a700 1 --2- 172.21.15.8:0/963879107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ab413bc90 0x7f5ab41466b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.522+0000 7f5abac3a700 1 -- 172.21.15.8:0/963879107 >> 172.21.15.8:0/963879107 conn(0x7f5ab406a840 msgr2=0x7f5ab4133660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:51.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.522+0000 7f5abac3a700 1 -- 172.21.15.8:0/963879107 shutdown_connections 2023-10-14T16:54:51.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.522+0000 7f5abac3a700 1 -- 172.21.15.8:0/963879107 wait complete. 2023-10-14T16:54:51.591 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T16:54:51.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.713+0000 7f485d8b3700 1 Processor -- start 2023-10-14T16:54:51.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.713+0000 7f485d8b3700 1 -- start start 2023-10-14T16:54:51.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f485d8b3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580a1310 0x7f485813f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f485d8b3700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48580a2df0 con 0x7f48580a25c0 2023-10-14T16:54:51.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f485d8b3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4858133ae0 con 0x7f48580a6940 2023-10-14T16:54:51.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f485d8b3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48581338f0 con 0x7f48580a1310 2023-10-14T16:54:51.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f48567fc700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f48580a25c0 0x7f485813c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41628/0 (socket says 172.21.15.8:41628) 2023-10-14T16:54:51.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f48567fc700 1 -- 172.21.15.8:0/37591649 learned_addr learned my addr 172.21.15.8:0/37591649 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:51.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f48577fe700 1 --2- 172.21.15.8:0/37591649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580a1310 0x7f485813f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401455754 0 0) 0x7f48580a2df0 con 0x7f48580a25c0 2023-10-14T16:54:51.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4844003570 con 0x7f48580a25c0 2023-10-14T16:54:51.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 342630418 0 0) 0x7f4844003570 con 0x7f48580a25c0 2023-10-14T16:54:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580a1310 msgr2=0x7f485813f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f4855ffb700 1 --2- 172.21.15.8:0/37591649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580a1310 0x7f485813f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 >> v1:172.21.15.155:6789/0 conn(0x7f48580a6940 legacy=0x7f4858133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48580a1720 con 0x7f48580a25c0 2023-10-14T16:54:51.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f4840001470 con 0x7f48580a25c0 2023-10-14T16:54:51.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.714+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 >> v1:172.21.15.8:6789/0 conn(0x7f48580a25c0 legacy=0x7f485813c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f4855ffb700 1 --2- 172.21.15.8:0/37591649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580a1310 0x7f4844003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f4855ffb700 1 --2- 172.21.15.8:0/37591649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4844003fd0 0x7f4844004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f4855ffb700 1 --2- 172.21.15.8:0/37591649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4844004d50 0x7f48440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484400bb10 con 0x7f4844004d50 2023-10-14T16:54:51.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484400bc80 con 0x7f4844003fd0 2023-10-14T16:54:51.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484400be40 con 0x7f48580a1310 2023-10-14T16:54:51.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f48577fe700 1 --2- 172.21.15.8:0/37591649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4844004d50 0x7f48440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f4856ffd700 1 --2- 172.21.15.8:0/37591649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580a1310 0x7f4844003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f48567fc700 1 --2- 172.21.15.8:0/37591649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4844003fd0 0x7f4844004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f48577fe700 1 -- 172.21.15.8:0/37591649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580a1310 msgr2=0x7f4844003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:51.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f48577fe700 1 --2- 172.21.15.8:0/37591649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48580a1310 0x7f4844003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f48577fe700 1 -- 172.21.15.8:0/37591649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4844003fd0 msgr2=0x7f4844004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f48577fe700 1 --2- 172.21.15.8:0/37591649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4844003fd0 0x7f4844004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f48577fe700 1 -- 172.21.15.8:0/37591649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4844003570 con 0x7f4844004d50 2023-10-14T16:54:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f48577fe700 1 --2- 172.21.15.8:0/37591649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4844004d50 0x7f48440051c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f484800e210 tx=0x7f484800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbaa4b5563c954e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484800eac0 con 0x7f4844004d50 2023-10-14T16:54:51.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484800f040 con 0x7f4844004d50 2023-10-14T16:54:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.715+0000 7f4855ffb700 1 -- 172.21.15.8:0/37591649 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484800ee70 con 0x7f4844004d50 2023-10-14T16:54:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.716+0000 7f485d8b3700 1 -- 172.21.15.8:0/37591649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4844004d50 msgr2=0x7f48440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.716+0000 7f485d8b3700 1 --2- 172.21.15.8:0/37591649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4844004d50 0x7f48440051c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f484800e210 tx=0x7f484800b040 comp rx=0 tx=0).stop 2023-10-14T16:54:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.716+0000 7f48577fe700 1 -- 172.21.15.8:0/37591649 reap_dead start 2023-10-14T16:54:51.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.716+0000 7f485d8b3700 1 -- 172.21.15.8:0/37591649 shutdown_connections 2023-10-14T16:54:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.716+0000 7f485d8b3700 1 -- 172.21.15.8:0/37591649 >> 172.21.15.8:0/37591649 conn(0x7f485806acd0 msgr2=0x7f48580701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:51.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.716+0000 7f485d8b3700 1 -- 172.21.15.8:0/37591649 shutdown_connections 2023-10-14T16:54:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.716+0000 7f485d8b3700 1 -- 172.21.15.8:0/37591649 wait complete. 2023-10-14T16:54:51.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.717+0000 7f485d8b3700 1 Processor -- start 2023-10-14T16:54:51.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.717+0000 7f485d8b3700 1 -- start start 2023-10-14T16:54:51.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.717+0000 7f485d8b3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4844004d50 0x7f48580a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.717+0000 7f485d8b3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4858097740 0x7f4858146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.717+0000 7f485d8b3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4858146aa0 0x7f4858146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.717+0000 7f485d8b3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4858147430 con 0x7f4858097740 2023-10-14T16:54:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.717+0000 7f485d8b3700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4858099e60 con 0x7f4844004d50 2023-10-14T16:54:51.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.717+0000 7f485d8b3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4858095a70 con 0x7f4858146aa0 2023-10-14T16:54:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f48567fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4858097740 0x7f4858146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f48567fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4858097740 0x7f4858146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58592/0 (socket says 172.21.15.8:58592) 2023-10-14T16:54:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f48567fc700 1 -- 172.21.15.8:0/1166678389 learned_addr learned my addr 172.21.15.8:0/1166678389 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:51.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f48577fe700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4858146aa0 0x7f4858146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f4856ffd700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4844004d50 0x7f48580a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f48567fc700 1 -- 172.21.15.8:0/1166678389 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4858146aa0 msgr2=0x7f4858146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f48567fc700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4858146aa0 0x7f4858146ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f48567fc700 1 -- 172.21.15.8:0/1166678389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4844004d50 msgr2=0x7f48580a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f48567fc700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4844004d50 0x7f48580a04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f48567fc700 1 -- 172.21.15.8:0/1166678389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4858098b90 con 0x7f4858097740 2023-10-14T16:54:51.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f48567fc700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4858097740 0x7f4858146560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f48400073c0 tx=0x7f4858133c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:51.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f484effd700 1 -- 172.21.15.8:0/1166678389 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000f8d0 con 0x7f4858097740 2023-10-14T16:54:51.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f484effd700 1 -- 172.21.15.8:0/1166678389 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484000fa50 con 0x7f4858097740 2023-10-14T16:54:51.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f485d8b3700 1 -- 172.21.15.8:0/1166678389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4858098e50 con 0x7f4858097740 2023-10-14T16:54:51.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f484effd700 1 -- 172.21.15.8:0/1166678389 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000fe10 con 0x7f4858097740 2023-10-14T16:54:51.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.718+0000 7f485d8b3700 1 -- 172.21.15.8:0/1166678389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4858139070 con 0x7f4858097740 2023-10-14T16:54:51.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.719+0000 7f485d8b3700 1 -- 172.21.15.8:0/1166678389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48580708d0 con 0x7f4858097740 2023-10-14T16:54:51.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.720+0000 7f484effd700 1 -- 172.21.15.8:0/1166678389 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4840012560 con 0x7f4858097740 2023-10-14T16:54:51.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.720+0000 7f484effd700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4838066f30 0x7f48380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:51.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.720+0000 7f484effd700 1 -- 172.21.15.8:0/1166678389 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f48400838c0 con 0x7f4858097740 2023-10-14T16:54:51.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.720+0000 7f4856ffd700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4838066f30 0x7f48380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:51.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.720+0000 7f4856ffd700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4838066f30 0x7f48380693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4850003ad0 tx=0x7f4850009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:51.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.724+0000 7f484effd700 1 -- 172.21.15.8:0/1166678389 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48400513e0 con 0x7f4858097740 2023-10-14T16:54:51.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.918+0000 7f485d8b3700 1 -- 172.21.15.8:0/1166678389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f48580a1b90 con 0x7f4858097740 2023-10-14T16:54:51.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.919+0000 7f484effd700 1 -- 172.21.15.8:0/1166678389 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) v1 ==== 84+0+126 (secure 0 0 0) 0x7f484001a070 con 0x7f4858097740 2023-10-14T16:54:51.920 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:51.920 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2023-10-14T16:54:51.921 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T16:54:51.921 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2023-10-14T16:54:51.921 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": "rbd" 2023-10-14T16:54:51.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-14T16:54:51.922 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-14T16:54:51.922 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 2, 2023-10-14T16:54:51.922 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2023-10-14T16:54:51.922 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-14T16:54:51.922 INFO:teuthology.orchestra.run.smithi008.stdout:] 2023-10-14T16:54:51.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.921+0000 7f485d8b3700 1 -- 172.21.15.8:0/1166678389 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4838066f30 msgr2=0x7f48380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.921+0000 7f485d8b3700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4838066f30 0x7f48380693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4850003ad0 tx=0x7f4850009040 comp rx=0 tx=0).stop 2023-10-14T16:54:51.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.921+0000 7f485d8b3700 1 -- 172.21.15.8:0/1166678389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4858097740 msgr2=0x7f4858146560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:51.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.921+0000 7f485d8b3700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4858097740 0x7f4858146560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f48400073c0 tx=0x7f4858133c70 comp rx=0 tx=0).stop 2023-10-14T16:54:51.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.921+0000 7f485d8b3700 1 -- 172.21.15.8:0/1166678389 shutdown_connections 2023-10-14T16:54:51.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.921+0000 7f485d8b3700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4838066f30 0x7f48380693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.921+0000 7f485d8b3700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4858146aa0 0x7f4858146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.921+0000 7f485d8b3700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4844004d50 0x7f48580a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.921+0000 7f485d8b3700 1 --2- 172.21.15.8:0/1166678389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4858097740 0x7f4858146560 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:51.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.921+0000 7f485d8b3700 1 -- 172.21.15.8:0/1166678389 >> 172.21.15.8:0/1166678389 conn(0x7f485806acd0 msgr2=0x7f4858132d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:51.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.921+0000 7f485d8b3700 1 -- 172.21.15.8:0/1166678389 shutdown_connections 2023-10-14T16:54:51.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:51.921+0000 7f485d8b3700 1 -- 172.21.15.8:0/1166678389 wait complete. 2023-10-14T16:54:51.933 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T16:54:51.934 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T16:54:52.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.095+0000 7fb827161700 1 Processor -- start 2023-10-14T16:54:52.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.095+0000 7fb827161700 1 -- start start 2023-10-14T16:54:52.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb827161700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb8200a6690 0x7fb820133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:52.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb827161700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb820096f20 0x7fb8201342e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:52.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb827161700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8200a4850 0x7fb8200a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:52.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb827161700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb820133780 con 0x7fb820096f20 2023-10-14T16:54:52.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb827161700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8200962d0 con 0x7fb8200a6690 2023-10-14T16:54:52.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb827161700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb820095f40 con 0x7fb8200a4850 2023-10-14T16:54:52.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb81ffff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb820096f20 0x7fb8201342e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:52.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb81ffff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb820096f20 0x7fb8201342e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58598/0 (socket says 172.21.15.8:58598) 2023-10-14T16:54:52.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb81ffff700 1 -- 172.21.15.8:0/1462016903 learned_addr learned my addr 172.21.15.8:0/1462016903 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:52.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb81ffff700 1 -- 172.21.15.8:0/1462016903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8200a4850 msgr2=0x7fb8200a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:52.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb8256fe700 1 --2- 172.21.15.8:0/1462016903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8200a4850 0x7fb8200a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:52.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb824efd700 1 --2- 172.21.15.8:0/1462016903 >> v2:172.21.15.155:3300/0 conn(0x7fb8200a6690 0x7fb820133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:52.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb81ffff700 1 --2- 172.21.15.8:0/1462016903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8200a4850 0x7fb8200a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:52.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb81ffff700 1 -- 172.21.15.8:0/1462016903 >> v2:172.21.15.155:3300/0 conn(0x7fb8200a6690 msgr2=0x7fb820133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:52.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb81ffff700 1 --2- 172.21.15.8:0/1462016903 >> v2:172.21.15.155:3300/0 conn(0x7fb8200a6690 0x7fb820133da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:52.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb81ffff700 1 -- 172.21.15.8:0/1462016903 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb820097750 con 0x7fb820096f20 2023-10-14T16:54:52.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb8256fe700 1 --2- 172.21.15.8:0/1462016903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8200a4850 0x7fb8200a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:54:52.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb824efd700 1 --2- 172.21.15.8:0/1462016903 >> v2:172.21.15.155:3300/0 conn(0x7fb8200a6690 0x7fb820133da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:54:52.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.096+0000 7fb81ffff700 1 --2- 172.21.15.8:0/1462016903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb820096f20 0x7fb8201342e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb820064890 tx=0x7fb810009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e153a6e9709b339d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:52.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.097+0000 7fb81f7fe700 1 -- 172.21.15.8:0/1462016903 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000b820 con 0x7fb820096f20 2023-10-14T16:54:52.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.097+0000 7fb81f7fe700 1 -- 172.21.15.8:0/1462016903 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81000b980 con 0x7fb820096f20 2023-10-14T16:54:52.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.097+0000 7fb81f7fe700 1 -- 172.21.15.8:0/1462016903 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000bd20 con 0x7fb820096f20 2023-10-14T16:54:52.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.097+0000 7fb827161700 1 -- 172.21.15.8:0/1462016903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb820096f20 msgr2=0x7fb8201342e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:52.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.097+0000 7fb827161700 1 --2- 172.21.15.8:0/1462016903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb820096f20 0x7fb8201342e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb820064890 tx=0x7fb810009250 comp rx=0 tx=0).stop 2023-10-14T16:54:52.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.097+0000 7fb827161700 1 -- 172.21.15.8:0/1462016903 shutdown_connections 2023-10-14T16:54:52.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.097+0000 7fb827161700 1 --2- 172.21.15.8:0/1462016903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8200a4850 0x7fb8200a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:52.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.097+0000 7fb827161700 1 --2- 172.21.15.8:0/1462016903 >> v2:172.21.15.155:3300/0 conn(0x7fb8200a6690 0x7fb820133da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:52.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.097+0000 7fb827161700 1 --2- 172.21.15.8:0/1462016903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb820096f20 0x7fb8201342e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:52.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.097+0000 7fb827161700 1 -- 172.21.15.8:0/1462016903 >> 172.21.15.8:0/1462016903 conn(0x7fb82006abb0 msgr2=0x7fb8200701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:52.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.097+0000 7fb827161700 1 -- 172.21.15.8:0/1462016903 shutdown_connections 2023-10-14T16:54:52.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.097+0000 7fb827161700 1 -- 172.21.15.8:0/1462016903 wait complete. 2023-10-14T16:54:52.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.098+0000 7fb827161700 1 Processor -- start 2023-10-14T16:54:52.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.098+0000 7fb827161700 1 -- start start 2023-10-14T16:54:52.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb827161700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb820096f20 0x7fb820146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:52.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb827161700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8200a4850 0x7fb8201469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:52.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb827161700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb82009c850 0x7fb820146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:52.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb827161700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82009b620 con 0x7fb8200a4850 2023-10-14T16:54:52.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb827161700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82009c100 con 0x7fb82009c850 2023-10-14T16:54:52.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb827161700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82009bb60 con 0x7fb820096f20 2023-10-14T16:54:52.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb81ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8200a4850 0x7fb8201469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:52.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb81ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8200a4850 0x7fb8201469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58610/0 (socket says 172.21.15.8:58610) 2023-10-14T16:54:52.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb81ffff700 1 -- 172.21.15.8:0/1003787824 learned_addr learned my addr 172.21.15.8:0/1003787824 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:52.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb8256fe700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb82009c850 0x7fb820146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:52.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb824efd700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb820096f20 0x7fb820146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:52.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb81ffff700 1 -- 172.21.15.8:0/1003787824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb820096f20 msgr2=0x7fb820146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:52.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb81ffff700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb820096f20 0x7fb820146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:52.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb81ffff700 1 -- 172.21.15.8:0/1003787824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb82009c850 msgr2=0x7fb820146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:52.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb81ffff700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb82009c850 0x7fb820146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:52.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb81ffff700 1 -- 172.21.15.8:0/1003787824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8100094f0 con 0x7fb8200a4850 2023-10-14T16:54:52.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb824efd700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb820096f20 0x7fb820146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:54:52.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb81ffff700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8200a4850 0x7fb8201469c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb8100094c0 tx=0x7fb810017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:52.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb81cff9700 1 -- 172.21.15.8:0/1003787824 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810024440 con 0x7fb8200a4850 2023-10-14T16:54:52.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb81cff9700 1 -- 172.21.15.8:0/1003787824 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8100245c0 con 0x7fb8200a4850 2023-10-14T16:54:52.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb827161700 1 -- 172.21.15.8:0/1003787824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82009b850 con 0x7fb8200a4850 2023-10-14T16:54:52.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb81cff9700 1 -- 172.21.15.8:0/1003787824 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810024980 con 0x7fb8200a4850 2023-10-14T16:54:52.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.099+0000 7fb827161700 1 -- 172.21.15.8:0/1003787824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82009a9f0 con 0x7fb8200a4850 2023-10-14T16:54:52.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.100+0000 7fb827161700 1 -- 172.21.15.8:0/1003787824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb820099a10 con 0x7fb8200a4850 2023-10-14T16:54:52.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.101+0000 7fb81cff9700 1 -- 172.21.15.8:0/1003787824 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb81001a420 con 0x7fb8200a4850 2023-10-14T16:54:52.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.101+0000 7fb81cff9700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fb800066f30 0x7fb8000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:52.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.101+0000 7fb81cff9700 1 -- 172.21.15.8:0/1003787824 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fb810085a60 con 0x7fb8200a4850 2023-10-14T16:54:52.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.101+0000 7fb824efd700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fb800066f30 0x7fb8000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:52.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.101+0000 7fb824efd700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fb800066f30 0x7fb8000693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb81800e4c0 tx=0x7fb818007700 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:52.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.105+0000 7fb81cff9700 1 -- 172.21.15.8:0/1003787824 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb810053580 con 0x7fb8200a4850 2023-10-14T16:54:52.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:52.300+0000 7fb827161700 1 -- 172.21.15.8:0/1003787824 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb820099bf0 con 0x7fb8200a4850 2023-10-14T16:54:53.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.072+0000 7fb81cff9700 1 -- 172.21.15.8:0/1003787824 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v13) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb810015020 con 0x7fb8200a4850 2023-10-14T16:54:53.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.077+0000 7fb827161700 1 -- 172.21.15.8:0/1003787824 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fb800066f30 msgr2=0x7fb8000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:53.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.077+0000 7fb827161700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fb800066f30 0x7fb8000693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb81800e4c0 tx=0x7fb818007700 comp rx=0 tx=0).stop 2023-10-14T16:54:53.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.077+0000 7fb827161700 1 -- 172.21.15.8:0/1003787824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8200a4850 msgr2=0x7fb8201469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:53.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.077+0000 7fb827161700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8200a4850 0x7fb8201469c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb8100094c0 tx=0x7fb810017000 comp rx=0 tx=0).stop 2023-10-14T16:54:53.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.077+0000 7fb827161700 1 -- 172.21.15.8:0/1003787824 shutdown_connections 2023-10-14T16:54:53.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.077+0000 7fb827161700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fb800066f30 0x7fb8000693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:53.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.077+0000 7fb827161700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb82009c850 0x7fb820146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:53.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.077+0000 7fb827161700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb820096f20 0x7fb820146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:53.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.077+0000 7fb827161700 1 --2- 172.21.15.8:0/1003787824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8200a4850 0x7fb8201469c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:53.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.077+0000 7fb827161700 1 -- 172.21.15.8:0/1003787824 >> 172.21.15.8:0/1003787824 conn(0x7fb82006abb0 msgr2=0x7fb8200a7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:53.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.078+0000 7fb827161700 1 -- 172.21.15.8:0/1003787824 shutdown_connections 2023-10-14T16:54:53.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.078+0000 7fb827161700 1 -- 172.21.15.8:0/1003787824 wait complete. 2023-10-14T16:54:53.081 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2023-10-14T16:54:53.094 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T16:54:53.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.224+0000 7f4104752700 1 Processor -- start 2023-10-14T16:54:53.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.224+0000 7f4104752700 1 -- start start 2023-10-14T16:54:53.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.225+0000 7f4104752700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc130f10 0x7f40fc06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:53.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.225+0000 7f4104752700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc06d940 con 0x7f40fc138da0 2023-10-14T16:54:53.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.225+0000 7f4104752700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc06cd60 con 0x7f40fc0a6d20 2023-10-14T16:54:53.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.225+0000 7f4104752700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc06d730 con 0x7f40fc130f10 2023-10-14T16:54:53.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.225+0000 7f4102cef700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f40fc138da0 0x7f40fc13b180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41638/0 (socket says 172.21.15.8:41638) 2023-10-14T16:54:53.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.225+0000 7f4102cef700 1 -- 172.21.15.8:0/4189129778 learned_addr learned my addr 172.21.15.8:0/4189129778 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:53.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.225+0000 7f4101ced700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc130f10 0x7f40fc06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:53.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.225+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034017250 0 0) 0x7f40fc06d940 con 0x7f40fc138da0 2023-10-14T16:54:53.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.225+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40e4003570 con 0x7f40fc138da0 2023-10-14T16:54:53.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2255282820 0 0) 0x7f40e4003570 con 0x7f40fc138da0 2023-10-14T16:54:53.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc130f10 msgr2=0x7f40fc06d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:53.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc130f10 0x7f40fc06d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:53.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 >> v1:172.21.15.155:6789/0 conn(0x7f40fc0a6d20 legacy=0x7f40fc130800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:53.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc131340 con 0x7f40fc138da0 2023-10-14T16:54:53.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f40ec0017f0 con 0x7f40fc138da0 2023-10-14T16:54:53.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 >> v1:172.21.15.8:6789/0 conn(0x7f40fc138da0 legacy=0x7f40fc13b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:53.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40e4003a90 0x7f40e4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:53.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4004810 0x7f40e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:53.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc130f10 0x7f40e40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:53.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc06d730 con 0x7f40e4004810 2023-10-14T16:54:53.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e400bb60 con 0x7f40e4003a90 2023-10-14T16:54:53.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e400df30 con 0x7f40fc130f10 2023-10-14T16:54:53.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f4101ced700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4004810 0x7f40e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:53.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41024ee700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40e4003a90 0x7f40e4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:53.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f4102cef700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc130f10 0x7f40e40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:53.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f4101ced700 1 -- 172.21.15.8:0/4189129778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc130f10 msgr2=0x7f40e40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:53.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f4101ced700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc130f10 0x7f40e40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:53.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f4101ced700 1 -- 172.21.15.8:0/4189129778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40e4003a90 msgr2=0x7f40e4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:53.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f4101ced700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40e4003a90 0x7f40e4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:53.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f4101ced700 1 -- 172.21.15.8:0/4189129778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e4003570 con 0x7f40e4004810 2023-10-14T16:54:53.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f4102cef700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc130f10 0x7f40e40051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:54:53.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f4101ced700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4004810 0x7f40e4004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009c00 tx=0x7f40f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff41d8ae7aedc5e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:53.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f000e710 con 0x7f40e4004810 2023-10-14T16:54:53.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f000e870 con 0x7f40e4004810 2023-10-14T16:54:53.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.226+0000 7f41014ec700 1 -- 172.21.15.8:0/4189129778 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f000ec30 con 0x7f40e4004810 2023-10-14T16:54:53.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.227+0000 7f4104752700 1 -- 172.21.15.8:0/4189129778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4004810 msgr2=0x7f40e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.227+0000 7f4104752700 1 --2- 172.21.15.8:0/4189129778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4004810 0x7f40e4004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009c00 tx=0x7f40f00091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.227+0000 7f4102cef700 1 -- 172.21.15.8:0/4189129778 reap_dead start 2023-10-14T16:54:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.227+0000 7f4104752700 1 -- 172.21.15.8:0/4189129778 shutdown_connections 2023-10-14T16:54:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.227+0000 7f4104752700 1 -- 172.21.15.8:0/4189129778 >> 172.21.15.8:0/4189129778 conn(0x7f40fc0701c0 msgr2=0x7f40fc0705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.227+0000 7f4104752700 1 -- 172.21.15.8:0/4189129778 shutdown_connections 2023-10-14T16:54:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.227+0000 7f4104752700 1 -- 172.21.15.8:0/4189129778 wait complete. 2023-10-14T16:54:53.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f4104752700 1 Processor -- start 2023-10-14T16:54:53.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f4104752700 1 -- start start 2023-10-14T16:54:53.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f4104752700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4004810 0x7f40fc1422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:53.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f4104752700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc0a0920 0x7f40fc142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:53.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f4104752700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40fc142d60 0x7f40fc12d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:53.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f4104752700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc095a70 con 0x7f40e4004810 2023-10-14T16:54:53.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f4104752700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc135f70 con 0x7f40fc142d60 2023-10-14T16:54:53.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f4104752700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0a0f80 con 0x7f40fc0a0920 2023-10-14T16:54:53.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f41024ee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4004810 0x7f40fc1422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:53.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f41024ee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4004810 0x7f40fc1422e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58628/0 (socket says 172.21.15.8:58628) 2023-10-14T16:54:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f41024ee700 1 -- 172.21.15.8:0/991789436 learned_addr learned my addr 172.21.15.8:0/991789436 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f4102cef700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40fc142d60 0x7f40fc12d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.228+0000 7f4101ced700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc0a0920 0x7f40fc142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.229+0000 7f41024ee700 1 -- 172.21.15.8:0/991789436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc0a0920 msgr2=0x7f40fc142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.229+0000 7f41024ee700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc0a0920 0x7f40fc142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.229+0000 7f41024ee700 1 -- 172.21.15.8:0/991789436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40fc142d60 msgr2=0x7f40fc12d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.229+0000 7f41024ee700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40fc142d60 0x7f40fc12d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.229+0000 7f41024ee700 1 -- 172.21.15.8:0/991789436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc096d50 con 0x7f40e4004810 2023-10-14T16:54:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.229+0000 7f41024ee700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4004810 0x7f40fc1422e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f40f4002920 tx=0x7f40f4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.229+0000 7f40fa7fc700 1 -- 172.21.15.8:0/991789436 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4003410 con 0x7f40e4004810 2023-10-14T16:54:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.229+0000 7f40fa7fc700 1 -- 172.21.15.8:0/991789436 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f400f720 con 0x7f40e4004810 2023-10-14T16:54:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.229+0000 7f4104752700 1 -- 172.21.15.8:0/991789436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc1361a0 con 0x7f40e4004810 2023-10-14T16:54:53.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.229+0000 7f40fa7fc700 1 -- 172.21.15.8:0/991789436 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f400fac0 con 0x7f40e4004810 2023-10-14T16:54:53.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.229+0000 7f4104752700 1 -- 172.21.15.8:0/991789436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc137ba0 con 0x7f40e4004810 2023-10-14T16:54:53.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.230+0000 7f4104752700 1 -- 172.21.15.8:0/991789436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40fc097120 con 0x7f40e4004810 2023-10-14T16:54:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.230+0000 7f40fa7fc700 1 -- 172.21.15.8:0/991789436 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40f401c400 con 0x7f40e4004810 2023-10-14T16:54:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.231+0000 7f40fa7fc700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f40e8066f60 0x7f40e8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.231+0000 7f40fa7fc700 1 -- 172.21.15.8:0/991789436 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3848+0+0 (secure 0 0 0) 0x7f40f40842b0 con 0x7f40e4004810 2023-10-14T16:54:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.231+0000 7f4101ced700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f40e8066f60 0x7f40e8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.231+0000 7f4101ced700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f40e8066f60 0x7f40e8069410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f40f00091e0 tx=0x7f40f001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:53.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.235+0000 7f40fa7fc700 1 -- 172.21.15.8:0/991789436 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40f4051dd0 con 0x7f40e4004810 2023-10-14T16:54:53.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:53.429+0000 7f4104752700 1 -- 172.21.15.8:0/991789436 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f40fc095bc0 con 0x7f40e4004810 2023-10-14T16:54:54.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.079+0000 7f40fa7fc700 1 -- 172.21.15.8:0/991789436 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v14) v1 ==== 170+0+0 (secure 0 0 0) 0x7f40f40553f0 con 0x7f40e4004810 2023-10-14T16:54:54.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.083+0000 7f4104752700 1 -- 172.21.15.8:0/991789436 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f40e8066f60 msgr2=0x7f40e8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:54.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.083+0000 7f4104752700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f40e8066f60 0x7f40e8069410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f40f00091e0 tx=0x7f40f001a000 comp rx=0 tx=0).stop 2023-10-14T16:54:54.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.083+0000 7f4104752700 1 -- 172.21.15.8:0/991789436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4004810 msgr2=0x7f40fc1422e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:54.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.083+0000 7f4104752700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4004810 0x7f40fc1422e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f40f4002920 tx=0x7f40f4007d30 comp rx=0 tx=0).stop 2023-10-14T16:54:54.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.084+0000 7f4104752700 1 -- 172.21.15.8:0/991789436 shutdown_connections 2023-10-14T16:54:54.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.084+0000 7f4104752700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f40e8066f60 0x7f40e8069410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:54.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.084+0000 7f4104752700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40fc142d60 0x7f40fc12d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:54.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.084+0000 7f4104752700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40e4004810 0x7f40fc1422e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:54.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.084+0000 7f4104752700 1 --2- 172.21.15.8:0/991789436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40fc0a0920 0x7f40fc142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:54.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.084+0000 7f4104752700 1 -- 172.21.15.8:0/991789436 >> 172.21.15.8:0/991789436 conn(0x7f40fc0701c0 msgr2=0x7f40fc12ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:54.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.085+0000 7f4104752700 1 -- 172.21.15.8:0/991789436 shutdown_connections 2023-10-14T16:54:54.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.085+0000 7f4104752700 1 -- 172.21.15.8:0/991789436 wait complete. 2023-10-14T16:54:54.089 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2023-10-14T16:54:54.108 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T16:54:54.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.233+0000 7f1ca71c9700 1 Processor -- start 2023-10-14T16:54:54.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.233+0000 7f1ca71c9700 1 -- start start 2023-10-14T16:54:54.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.233+0000 7f1ca71c9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca0137990 0x7f1ca013c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:54.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.233+0000 7f1ca71c9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1ca013c5c0 0x7f1ca013e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:54.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.233+0000 7f1ca71c9700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca00a63b0 con 0x7f1ca0097210 2023-10-14T16:54:54.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.233+0000 7f1ca71c9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca0095a70 con 0x7f1ca013c5c0 2023-10-14T16:54:54.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.233+0000 7f1ca71c9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0136d90 con 0x7f1ca0137990 2023-10-14T16:54:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.233+0000 7f1ca4f65700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1ca0097210 0x7f1ca0137280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41648/0 (socket says 172.21.15.8:41648) 2023-10-14T16:54:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1ca4f65700 1 -- 172.21.15.8:0/969930261 learned_addr learned my addr 172.21.15.8:0/969930261 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1c9ffff700 1 --2- 172.21.15.8:0/969930261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca0137990 0x7f1ca013c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1ca5766700 1 --2- 172.21.15.8:0/969930261 >> v2:172.21.15.155:3300/0 conn(0x7f1ca013c5c0 0x7f1ca013e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1c9f7fe700 1 -- 172.21.15.8:0/969930261 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628971960 0 0) 0x7f1ca00a63b0 con 0x7f1ca0097210 2023-10-14T16:54:54.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1c9f7fe700 1 -- 172.21.15.8:0/969930261 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c90003570 con 0x7f1ca0097210 2023-10-14T16:54:54.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1c9f7fe700 1 -- 172.21.15.8:0/969930261 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4042799867 0 0) 0x7f1c90003570 con 0x7f1ca0097210 2023-10-14T16:54:54.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1c9ffff700 1 -- 172.21.15.8:0/969930261 >> v2:172.21.15.155:3300/0 conn(0x7f1ca013c5c0 msgr2=0x7f1ca013e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:54.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1c9ffff700 1 --2- 172.21.15.8:0/969930261 >> v2:172.21.15.155:3300/0 conn(0x7f1ca013c5c0 0x7f1ca013e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:54.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1c9ffff700 1 -- 172.21.15.8:0/969930261 >> v1:172.21.15.8:6789/0 conn(0x7f1ca0097210 legacy=0x7f1ca0137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1c9ffff700 1 -- 172.21.15.8:0/969930261 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0096520 con 0x7f1ca0137990 2023-10-14T16:54:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1ca5766700 1 --2- 172.21.15.8:0/969930261 >> v2:172.21.15.155:3300/0 conn(0x7f1ca013c5c0 0x7f1ca013e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1c9ffff700 1 --2- 172.21.15.8:0/969930261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca0137990 0x7f1ca013c080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0098e0 tx=0x7f1c8c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aeee51d084e3a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1c9f7fe700 1 -- 172.21.15.8:0/969930261 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94001470 con 0x7f1ca0137990 2023-10-14T16:54:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1c9f7fe700 1 -- 172.21.15.8:0/969930261 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c011420 con 0x7f1ca0137990 2023-10-14T16:54:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.234+0000 7f1c9f7fe700 1 -- 172.21.15.8:0/969930261 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c0117c0 con 0x7f1ca0137990 2023-10-14T16:54:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.235+0000 7f1ca71c9700 1 -- 172.21.15.8:0/969930261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca0137990 msgr2=0x7f1ca013c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.235+0000 7f1ca71c9700 1 --2- 172.21.15.8:0/969930261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca0137990 0x7f1ca013c080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0098e0 tx=0x7f1c8c0091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.235+0000 7f1ca71c9700 1 -- 172.21.15.8:0/969930261 shutdown_connections 2023-10-14T16:54:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.235+0000 7f1ca71c9700 1 --2- 172.21.15.8:0/969930261 >> v2:172.21.15.155:3300/0 conn(0x7f1ca013c5c0 0x7f1ca013e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:54.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.235+0000 7f1ca71c9700 1 --2- 172.21.15.8:0/969930261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca0137990 0x7f1ca013c080 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:54.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.235+0000 7f1ca71c9700 1 -- 172.21.15.8:0/969930261 >> 172.21.15.8:0/969930261 conn(0x7f1ca006ab90 msgr2=0x7f1ca00701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:54.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.235+0000 7f1ca71c9700 1 -- 172.21.15.8:0/969930261 shutdown_connections 2023-10-14T16:54:54.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.235+0000 7f1ca71c9700 1 -- 172.21.15.8:0/969930261 wait complete. 2023-10-14T16:54:54.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.236+0000 7f1ca71c9700 1 Processor -- start 2023-10-14T16:54:54.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.236+0000 7f1ca71c9700 1 -- start start 2023-10-14T16:54:54.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca71c9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ca0097210 0x7f1ca013af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:54.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca71c9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca0137990 0x7f1ca00977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:54.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca71c9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca013c5c0 0x7f1ca0097d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:54.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca71c9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca009a1c0 con 0x7f1ca0097210 2023-10-14T16:54:54.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca71c9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca009a620 con 0x7f1ca013c5c0 2023-10-14T16:54:54.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca71c9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00991b0 con 0x7f1ca0137990 2023-10-14T16:54:54.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca4f65700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ca0097210 0x7f1ca013af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:54.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca4f65700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ca0097210 0x7f1ca013af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58630/0 (socket says 172.21.15.8:58630) 2023-10-14T16:54:54.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca4f65700 1 -- 172.21.15.8:0/3943889683 learned_addr learned my addr 172.21.15.8:0/3943889683 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:54.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1c9ffff700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca0137990 0x7f1ca00977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:54.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca5766700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca013c5c0 0x7f1ca0097d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:54.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca4f65700 1 -- 172.21.15.8:0/3943889683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca0137990 msgr2=0x7f1ca00977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:54.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca4f65700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca0137990 0x7f1ca00977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:54.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca4f65700 1 -- 172.21.15.8:0/3943889683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca013c5c0 msgr2=0x7f1ca0097d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:54.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca4f65700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca013c5c0 0x7f1ca0097d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:54.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca4f65700 1 -- 172.21.15.8:0/3943889683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c98009a20 con 0x7f1ca0097210 2023-10-14T16:54:54.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca4f65700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ca0097210 0x7f1ca013af40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400cb90 tx=0x7f1c94001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:54.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1c9cff9700 1 -- 172.21.15.8:0/3943889683 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94007150 con 0x7f1ca0097210 2023-10-14T16:54:54.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1c9cff9700 1 -- 172.21.15.8:0/3943889683 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c940072d0 con 0x7f1ca0097210 2023-10-14T16:54:54.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca71c9700 1 -- 172.21.15.8:0/3943889683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c009420 con 0x7f1ca0097210 2023-10-14T16:54:54.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1c9cff9700 1 -- 172.21.15.8:0/3943889683 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94007690 con 0x7f1ca0097210 2023-10-14T16:54:54.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.237+0000 7f1ca71c9700 1 -- 172.21.15.8:0/3943889683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca0099ba0 con 0x7f1ca0097210 2023-10-14T16:54:54.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.238+0000 7f1ca71c9700 1 -- 172.21.15.8:0/3943889683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca009a460 con 0x7f1ca0097210 2023-10-14T16:54:54.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.239+0000 7f1c9cff9700 1 -- 172.21.15.8:0/3943889683 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c94004a40 con 0x7f1ca0097210 2023-10-14T16:54:54.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.239+0000 7f1c9cff9700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1c84066f30 0x7f1c840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:54.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.239+0000 7f1c9cff9700 1 -- 172.21.15.8:0/3943889683 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f1c94083790 con 0x7f1ca0097210 2023-10-14T16:54:54.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.239+0000 7f1c9ffff700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1c84066f30 0x7f1c840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:54.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.239+0000 7f1c9ffff700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1c84066f30 0x7f1c840693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0137d80 tx=0x7f1c8c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:54.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.243+0000 7f1c9cff9700 1 -- 172.21.15.8:0/3943889683 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c94051040 con 0x7f1ca0097210 2023-10-14T16:54:54.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:54.477+0000 7f1ca71c9700 1 -- 172.21.15.8:0/3943889683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1ca00708d0 con 0x7f1ca0097210 2023-10-14T16:54:55.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.096+0000 7f1c9cff9700 1 -- 172.21.15.8:0/3943889683 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1c940180c0 con 0x7f1ca0097210 2023-10-14T16:54:55.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.102+0000 7f1ca71c9700 1 -- 172.21.15.8:0/3943889683 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1c84066f30 msgr2=0x7f1c840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.102+0000 7f1ca71c9700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1c84066f30 0x7f1c840693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0137d80 tx=0x7f1c8c016000 comp rx=0 tx=0).stop 2023-10-14T16:54:55.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.102+0000 7f1ca71c9700 1 -- 172.21.15.8:0/3943889683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ca0097210 msgr2=0x7f1ca013af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.102+0000 7f1ca71c9700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ca0097210 0x7f1ca013af40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400cb90 tx=0x7f1c94001ab0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.103+0000 7f1ca71c9700 1 -- 172.21.15.8:0/3943889683 shutdown_connections 2023-10-14T16:54:55.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.103+0000 7f1ca71c9700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1c84066f30 0x7f1c840693e0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0137d80 tx=0x7f1c8c016000 comp rx=0 tx=0).stop 2023-10-14T16:54:55.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.103+0000 7f1ca71c9700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ca013c5c0 0x7f1ca0097d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.103+0000 7f1ca71c9700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ca0097210 0x7f1ca013af40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.103+0000 7f1ca71c9700 1 --2- 172.21.15.8:0/3943889683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca0137990 0x7f1ca00977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.103+0000 7f1ca71c9700 1 -- 172.21.15.8:0/3943889683 >> 172.21.15.8:0/3943889683 conn(0x7f1ca006ab90 msgr2=0x7f1ca0133700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:55.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.103+0000 7f1ca71c9700 1 -- 172.21.15.8:0/3943889683 shutdown_connections 2023-10-14T16:54:55.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.105+0000 7f1ca71c9700 1 -- 172.21.15.8:0/3943889683 wait complete. 2023-10-14T16:54:55.109 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 3 and data pool 4 2023-10-14T16:54:55.123 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T16:54:55.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.245+0000 7f93a6941700 1 Processor -- start 2023-10-14T16:54:55.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.245+0000 7f93a6941700 1 -- start start 2023-10-14T16:54:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f93a6941700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f93a00a9fa0 0x7f93a0133f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f93a6941700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a5340 0x7f93a013f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f93a6941700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a0133740 con 0x7f93a00a47b0 2023-10-14T16:54:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f93a6941700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a00a12a0 con 0x7f93a00a9fa0 2023-10-14T16:54:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f93a6941700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00a1bc0 con 0x7f93a00a5340 2023-10-14T16:54:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f939ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f93a00a9fa0 0x7f93a0133f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f93a4ede700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a5340 0x7f93a013f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f939ffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f93a00a9fa0 0x7f93a0133f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.8:34462/0 (socket says 172.21.15.8:34462) 2023-10-14T16:54:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f939ffff700 1 -- 172.21.15.8:0/3460856561 learned_addr learned my addr 172.21.15.8:0/3460856561 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f93a4ede700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a5340 0x7f93a013f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.8:59694/0 (socket says 172.21.15.8:59694) 2023-10-14T16:54:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f939f7fe700 1 --1- 172.21.15.8:0/3460856561 >> v1:172.21.15.155:6789/0 conn(0x7f93a00a47b0 0x7f93a00a4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.8:47452/0 (socket says 172.21.15.8:47452) 2023-10-14T16:54:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f939ffff700 1 -- 172.21.15.8:0/3460856561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a5340 msgr2=0x7f93a013f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f939ffff700 1 --2- 172.21.15.8:0/3460856561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a5340 0x7f93a013f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f939ffff700 1 -- 172.21.15.8:0/3460856561 >> v1:172.21.15.155:6789/0 conn(0x7f93a00a47b0 legacy=0x7f93a00a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f939ffff700 1 -- 172.21.15.8:0/3460856561 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a0133970 con 0x7f93a00a9fa0 2023-10-14T16:54:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.246+0000 7f93a4ede700 1 --2- 172.21.15.8:0/3460856561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a5340 0x7f93a013f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.247+0000 7f939ffff700 1 --2- 172.21.15.8:0/3460856561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a00a9fa0 0x7f93a0133f60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f93900099b0 tx=0x7f9390009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d90857340117056 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.247+0000 7f939effd700 1 -- 172.21.15.8:0/3460856561 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390009ea0 con 0x7f93a00a9fa0 2023-10-14T16:54:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.247+0000 7f939effd700 1 -- 172.21.15.8:0/3460856561 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939000b760 con 0x7f93a00a9fa0 2023-10-14T16:54:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.247+0000 7f939effd700 1 -- 172.21.15.8:0/3460856561 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000bb20 con 0x7f93a00a9fa0 2023-10-14T16:54:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.247+0000 7f93a6941700 1 -- 172.21.15.8:0/3460856561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a00a9fa0 msgr2=0x7f93a0133f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.247+0000 7f93a6941700 1 --2- 172.21.15.8:0/3460856561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a00a9fa0 0x7f93a0133f60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f93900099b0 tx=0x7f9390009250 comp rx=0 tx=0).stop 2023-10-14T16:54:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.247+0000 7f93a6941700 1 -- 172.21.15.8:0/3460856561 shutdown_connections 2023-10-14T16:54:55.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.247+0000 7f93a6941700 1 --2- 172.21.15.8:0/3460856561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a00a9fa0 0x7f93a0133f60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.247+0000 7f93a6941700 1 --2- 172.21.15.8:0/3460856561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a5340 0x7f93a013f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.247+0000 7f93a6941700 1 -- 172.21.15.8:0/3460856561 >> 172.21.15.8:0/3460856561 conn(0x7f93a006a960 msgr2=0x7f93a00701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.247+0000 7f93a6941700 1 -- 172.21.15.8:0/3460856561 shutdown_connections 2023-10-14T16:54:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.247+0000 7f93a6941700 1 -- 172.21.15.8:0/3460856561 wait complete. 2023-10-14T16:54:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.248+0000 7f93a6941700 1 Processor -- start 2023-10-14T16:54:55.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.248+0000 7f93a6941700 1 -- start start 2023-10-14T16:54:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a6941700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a47b0 0x7f93a0098c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a6941700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a00a5340 0x7f93a0099180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a6941700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a009d5b0 0x7f93a00996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a6941700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a009c460 con 0x7f93a009d5b0 2023-10-14T16:54:55.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a6941700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a009c690 con 0x7f93a00a5340 2023-10-14T16:54:55.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a6941700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00a0310 con 0x7f93a00a47b0 2023-10-14T16:54:55.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a4ede700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a009d5b0 0x7f93a00996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a4ede700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a009d5b0 0x7f93a00996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58632/0 (socket says 172.21.15.8:58632) 2023-10-14T16:54:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f939ffff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a47b0 0x7f93a0098c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a4ede700 1 -- 172.21.15.8:0/3769938712 learned_addr learned my addr 172.21.15.8:0/3769938712 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f939f7fe700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a00a5340 0x7f93a0099180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a4ede700 1 -- 172.21.15.8:0/3769938712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a47b0 msgr2=0x7f93a0098c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a4ede700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a47b0 0x7f93a0098c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a4ede700 1 -- 172.21.15.8:0/3769938712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a00a5340 msgr2=0x7f93a0099180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a4ede700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a00a5340 0x7f93a0099180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a4ede700 1 -- 172.21.15.8:0/3769938712 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9398009a20 con 0x7f93a009d5b0 2023-10-14T16:54:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f939ffff700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a47b0 0x7f93a0098c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:54:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.249+0000 7f93a4ede700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a009d5b0 0x7f93a00996c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9398009fc0 tx=0x7f939800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.250+0000 7f9397fff700 1 -- 172.21.15.8:0/3769938712 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939800cbd0 con 0x7f93a009d5b0 2023-10-14T16:54:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.250+0000 7f9397fff700 1 -- 172.21.15.8:0/3769938712 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939800f040 con 0x7f93a009d5b0 2023-10-14T16:54:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.250+0000 7f93a6941700 1 -- 172.21.15.8:0/3769938712 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93900094f0 con 0x7f93a009d5b0 2023-10-14T16:54:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.250+0000 7f9397fff700 1 -- 172.21.15.8:0/3769938712 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398014480 con 0x7f93a009d5b0 2023-10-14T16:54:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.250+0000 7f93a6941700 1 -- 172.21.15.8:0/3769938712 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a009cc10 con 0x7f93a009d5b0 2023-10-14T16:54:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.251+0000 7f93a6941700 1 -- 172.21.15.8:0/3769938712 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a009a110 con 0x7f93a009d5b0 2023-10-14T16:54:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.251+0000 7f9397fff700 1 -- 172.21.15.8:0/3769938712 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9398003020 con 0x7f93a009d5b0 2023-10-14T16:54:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.251+0000 7f9397fff700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9380066f30 0x7f93800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.252+0000 7f9397fff700 1 -- 172.21.15.8:0/3769938712 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f9398084950 con 0x7f93a009d5b0 2023-10-14T16:54:55.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.252+0000 7f939ffff700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9380066f30 0x7f93800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.252+0000 7f939ffff700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9380066f30 0x7f93800693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f93900099b0 tx=0x7f9390016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:55.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.256+0000 7f9397fff700 1 -- 172.21.15.8:0/3769938712 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9398052120 con 0x7f93a009d5b0 2023-10-14T16:54:55.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.449+0000 7f93a6941700 1 -- 172.21.15.8:0/3769938712 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93a009ce30 con 0x7f93a009d5b0 2023-10-14T16:54:55.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.450+0000 7f9397fff700 1 -- 172.21.15.8:0/3769938712 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12171 (secure 0 0 0) 0x7f9398055740 con 0x7f93a009d5b0 2023-10-14T16:54:55.451 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:55.452 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:54.478884+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-14T16:54:52.330193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-14T16:54:53.459270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:54:55.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.452+0000 7f93a6941700 1 -- 172.21.15.8:0/3769938712 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9380066f30 msgr2=0x7f93800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.452+0000 7f93a6941700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9380066f30 0x7f93800693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f93900099b0 tx=0x7f9390016000 comp rx=0 tx=0).stop 2023-10-14T16:54:55.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.452+0000 7f93a6941700 1 -- 172.21.15.8:0/3769938712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a009d5b0 msgr2=0x7f93a00996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.452+0000 7f93a6941700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a009d5b0 0x7f93a00996c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9398009fc0 tx=0x7f939800b040 comp rx=0 tx=0).stop 2023-10-14T16:54:55.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.453+0000 7f93a6941700 1 -- 172.21.15.8:0/3769938712 shutdown_connections 2023-10-14T16:54:55.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.453+0000 7f93a6941700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9380066f30 0x7f93800693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.453+0000 7f93a6941700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93a009d5b0 0x7f93a00996c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.453+0000 7f93a6941700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93a00a47b0 0x7f93a0098c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.453+0000 7f93a6941700 1 --2- 172.21.15.8:0/3769938712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a00a5340 0x7f93a0099180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.453+0000 7f93a6941700 1 -- 172.21.15.8:0/3769938712 >> 172.21.15.8:0/3769938712 conn(0x7f93a006a960 msgr2=0x7f93a00a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:55.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.453+0000 7f93a6941700 1 -- 172.21.15.8:0/3769938712 shutdown_connections 2023-10-14T16:54:55.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.453+0000 7f93a6941700 1 -- 172.21.15.8:0/3769938712 wait complete. 2023-10-14T16:54:55.466 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T16:54:55.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.583+0000 7f04f2dce700 1 Processor -- start 2023-10-14T16:54:55.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.583+0000 7f04f2dce700 1 -- start start 2023-10-14T16:54:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.583+0000 7f04f2dce700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f04ec0a6a70 0x7f04ec0a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.583+0000 7f04f2dce700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ec0a5180 0x7f04ec136970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.583+0000 7f04f2dce700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04ec0a5550 0x7f04ec136eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f2dce700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ec0a0d30 con 0x7f04ec0a6a70 2023-10-14T16:54:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f2dce700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ec0a4850 con 0x7f04ec0a5550 2023-10-14T16:54:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f2dce700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec0a2a40 con 0x7f04ec0a5180 2023-10-14T16:54:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f1dcc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f04ec0a6a70 0x7f04ec0a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f1dcc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f04ec0a6a70 0x7f04ec0a4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58634/0 (socket says 172.21.15.8:58634) 2023-10-14T16:54:55.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f1dcc700 1 -- 172.21.15.8:0/4262286883 learned_addr learned my addr 172.21.15.8:0/4262286883 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:55.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f15cb700 1 --2- 172.21.15.8:0/4262286883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ec0a5180 0x7f04ec136970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f25cd700 1 --2- 172.21.15.8:0/4262286883 >> v2:172.21.15.155:3300/0 conn(0x7f04ec0a5550 0x7f04ec136eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f1dcc700 1 -- 172.21.15.8:0/4262286883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ec0a5180 msgr2=0x7f04ec136970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:55.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f1dcc700 1 --2- 172.21.15.8:0/4262286883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ec0a5180 0x7f04ec136970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f1dcc700 1 -- 172.21.15.8:0/4262286883 >> v2:172.21.15.155:3300/0 conn(0x7f04ec0a5550 msgr2=0x7f04ec136eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f1dcc700 1 --2- 172.21.15.8:0/4262286883 >> v2:172.21.15.155:3300/0 conn(0x7f04ec0a5550 0x7f04ec136eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f1dcc700 1 -- 172.21.15.8:0/4262286883 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec0a18c0 con 0x7f04ec0a6a70 2023-10-14T16:54:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f25cd700 1 --2- 172.21.15.8:0/4262286883 >> v2:172.21.15.155:3300/0 conn(0x7f04ec0a5550 0x7f04ec136eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:54:55.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f1dcc700 1 --2- 172.21.15.8:0/4262286883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ec0a6a70 0x7f04ec0a4c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0a71d0 tx=0x7f04dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6696e608df80148 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f0dca700 1 -- 172.21.15.8:0/4262286883 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc00e070 con 0x7f04ec0a6a70 2023-10-14T16:54:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f0dca700 1 -- 172.21.15.8:0/4262286883 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc00ba50 con 0x7f04ec0a6a70 2023-10-14T16:54:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.584+0000 7f04f0dca700 1 -- 172.21.15.8:0/4262286883 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc0092e0 con 0x7f04ec0a6a70 2023-10-14T16:54:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.585+0000 7f04f2dce700 1 -- 172.21.15.8:0/4262286883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ec0a6a70 msgr2=0x7f04ec0a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.585+0000 7f04f2dce700 1 --2- 172.21.15.8:0/4262286883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ec0a6a70 0x7f04ec0a4c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0a71d0 tx=0x7f04dc009840 comp rx=0 tx=0).stop 2023-10-14T16:54:55.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.585+0000 7f04f2dce700 1 -- 172.21.15.8:0/4262286883 shutdown_connections 2023-10-14T16:54:55.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.585+0000 7f04f2dce700 1 --2- 172.21.15.8:0/4262286883 >> v2:172.21.15.155:3300/0 conn(0x7f04ec0a5550 0x7f04ec136eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.585+0000 7f04f2dce700 1 --2- 172.21.15.8:0/4262286883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ec0a6a70 0x7f04ec0a4c40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.585+0000 7f04f2dce700 1 --2- 172.21.15.8:0/4262286883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ec0a5180 0x7f04ec136970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.585+0000 7f04f2dce700 1 -- 172.21.15.8:0/4262286883 >> 172.21.15.8:0/4262286883 conn(0x7f04ec06a960 msgr2=0x7f04ec0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:55.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.585+0000 7f04f2dce700 1 -- 172.21.15.8:0/4262286883 shutdown_connections 2023-10-14T16:54:55.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.585+0000 7f04f2dce700 1 -- 172.21.15.8:0/4262286883 wait complete. 2023-10-14T16:54:55.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f2dce700 1 Processor -- start 2023-10-14T16:54:55.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f2dce700 1 -- start start 2023-10-14T16:54:55.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f2dce700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ec0a5180 0x7f04ec1357c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f2dce700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ec0a5550 0x7f04ec135d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f2dce700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ec09d5b0 0x7f04ec09a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f2dce700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec09c710 con 0x7f04ec0a5180 2023-10-14T16:54:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f2dce700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec09f220 con 0x7f04ec0a5550 2023-10-14T16:54:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f2dce700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec09db40 con 0x7f04ec09d5b0 2023-10-14T16:54:55.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f1dcc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ec0a5180 0x7f04ec1357c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f1dcc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ec0a5180 0x7f04ec1357c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58644/0 (socket says 172.21.15.8:58644) 2023-10-14T16:54:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f1dcc700 1 -- 172.21.15.8:0/3064875213 learned_addr learned my addr 172.21.15.8:0/3064875213 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f15cb700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ec0a5550 0x7f04ec135d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.586+0000 7f04f25cd700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ec09d5b0 0x7f04ec09a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.587+0000 7f04f1dcc700 1 -- 172.21.15.8:0/3064875213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ec09d5b0 msgr2=0x7f04ec09a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.587+0000 7f04f1dcc700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ec09d5b0 0x7f04ec09a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.587+0000 7f04f1dcc700 1 -- 172.21.15.8:0/3064875213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ec0a5550 msgr2=0x7f04ec135d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.587+0000 7f04f1dcc700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ec0a5550 0x7f04ec135d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.587+0000 7f04f1dcc700 1 -- 172.21.15.8:0/3064875213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc009ae0 con 0x7f04ec0a5180 2023-10-14T16:54:55.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.587+0000 7f04f1dcc700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ec0a5180 0x7f04ec1357c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009fd0 tx=0x7f04dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:55.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.587+0000 7f04e9ffb700 1 -- 172.21.15.8:0/3064875213 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc007610 con 0x7f04ec0a5180 2023-10-14T16:54:55.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.587+0000 7f04e9ffb700 1 -- 172.21.15.8:0/3064875213 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc007770 con 0x7f04ec0a5180 2023-10-14T16:54:55.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.587+0000 7f04f2dce700 1 -- 172.21.15.8:0/3064875213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ec09bb80 con 0x7f04ec0a5180 2023-10-14T16:54:55.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.587+0000 7f04e9ffb700 1 -- 172.21.15.8:0/3064875213 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc007b10 con 0x7f04ec0a5180 2023-10-14T16:54:55.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.587+0000 7f04f2dce700 1 -- 172.21.15.8:0/3064875213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ec136240 con 0x7f04ec0a5180 2023-10-14T16:54:55.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.588+0000 7f04f2dce700 1 -- 172.21.15.8:0/3064875213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ec09b990 con 0x7f04ec0a5180 2023-10-14T16:54:55.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.588+0000 7f04e9ffb700 1 -- 172.21.15.8:0/3064875213 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04dc01d420 con 0x7f04ec0a5180 2023-10-14T16:54:55.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.589+0000 7f04e9ffb700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f04d8066f60 0x7f04d8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.589+0000 7f04e9ffb700 1 -- 172.21.15.8:0/3064875213 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f04dc085bb0 con 0x7f04ec0a5180 2023-10-14T16:54:55.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.589+0000 7f04f15cb700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f04d8066f60 0x7f04d8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.589+0000 7f04f15cb700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f04d8066f60 0x7f04d8069410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0a8ed0 tx=0x7f04e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:55.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.593+0000 7f04e9ffb700 1 -- 172.21.15.8:0/3064875213 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04dc053430 con 0x7f04ec0a5180 2023-10-14T16:54:55.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.784+0000 7f04f2dce700 1 -- 172.21.15.8:0/3064875213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04ec06ad60 con 0x7f04ec0a5180 2023-10-14T16:54:55.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.785+0000 7f04e9ffb700 1 -- 172.21.15.8:0/3064875213 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12171 (secure 0 0 0) 0x7f04dc056a50 con 0x7f04ec0a5180 2023-10-14T16:54:55.786 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:55.787 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:54.478884+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-14T16:54:52.330193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-14T16:54:53.459270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:54:55.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.787+0000 7f04f2dce700 1 -- 172.21.15.8:0/3064875213 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f04d8066f60 msgr2=0x7f04d8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.787+0000 7f04f2dce700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f04d8066f60 0x7f04d8069410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0a8ed0 tx=0x7f04e0008040 comp rx=0 tx=0).stop 2023-10-14T16:54:55.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.787+0000 7f04f2dce700 1 -- 172.21.15.8:0/3064875213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ec0a5180 msgr2=0x7f04ec1357c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.787+0000 7f04f2dce700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ec0a5180 0x7f04ec1357c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009fd0 tx=0x7f04dc018000 comp rx=0 tx=0).stop 2023-10-14T16:54:55.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.787+0000 7f04f2dce700 1 -- 172.21.15.8:0/3064875213 shutdown_connections 2023-10-14T16:54:55.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.787+0000 7f04f2dce700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f04d8066f60 0x7f04d8069410 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.787+0000 7f04f2dce700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ec09d5b0 0x7f04ec09a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.787+0000 7f04f2dce700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ec0a5180 0x7f04ec1357c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.787+0000 7f04f2dce700 1 --2- 172.21.15.8:0/3064875213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ec0a5550 0x7f04ec135d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.787+0000 7f04f2dce700 1 -- 172.21.15.8:0/3064875213 >> 172.21.15.8:0/3064875213 conn(0x7f04ec06a960 msgr2=0x7f04ec0a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:55.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.787+0000 7f04f2dce700 1 -- 172.21.15.8:0/3064875213 shutdown_connections 2023-10-14T16:54:55.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.787+0000 7f04f2dce700 1 -- 172.21.15.8:0/3064875213 wait complete. 2023-10-14T16:54:55.800 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T16:54:55.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.921+0000 7f0edb9d6700 1 Processor -- start 2023-10-14T16:54:55.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.921+0000 7f0edb9d6700 1 -- start start 2023-10-14T16:54:55.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.921+0000 7f0edb9d6700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0ed4097210 0x7f0ed4137280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.921+0000 7f0edb9d6700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ed41377c0 0x7f0ed4133710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.921+0000 7f0edb9d6700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed4137c20 con 0x7f0ed4133c50 2023-10-14T16:54:55.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.921+0000 7f0edb9d6700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed40a63b0 con 0x7f0ed41377c0 2023-10-14T16:54:55.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.921+0000 7f0edb9d6700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed4095a70 con 0x7f0ed4097210 2023-10-14T16:54:55.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ed8f71700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ed41377c0 0x7f0ed4133710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ed9f73700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0ed4133c50 0x7f0ed413e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41656/0 (socket says 172.21.15.8:41656) 2023-10-14T16:54:55.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ed8f71700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ed41377c0 0x7f0ed4133710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58648/0 (socket says 172.21.15.8:58648) 2023-10-14T16:54:55.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ed9f73700 1 -- 172.21.15.8:0/1080875655 learned_addr learned my addr 172.21.15.8:0/1080875655 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:55.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ed9772700 1 --2- 172.21.15.8:0/1080875655 >> v2:172.21.15.155:3300/0 conn(0x7f0ed4097210 0x7f0ed4137280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ed8f71700 1 -- 172.21.15.8:0/1080875655 >> v2:172.21.15.155:3300/0 conn(0x7f0ed4097210 msgr2=0x7f0ed4137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ed8f71700 1 --2- 172.21.15.8:0/1080875655 >> v2:172.21.15.155:3300/0 conn(0x7f0ed4097210 0x7f0ed4137280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ed8f71700 1 -- 172.21.15.8:0/1080875655 >> v1:172.21.15.8:6789/0 conn(0x7f0ed4133c50 legacy=0x7f0ed413e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ed8f71700 1 -- 172.21.15.8:0/1080875655 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed4136d90 con 0x7f0ed41377c0 2023-10-14T16:54:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ecbfff700 1 -- 172.21.15.8:0/1080875655 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148488119 0 0) 0x7f0ed4137c20 con 0x7f0ed4133c50 2023-10-14T16:54:55.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ed8f71700 1 --2- 172.21.15.8:0/1080875655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed41377c0 0x7f0ed4133710 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40098e0 tx=0x7f0ec40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e2996267ff2d14 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:55.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ecbfff700 1 -- 172.21.15.8:0/1080875655 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4009e80 con 0x7f0ed41377c0 2023-10-14T16:54:55.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ecbfff700 1 -- 172.21.15.8:0/1080875655 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec400b820 con 0x7f0ed41377c0 2023-10-14T16:54:55.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.922+0000 7f0ecbfff700 1 -- 172.21.15.8:0/1080875655 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400bba0 con 0x7f0ed41377c0 2023-10-14T16:54:55.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.923+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1080875655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed41377c0 msgr2=0x7f0ed4133710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.923+0000 7f0edb9d6700 1 --2- 172.21.15.8:0/1080875655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed41377c0 0x7f0ed4133710 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40098e0 tx=0x7f0ec40091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.923+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1080875655 shutdown_connections 2023-10-14T16:54:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.923+0000 7f0edb9d6700 1 --2- 172.21.15.8:0/1080875655 >> v2:172.21.15.155:3300/0 conn(0x7f0ed4097210 0x7f0ed4137280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.923+0000 7f0edb9d6700 1 --2- 172.21.15.8:0/1080875655 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed41377c0 0x7f0ed4133710 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.923+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1080875655 >> 172.21.15.8:0/1080875655 conn(0x7f0ed406ab90 msgr2=0x7f0ed40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:55.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.923+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1080875655 shutdown_connections 2023-10-14T16:54:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.923+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1080875655 wait complete. 2023-10-14T16:54:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.924+0000 7f0edb9d6700 1 Processor -- start 2023-10-14T16:54:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.924+0000 7f0edb9d6700 1 -- start start 2023-10-14T16:54:55.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.924+0000 7f0edb9d6700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed4097210 0x7f0ed409e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.924+0000 7f0edb9d6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed4133c50 0x7f0ed4146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.924+0000 7f0edb9d6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed41377c0 0x7f0ed4147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.924+0000 7f0edb9d6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed409cb50 con 0x7f0ed41377c0 2023-10-14T16:54:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.924+0000 7f0edb9d6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40a7d40 con 0x7f0ed4133c50 2023-10-14T16:54:55.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.924+0000 7f0edb9d6700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed409f6a0 con 0x7f0ed4097210 2023-10-14T16:54:55.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.924+0000 7f0ed9f73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed41377c0 0x7f0ed4147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.924+0000 7f0ed9f73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed41377c0 0x7f0ed4147150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58654/0 (socket says 172.21.15.8:58654) 2023-10-14T16:54:55.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.924+0000 7f0ed9f73700 1 -- 172.21.15.8:0/1703893544 learned_addr learned my addr 172.21.15.8:0/1703893544 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:55.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0ed9772700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed4097210 0x7f0ed409e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0ed8f71700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed4133c50 0x7f0ed4146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0ed9f73700 1 -- 172.21.15.8:0/1703893544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed4097210 msgr2=0x7f0ed409e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0ed9f73700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed4097210 0x7f0ed409e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0ed9f73700 1 -- 172.21.15.8:0/1703893544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed4133c50 msgr2=0x7f0ed4146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:55.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0ed9f73700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed4133c50 0x7f0ed4146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:55.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0ed9f73700 1 -- 172.21.15.8:0/1703893544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4009420 con 0x7f0ed41377c0 2023-10-14T16:54:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0ed9f73700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed41377c0 0x7f0ed4147150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00ccc0 tx=0x7f0ecc001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0ec97fa700 1 -- 172.21.15.8:0/1703893544 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00a8a0 con 0x7f0ed41377c0 2023-10-14T16:54:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0ec97fa700 1 -- 172.21.15.8:0/1703893544 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc00aa00 con 0x7f0ed41377c0 2023-10-14T16:54:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1703893544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed4146950 con 0x7f0ed41377c0 2023-10-14T16:54:55.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0ec97fa700 1 -- 172.21.15.8:0/1703893544 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00adc0 con 0x7f0ed41377c0 2023-10-14T16:54:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.925+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1703893544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed4147690 con 0x7f0ed41377c0 2023-10-14T16:54:55.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.926+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1703893544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed40708d0 con 0x7f0ed41377c0 2023-10-14T16:54:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.926+0000 7f0ec97fa700 1 -- 172.21.15.8:0/1703893544 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ecc007300 con 0x7f0ed41377c0 2023-10-14T16:54:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.927+0000 7f0ec97fa700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0eb8066f30 0x7f0eb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.927+0000 7f0ec97fa700 1 -- 172.21.15.8:0/1703893544 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f0ecc084260 con 0x7f0ed41377c0 2023-10-14T16:54:55.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.927+0000 7f0ed9772700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0eb8066f30 0x7f0eb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.927+0000 7f0ed9772700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0eb8066f30 0x7f0eb80693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0006fd0 tx=0x7f0ed0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:55.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:55.931+0000 7f0ec97fa700 1 -- 172.21.15.8:0/1703893544 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ecc051ab0 con 0x7f0ed41377c0 2023-10-14T16:54:56.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:56.172+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1703893544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0ed409d1a0 con 0x7f0ed41377c0 2023-10-14T16:54:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.104+0000 7f0ec97fa700 1 -- 172.21.15.8:0/1703893544 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0ed409d1a0 con 0x7f0ed41377c0 2023-10-14T16:54:57.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.107+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1703893544 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0eb8066f30 msgr2=0x7f0eb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:57.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.107+0000 7f0edb9d6700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0eb8066f30 0x7f0eb80693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0006fd0 tx=0x7f0ed0008040 comp rx=0 tx=0).stop 2023-10-14T16:54:57.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.107+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1703893544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed41377c0 msgr2=0x7f0ed4147150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:57.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.107+0000 7f0edb9d6700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed41377c0 0x7f0ed4147150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00ccc0 tx=0x7f0ecc001a80 comp rx=0 tx=0).stop 2023-10-14T16:54:57.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.107+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1703893544 shutdown_connections 2023-10-14T16:54:57.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.107+0000 7f0edb9d6700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0eb8066f30 0x7f0eb80693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:57.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.107+0000 7f0edb9d6700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ed41377c0 0x7f0ed4147150 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:57.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.107+0000 7f0edb9d6700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed4097210 0x7f0ed409e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:57.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.107+0000 7f0edb9d6700 1 --2- 172.21.15.8:0/1703893544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed4133c50 0x7f0ed4146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:57.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.107+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1703893544 >> 172.21.15.8:0/1703893544 conn(0x7f0ed406ab90 msgr2=0x7f0ed40a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:57.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.107+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1703893544 shutdown_connections 2023-10-14T16:54:57.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.107+0000 7f0edb9d6700 1 -- 172.21.15.8:0/1703893544 wait complete. 2023-10-14T16:54:57.122 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T16:54:57.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.249+0000 7f21ca012700 1 Processor -- start 2023-10-14T16:54:57.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.249+0000 7f21ca012700 1 -- start start 2023-10-14T16:54:57.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21ca012700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f21c413d7a0 0x7f21c413fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:57.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21ca012700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c40a63b0 con 0x7f21c4137990 2023-10-14T16:54:57.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21ca012700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c4095a70 con 0x7f21c4097210 2023-10-14T16:54:57.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21ca012700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c4136d90 con 0x7f21c413d7a0 2023-10-14T16:54:57.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21c2ffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f21c4137990 0x7f21c413c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41670/0 (socket says 172.21.15.8:41670) 2023-10-14T16:54:57.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21c2ffd700 1 -- 172.21.15.8:0/1902375814 learned_addr learned my addr 172.21.15.8:0/1902375814 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:57.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21c3fff700 1 --2- 172.21.15.8:0/1902375814 >> v2:172.21.15.155:3300/0 conn(0x7f21c413d7a0 0x7f21c413fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:57.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679411647 0 0) 0x7f21c40a63b0 con 0x7f21c4137990 2023-10-14T16:54:57.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21ac003570 con 0x7f21c4137990 2023-10-14T16:54:57.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3256527330 0 0) 0x7f21ac003570 con 0x7f21c4137990 2023-10-14T16:54:57.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 >> v2:172.21.15.155:3300/0 conn(0x7f21c413d7a0 msgr2=0x7f21c413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:57.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21c27fc700 1 --2- 172.21.15.8:0/1902375814 >> v2:172.21.15.155:3300/0 conn(0x7f21c413d7a0 0x7f21c413fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:57.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 >> v1:172.21.15.155:6789/0 conn(0x7f21c4097210 legacy=0x7f21c4137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:57.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4096520 con 0x7f21c4137990 2023-10-14T16:54:57.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.250+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f21b8001470 con 0x7f21c4137990 2023-10-14T16:54:57.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 >> v1:172.21.15.8:6789/0 conn(0x7f21c4137990 legacy=0x7f21c413c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:57.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c27fc700 1 --2- 172.21.15.8:0/1902375814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21ac003a60 0x7f21ac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:57.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c27fc700 1 --2- 172.21.15.8:0/1902375814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21ac004810 0x7f21ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:57.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c27fc700 1 --2- 172.21.15.8:0/1902375814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21ac0051c0 0x7f21ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:57.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4136d90 con 0x7f21ac004810 2023-10-14T16:54:57.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac00c0e0 con 0x7f21ac003a60 2023-10-14T16:54:57.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac00c2a0 con 0x7f21ac0051c0 2023-10-14T16:54:57.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c2ffd700 1 --2- 172.21.15.8:0/1902375814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21ac004810 0x7f21ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:57.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c37fe700 1 --2- 172.21.15.8:0/1902375814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21ac003a60 0x7f21ac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:57.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c3fff700 1 --2- 172.21.15.8:0/1902375814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21ac0051c0 0x7f21ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:57.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c2ffd700 1 -- 172.21.15.8:0/1902375814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21ac0051c0 msgr2=0x7f21ac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:57.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c2ffd700 1 --2- 172.21.15.8:0/1902375814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21ac0051c0 0x7f21ac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:57.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c2ffd700 1 -- 172.21.15.8:0/1902375814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21ac003a60 msgr2=0x7f21ac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:57.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c2ffd700 1 --2- 172.21.15.8:0/1902375814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21ac003a60 0x7f21ac003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:57.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c2ffd700 1 -- 172.21.15.8:0/1902375814 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac003570 con 0x7f21ac004810 2023-10-14T16:54:57.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c3fff700 1 -- 172.21.15.8:0/1902375814 reap_dead start 2023-10-14T16:54:57.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c2ffd700 1 --2- 172.21.15.8:0/1902375814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21ac004810 0x7f21ac004c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f21b800c390 tx=0x7f21b8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b6063975cefb22 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:57.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800cbe0 con 0x7f21ac004810 2023-10-14T16:54:57.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800cd40 con 0x7f21ac004810 2023-10-14T16:54:57.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.251+0000 7f21c27fc700 1 -- 172.21.15.8:0/1902375814 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8005b70 con 0x7f21ac004810 2023-10-14T16:54:57.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.252+0000 7f21ca012700 1 -- 172.21.15.8:0/1902375814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21ac004810 msgr2=0x7f21ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:57.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.252+0000 7f21ca012700 1 --2- 172.21.15.8:0/1902375814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21ac004810 0x7f21ac004c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f21b800c390 tx=0x7f21b8001e70 comp rx=0 tx=0).stop 2023-10-14T16:54:57.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.252+0000 7f21ca012700 1 -- 172.21.15.8:0/1902375814 shutdown_connections 2023-10-14T16:54:57.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.252+0000 7f21ca012700 1 --2- 172.21.15.8:0/1902375814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21ac004810 0x7f21ac004c80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:57.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.252+0000 7f21ca012700 1 -- 172.21.15.8:0/1902375814 >> 172.21.15.8:0/1902375814 conn(0x7f21c406ab90 msgr2=0x7f21c40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:57.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.252+0000 7f21ca012700 1 -- 172.21.15.8:0/1902375814 shutdown_connections 2023-10-14T16:54:57.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.252+0000 7f21ca012700 1 -- 172.21.15.8:0/1902375814 wait complete. 2023-10-14T16:54:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.253+0000 7f21ca012700 1 Processor -- start 2023-10-14T16:54:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.253+0000 7f21ca012700 1 -- start start 2023-10-14T16:54:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.253+0000 7f21ca012700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21ac004810 0x7f21c412efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:57.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.253+0000 7f21ca012700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21c41365d0 0x7f21c412f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.253+0000 7f21ca012700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c412fa50 0x7f21c40a2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21ca012700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c412fea0 con 0x7f21c41365d0 2023-10-14T16:54:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21ca012700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4130ff0 con 0x7f21ac004810 2023-10-14T16:54:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21ca012700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c40a86d0 con 0x7f21c412fa50 2023-10-14T16:54:57.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21c2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21c41365d0 0x7f21c412f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21c2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21c41365d0 0x7f21c412f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58676/0 (socket says 172.21.15.8:58676) 2023-10-14T16:54:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21c2ffd700 1 -- 172.21.15.8:0/3354047467 learned_addr learned my addr 172.21.15.8:0/3354047467 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21c37fe700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21ac004810 0x7f21c412efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21c3fff700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c412fa50 0x7f21c40a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:57.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21c2ffd700 1 -- 172.21.15.8:0/3354047467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c412fa50 msgr2=0x7f21c40a2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:57.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21c2ffd700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c412fa50 0x7f21c40a2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:57.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21c2ffd700 1 -- 172.21.15.8:0/3354047467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21ac004810 msgr2=0x7f21c412efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:57.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21c2ffd700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21ac004810 0x7f21c412efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:57.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21c2ffd700 1 -- 172.21.15.8:0/3354047467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4131400 con 0x7f21c41365d0 2023-10-14T16:54:57.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21c2ffd700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21c41365d0 0x7f21c412f510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21b8000e40 tx=0x7f21b8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21ab7fe700 1 -- 172.21.15.8:0/3354047467 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8022070 con 0x7f21c41365d0 2023-10-14T16:54:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21ab7fe700 1 -- 172.21.15.8:0/3354047467 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800ceb0 con 0x7f21c41365d0 2023-10-14T16:54:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21ca012700 1 -- 172.21.15.8:0/3354047467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c41320f0 con 0x7f21c41365d0 2023-10-14T16:54:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21ab7fe700 1 -- 172.21.15.8:0/3354047467 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8001b90 con 0x7f21c41365d0 2023-10-14T16:54:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.254+0000 7f21ca012700 1 -- 172.21.15.8:0/3354047467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c4133850 con 0x7f21c41365d0 2023-10-14T16:54:57.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.255+0000 7f21ca012700 1 -- 172.21.15.8:0/3354047467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c412eb60 con 0x7f21c41365d0 2023-10-14T16:54:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.255+0000 7f21ab7fe700 1 -- 172.21.15.8:0/3354047467 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21b8007070 con 0x7f21c41365d0 2023-10-14T16:54:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.256+0000 7f21ab7fe700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f21b0066f60 0x7f21b0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.256+0000 7f21ab7fe700 1 -- 172.21.15.8:0/3354047467 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f21b8084d40 con 0x7f21c41365d0 2023-10-14T16:54:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.256+0000 7f21c37fe700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f21b0066f60 0x7f21b0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:57.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.256+0000 7f21c37fe700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f21b0066f60 0x7f21b0069410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f21c40700e0 tx=0x7f21b4007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:57.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.260+0000 7f21ab7fe700 1 -- 172.21.15.8:0/3354047467 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21b8052510 con 0x7f21c41365d0 2023-10-14T16:54:57.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:57.502+0000 7f21ca012700 1 -- 172.21.15.8:0/3354047467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f21c412eb60 con 0x7f21c41365d0 2023-10-14T16:54:58.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.108+0000 7f21ab7fe700 1 -- 172.21.15.8:0/3354047467 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f21b8017070 con 0x7f21c41365d0 2023-10-14T16:54:58.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.111+0000 7f21ca012700 1 -- 172.21.15.8:0/3354047467 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f21b0066f60 msgr2=0x7f21b0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.111+0000 7f21ca012700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f21b0066f60 0x7f21b0069410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f21c40700e0 tx=0x7f21b4007d10 comp rx=0 tx=0).stop 2023-10-14T16:54:58.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.111+0000 7f21ca012700 1 -- 172.21.15.8:0/3354047467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21c41365d0 msgr2=0x7f21c412f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.111+0000 7f21ca012700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21c41365d0 0x7f21c412f510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21b8000e40 tx=0x7f21b8015000 comp rx=0 tx=0).stop 2023-10-14T16:54:58.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.111+0000 7f21ca012700 1 -- 172.21.15.8:0/3354047467 shutdown_connections 2023-10-14T16:54:58.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.111+0000 7f21ca012700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f21b0066f60 0x7f21b0069410 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.111+0000 7f21ca012700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c412fa50 0x7f21c40a2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.111+0000 7f21ca012700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21ac004810 0x7f21c412efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.111+0000 7f21ca012700 1 --2- 172.21.15.8:0/3354047467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21c41365d0 0x7f21c412f510 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.111+0000 7f21ca012700 1 -- 172.21.15.8:0/3354047467 >> 172.21.15.8:0/3354047467 conn(0x7f21c406ab90 msgr2=0x7f21c412dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:58.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.112+0000 7f21ca012700 1 -- 172.21.15.8:0/3354047467 shutdown_connections 2023-10-14T16:54:58.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.112+0000 7f21ca012700 1 -- 172.21.15.8:0/3354047467 wait complete. 2023-10-14T16:54:58.127 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T16:54:58.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.252+0000 7fcc60ec4700 1 Processor -- start 2023-10-14T16:54:58.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.252+0000 7fcc60ec4700 1 -- start start 2023-10-14T16:54:58.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.252+0000 7fcc60ec4700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcc5c0a1310 0x7fcc5c13f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.252+0000 7fcc60ec4700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c0a2df0 con 0x7fcc5c0a6940 2023-10-14T16:54:58.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.252+0000 7fcc60ec4700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c133ae0 con 0x7fcc5c0a25c0 2023-10-14T16:54:58.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.252+0000 7fcc60ec4700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c1338f0 con 0x7fcc5c0a1310 2023-10-14T16:54:58.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.252+0000 7fcc5ad9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcc5c0a1310 0x7fcc5c13f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.252+0000 7fcc5a59c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fcc5c0a6940 0x7fcc5c133f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42316/0 (socket says 172.21.15.8:42316) 2023-10-14T16:54:58.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.253+0000 7fcc5a59c700 1 -- 172.21.15.8:0/2104937369 learned_addr learned my addr 172.21.15.8:0/2104937369 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:58.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.253+0000 7fcc5ad9d700 1 --2- 172.21.15.8:0/2104937369 >> v2:172.21.15.8:3300/0 conn(0x7fcc5c0a1310 0x7fcc5c13f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53136/0 (socket says 172.21.15.8:53136) 2023-10-14T16:54:58.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.253+0000 7fcc5ad9d700 1 -- 172.21.15.8:0/2104937369 >> v1:172.21.15.155:6789/0 conn(0x7fcc5c0a25c0 legacy=0x7fcc5c13c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.253+0000 7fcc5ad9d700 1 -- 172.21.15.8:0/2104937369 >> v1:172.21.15.8:6789/0 conn(0x7fcc5c0a6940 legacy=0x7fcc5c133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.253+0000 7fcc5ad9d700 1 -- 172.21.15.8:0/2104937369 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0a1720 con 0x7fcc5c0a1310 2023-10-14T16:54:58.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.253+0000 7fcc5959a700 1 -- 172.21.15.8:0/2104937369 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016996687 0 0) 0x7fcc5c0a2df0 con 0x7fcc5c0a6940 2023-10-14T16:54:58.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.253+0000 7fcc5ad9d700 1 --2- 172.21.15.8:0/2104937369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc5c0a1310 0x7fcc5c13f8d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009e60 tx=0x7fcc54009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f44c43e5a7a083 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:58.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.253+0000 7fcc5959a700 1 -- 172.21.15.8:0/2104937369 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400e070 con 0x7fcc5c0a1310 2023-10-14T16:54:58.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.253+0000 7fcc5959a700 1 -- 172.21.15.8:0/2104937369 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5400bc30 con 0x7fcc5c0a1310 2023-10-14T16:54:58.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.253+0000 7fcc5959a700 1 -- 172.21.15.8:0/2104937369 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54012430 con 0x7fcc5c0a1310 2023-10-14T16:54:58.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.254+0000 7fcc60ec4700 1 -- 172.21.15.8:0/2104937369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc5c0a1310 msgr2=0x7fcc5c13f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.254+0000 7fcc60ec4700 1 --2- 172.21.15.8:0/2104937369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc5c0a1310 0x7fcc5c13f8d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009e60 tx=0x7fcc54009780 comp rx=0 tx=0).stop 2023-10-14T16:54:58.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.254+0000 7fcc60ec4700 1 -- 172.21.15.8:0/2104937369 shutdown_connections 2023-10-14T16:54:58.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.254+0000 7fcc60ec4700 1 --2- 172.21.15.8:0/2104937369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc5c0a1310 0x7fcc5c13f8d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.254+0000 7fcc60ec4700 1 -- 172.21.15.8:0/2104937369 >> 172.21.15.8:0/2104937369 conn(0x7fcc5c06acd0 msgr2=0x7fcc5c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:58.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.254+0000 7fcc60ec4700 1 -- 172.21.15.8:0/2104937369 shutdown_connections 2023-10-14T16:54:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.254+0000 7fcc60ec4700 1 -- 172.21.15.8:0/2104937369 wait complete. 2023-10-14T16:54:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc60ec4700 1 Processor -- start 2023-10-14T16:54:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc60ec4700 1 -- start start 2023-10-14T16:54:58.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc60ec4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc5c0a1310 0x7fcc5c095b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc60ec4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc5c0a25c0 0x7fcc5c096050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc60ec4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc5c0a9ad0 0x7fcc5c096590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc60ec4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0aa470 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc60ec4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0aa230 con 0x7fcc5c0a25c0 2023-10-14T16:54:58.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc60ec4700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c096de0 con 0x7fcc5c0a1310 2023-10-14T16:54:58.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc5ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc5c0a9ad0 0x7fcc5c096590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc5ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc5c0a9ad0 0x7fcc5c096590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53142/0 (socket says 172.21.15.8:53142) 2023-10-14T16:54:58.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc5ad9d700 1 -- 172.21.15.8:0/746373680 learned_addr learned my addr 172.21.15.8:0/746373680 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:58.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc5a59c700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc5c0a1310 0x7fcc5c095b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.255+0000 7fcc59d9b700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc5c0a25c0 0x7fcc5c096050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.256+0000 7fcc5ad9d700 1 -- 172.21.15.8:0/746373680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc5c0a1310 msgr2=0x7fcc5c095b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.256+0000 7fcc5ad9d700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc5c0a1310 0x7fcc5c095b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.256+0000 7fcc5ad9d700 1 -- 172.21.15.8:0/746373680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc5c0a25c0 msgr2=0x7fcc5c096050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.256+0000 7fcc5ad9d700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc5c0a25c0 0x7fcc5c096050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.256+0000 7fcc5ad9d700 1 -- 172.21.15.8:0/746373680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc54009a20 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.256+0000 7fcc5ad9d700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc5c0a9ad0 0x7fcc5c096590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcc54013000 tx=0x7fcc54019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:58.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.256+0000 7fcc4a7fc700 1 -- 172.21.15.8:0/746373680 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54012e10 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.256+0000 7fcc4a7fc700 1 -- 172.21.15.8:0/746373680 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5401d630 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.256+0000 7fcc60ec4700 1 -- 172.21.15.8:0/746373680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c097650 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.256+0000 7fcc4a7fc700 1 -- 172.21.15.8:0/746373680 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5401d9f0 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.256+0000 7fcc60ec4700 1 -- 172.21.15.8:0/746373680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c099030 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.257+0000 7fcc60ec4700 1 -- 172.21.15.8:0/746373680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c133440 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.257+0000 7fcc4a7fc700 1 -- 172.21.15.8:0/746373680 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc54024070 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.258+0000 7fcc4a7fc700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcc3c066f30 0x7fcc3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.258+0000 7fcc4a7fc700 1 -- 172.21.15.8:0/746373680 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fcc540867a0 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.258+0000 7fcc5a59c700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcc3c066f30 0x7fcc3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.258+0000 7fcc5a59c700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcc3c066f30 0x7fcc3c0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c007fd0 tx=0x7fcc4c007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:58.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.262+0000 7fcc4a7fc700 1 -- 172.21.15.8:0/746373680 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc54053f70 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.498+0000 7fcc60ec4700 1 -- 172.21.15.8:0/746373680 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc5c0708d0 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.499+0000 7fcc4a7fc700 1 -- 172.21.15.8:0/746373680 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3079 (secure 0 0 0) 0x7fcc54057590 con 0x7fcc5c0a9ad0 2023-10-14T16:54:58.500 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:58.501 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6817/3883908964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3883908964},{"type":"v1","addr":"172.21.15.155:6817","nonce":3883908964}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T16:54:54.479174+0000","modified":"2023-10-14T16:54:58.104119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.8:6819/3402040876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3402040876},{"type":"v1","addr":"172.21.15.8:6819","nonce":3402040876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T16:54:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.501+0000 7fcc60ec4700 1 -- 172.21.15.8:0/746373680 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcc3c066f30 msgr2=0x7fcc3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.501+0000 7fcc60ec4700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcc3c066f30 0x7fcc3c0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c007fd0 tx=0x7fcc4c007d30 comp rx=0 tx=0).stop 2023-10-14T16:54:58.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.501+0000 7fcc60ec4700 1 -- 172.21.15.8:0/746373680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc5c0a9ad0 msgr2=0x7fcc5c096590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.501+0000 7fcc60ec4700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc5c0a9ad0 0x7fcc5c096590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcc54013000 tx=0x7fcc54019000 comp rx=0 tx=0).stop 2023-10-14T16:54:58.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.501+0000 7fcc60ec4700 1 -- 172.21.15.8:0/746373680 shutdown_connections 2023-10-14T16:54:58.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.501+0000 7fcc60ec4700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcc3c066f30 0x7fcc3c0693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.501+0000 7fcc60ec4700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc5c0a9ad0 0x7fcc5c096590 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.501+0000 7fcc60ec4700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc5c0a1310 0x7fcc5c095b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.501+0000 7fcc60ec4700 1 --2- 172.21.15.8:0/746373680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc5c0a25c0 0x7fcc5c096050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.501+0000 7fcc60ec4700 1 -- 172.21.15.8:0/746373680 >> 172.21.15.8:0/746373680 conn(0x7fcc5c06acd0 msgr2=0x7fcc5c130a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:58.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.501+0000 7fcc60ec4700 1 -- 172.21.15.8:0/746373680 shutdown_connections 2023-10-14T16:54:58.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.501+0000 7fcc60ec4700 1 -- 172.21.15.8:0/746373680 wait complete. 2023-10-14T16:54:58.505 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T16:54:58.514 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T16:54:58.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.632+0000 7f5d58e7e700 1 Processor -- start 2023-10-14T16:54:58.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.632+0000 7f5d58e7e700 1 -- start start 2023-10-14T16:54:58.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.632+0000 7f5d58e7e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5d540a6550 0x7f5d54133e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.632+0000 7f5d58e7e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d54137b70 con 0x7f5d54111f90 2023-10-14T16:54:58.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.632+0000 7f5d58e7e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d54133940 con 0x7f5d540a6920 2023-10-14T16:54:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.632+0000 7f5d58e7e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d54133750 con 0x7f5d540a6550 2023-10-14T16:54:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.632+0000 7f5d5259c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5d540a6550 0x7f5d54133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.632+0000 7f5d52d9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5d54111f90 0x7f5d54137460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42326/0 (socket says 172.21.15.8:42326) 2023-10-14T16:54:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.632+0000 7f5d5259c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5d540a6550 0x7f5d54133e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53148/0 (socket says 172.21.15.8:53148) 2023-10-14T16:54:58.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.632+0000 7f5d52d9d700 1 -- 172.21.15.8:0/820120398 learned_addr learned my addr 172.21.15.8:0/820120398 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:58.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.633+0000 7f5d5259c700 1 -- 172.21.15.8:0/820120398 >> v1:172.21.15.155:6789/0 conn(0x7f5d540a6920 legacy=0x7f5d54136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.633+0000 7f5d5259c700 1 -- 172.21.15.8:0/820120398 >> v1:172.21.15.8:6789/0 conn(0x7f5d54111f90 legacy=0x7f5d54137460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.633+0000 7f5d5259c700 1 -- 172.21.15.8:0/820120398 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54133be0 con 0x7f5d540a6550 2023-10-14T16:54:58.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.633+0000 7f5d5159a700 1 -- 172.21.15.8:0/820120398 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510340866 0 0) 0x7f5d54137b70 con 0x7f5d54111f90 2023-10-14T16:54:58.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.633+0000 7f5d5259c700 1 --2- 172.21.15.8:0/820120398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540a6550 0x7f5d54133e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009e60 tx=0x7f5d44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0551989c4ae6614 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.633+0000 7f5d5159a700 1 -- 172.21.15.8:0/820120398 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400e070 con 0x7f5d540a6550 2023-10-14T16:54:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.633+0000 7f5d5159a700 1 -- 172.21.15.8:0/820120398 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4400bc30 con 0x7f5d540a6550 2023-10-14T16:54:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.633+0000 7f5d5159a700 1 -- 172.21.15.8:0/820120398 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44012430 con 0x7f5d540a6550 2023-10-14T16:54:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.634+0000 7f5d58e7e700 1 -- 172.21.15.8:0/820120398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540a6550 msgr2=0x7f5d54133e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.634+0000 7f5d58e7e700 1 --2- 172.21.15.8:0/820120398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540a6550 0x7f5d54133e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009e60 tx=0x7f5d44009780 comp rx=0 tx=0).stop 2023-10-14T16:54:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.634+0000 7f5d58e7e700 1 -- 172.21.15.8:0/820120398 shutdown_connections 2023-10-14T16:54:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.634+0000 7f5d58e7e700 1 --2- 172.21.15.8:0/820120398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540a6550 0x7f5d54133e70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.634+0000 7f5d58e7e700 1 -- 172.21.15.8:0/820120398 >> 172.21.15.8:0/820120398 conn(0x7f5d5406ac40 msgr2=0x7f5d540701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:58.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.634+0000 7f5d58e7e700 1 -- 172.21.15.8:0/820120398 shutdown_connections 2023-10-14T16:54:58.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.634+0000 7f5d58e7e700 1 -- 172.21.15.8:0/820120398 wait complete. 2023-10-14T16:54:58.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d58e7e700 1 Processor -- start 2023-10-14T16:54:58.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d58e7e700 1 -- start start 2023-10-14T16:54:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d58e7e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d540a6550 0x7f5d54135190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d58e7e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540a6920 0x7f5d541356d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d58e7e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d54111f90 0x7f5d54135c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d58e7e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54115530 con 0x7f5d540a6920 2023-10-14T16:54:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d58e7e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54136720 con 0x7f5d54111f90 2023-10-14T16:54:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d58e7e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54115740 con 0x7f5d540a6550 2023-10-14T16:54:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d51d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540a6920 0x7f5d541356d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d51d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540a6920 0x7f5d541356d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53154/0 (socket says 172.21.15.8:53154) 2023-10-14T16:54:58.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d51d9b700 1 -- 172.21.15.8:0/28895827 learned_addr learned my addr 172.21.15.8:0/28895827 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d5259c700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d540a6550 0x7f5d54135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d52d9d700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d54111f90 0x7f5d54135c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d51d9b700 1 -- 172.21.15.8:0/28895827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d540a6550 msgr2=0x7f5d54135190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d51d9b700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d540a6550 0x7f5d54135190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d51d9b700 1 -- 172.21.15.8:0/28895827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d54111f90 msgr2=0x7f5d54135c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d51d9b700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d54111f90 0x7f5d54135c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d51d9b700 1 -- 172.21.15.8:0/28895827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d44009a20 con 0x7f5d540a6920 2023-10-14T16:54:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.635+0000 7f5d52d9d700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d54111f90 0x7f5d54135c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:54:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.636+0000 7f5d51d9b700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540a6920 0x7f5d541356d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c4e0 tx=0x7f5d3c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.636+0000 7f5d4a7fc700 1 -- 172.21.15.8:0/28895827 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c011590 con 0x7f5d540a6920 2023-10-14T16:54:58.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.636+0000 7f5d4a7fc700 1 -- 172.21.15.8:0/28895827 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c011710 con 0x7f5d540a6920 2023-10-14T16:54:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.636+0000 7f5d58e7e700 1 -- 172.21.15.8:0/28895827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d54114b00 con 0x7f5d540a6920 2023-10-14T16:54:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.636+0000 7f5d4a7fc700 1 -- 172.21.15.8:0/28895827 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c011ad0 con 0x7f5d540a6920 2023-10-14T16:54:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.636+0000 7f5d58e7e700 1 -- 172.21.15.8:0/28895827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d541145a0 con 0x7f5d540a6920 2023-10-14T16:54:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.637+0000 7f5d58e7e700 1 -- 172.21.15.8:0/28895827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d540708d0 con 0x7f5d540a6920 2023-10-14T16:54:58.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.637+0000 7f5d4a7fc700 1 -- 172.21.15.8:0/28895827 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d3c01b3b0 con 0x7f5d540a6920 2023-10-14T16:54:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.637+0000 7f5d4a7fc700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5d34066f30 0x7f5d340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.638+0000 7f5d4a7fc700 1 -- 172.21.15.8:0/28895827 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f5d3c0833f0 con 0x7f5d540a6920 2023-10-14T16:54:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.638+0000 7f5d5259c700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5d34066f30 0x7f5d340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.638+0000 7f5d5259c700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5d34066f30 0x7f5d340693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009e60 tx=0x7f5d44019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:58.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.642+0000 7f5d4a7fc700 1 -- 172.21.15.8:0/28895827 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d3c050bc0 con 0x7f5d540a6920 2023-10-14T16:54:58.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.835+0000 7f5d58e7e700 1 -- 172.21.15.8:0/28895827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d540a5a60 con 0x7f5d540a6920 2023-10-14T16:54:58.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.835+0000 7f5d4a7fc700 1 -- 172.21.15.8:0/28895827 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12158 (secure 0 0 0) 0x7f5d3c017020 con 0x7f5d540a6920 2023-10-14T16:54:58.837 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:58.837 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:56.078671+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-14T16:54:52.330193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-14T16:54:53.459270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:54:58.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.837+0000 7f5d58e7e700 1 -- 172.21.15.8:0/28895827 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5d34066f30 msgr2=0x7f5d340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.837+0000 7f5d58e7e700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5d34066f30 0x7f5d340693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009e60 tx=0x7f5d44019000 comp rx=0 tx=0).stop 2023-10-14T16:54:58.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.837+0000 7f5d58e7e700 1 -- 172.21.15.8:0/28895827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540a6920 msgr2=0x7f5d541356d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.837+0000 7f5d58e7e700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540a6920 0x7f5d541356d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c4e0 tx=0x7f5d3c00c7f0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.837+0000 7f5d58e7e700 1 -- 172.21.15.8:0/28895827 shutdown_connections 2023-10-14T16:54:58.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.837+0000 7f5d58e7e700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5d34066f30 0x7f5d340693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.837+0000 7f5d58e7e700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d54111f90 0x7f5d54135c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.837+0000 7f5d58e7e700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d540a6550 0x7f5d54135190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.837+0000 7f5d58e7e700 1 --2- 172.21.15.8:0/28895827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540a6920 0x7f5d541356d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.837+0000 7f5d58e7e700 1 -- 172.21.15.8:0/28895827 >> 172.21.15.8:0/28895827 conn(0x7f5d5406ac40 msgr2=0x7f5d5413a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:58.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.838+0000 7f5d58e7e700 1 -- 172.21.15.8:0/28895827 shutdown_connections 2023-10-14T16:54:58.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.838+0000 7f5d58e7e700 1 -- 172.21.15.8:0/28895827 wait complete. 2023-10-14T16:54:58.851 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T16:54:58.851 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T16:54:58.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.969+0000 7f93b56c2700 1 Processor -- start 2023-10-14T16:54:58.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.969+0000 7f93b56c2700 1 -- start start 2023-10-14T16:54:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93b56c2700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93b00a69c0 0x7f93b00a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93b56c2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f93b0137100 0x7f93b013ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93b56c2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b00a2b20 con 0x7f93b00a5230 2023-10-14T16:54:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93b56c2700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b00a48c0 con 0x7f93b00a69c0 2023-10-14T16:54:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93b56c2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b00a76a0 con 0x7f93b0137100 2023-10-14T16:54:58.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93aeffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93b00a69c0 0x7f93b00a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93aeffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93b00a69c0 0x7f93b00a4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53168/0 (socket says 172.21.15.8:53168) 2023-10-14T16:54:58.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93aeffd700 1 -- 172.21.15.8:0/2519005940 learned_addr learned my addr 172.21.15.8:0/2519005940 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:58.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93af7fe700 1 --2- 172.21.15.8:0/2519005940 >> v2:172.21.15.155:3300/0 conn(0x7f93b0137100 0x7f93b013ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93aeffd700 1 -- 172.21.15.8:0/2519005940 >> v2:172.21.15.155:3300/0 conn(0x7f93b0137100 msgr2=0x7f93b013ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93aeffd700 1 --2- 172.21.15.8:0/2519005940 >> v2:172.21.15.155:3300/0 conn(0x7f93b0137100 0x7f93b013ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93aeffd700 1 -- 172.21.15.8:0/2519005940 >> v1:172.21.15.155:6789/0 conn(0x7f93b00a5230 legacy=0x7f93b01369f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93aeffd700 1 -- 172.21.15.8:0/2519005940 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b00a18c0 con 0x7f93b00a69c0 2023-10-14T16:54:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93aeffd700 1 --2- 172.21.15.8:0/2519005940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b00a69c0 0x7f93b00a4cf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f93b00a4740 tx=0x7f93a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750a074576a06ae3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93adffb700 1 -- 172.21.15.8:0/2519005940 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a000e070 con 0x7f93b00a69c0 2023-10-14T16:54:58.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93adffb700 1 -- 172.21.15.8:0/2519005940 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a000ba50 con 0x7f93b00a69c0 2023-10-14T16:54:58.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.970+0000 7f93adffb700 1 -- 172.21.15.8:0/2519005940 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a00092e0 con 0x7f93b00a69c0 2023-10-14T16:54:58.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.971+0000 7f93b56c2700 1 -- 172.21.15.8:0/2519005940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b00a69c0 msgr2=0x7f93b00a4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.971+0000 7f93b56c2700 1 --2- 172.21.15.8:0/2519005940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b00a69c0 0x7f93b00a4cf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f93b00a4740 tx=0x7f93a0009840 comp rx=0 tx=0).stop 2023-10-14T16:54:58.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.971+0000 7f93b56c2700 1 -- 172.21.15.8:0/2519005940 shutdown_connections 2023-10-14T16:54:58.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.971+0000 7f93b56c2700 1 --2- 172.21.15.8:0/2519005940 >> v2:172.21.15.155:3300/0 conn(0x7f93b0137100 0x7f93b013ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.971+0000 7f93b56c2700 1 --2- 172.21.15.8:0/2519005940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b00a69c0 0x7f93b00a4cf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.971+0000 7f93b56c2700 1 -- 172.21.15.8:0/2519005940 >> 172.21.15.8:0/2519005940 conn(0x7f93b006a8d0 msgr2=0x7f93b00701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:58.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.971+0000 7f93b56c2700 1 -- 172.21.15.8:0/2519005940 shutdown_connections 2023-10-14T16:54:58.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.971+0000 7f93b56c2700 1 -- 172.21.15.8:0/2519005940 wait complete. 2023-10-14T16:54:58.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.972+0000 7f93b56c2700 1 Processor -- start 2023-10-14T16:54:58.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.972+0000 7f93b56c2700 1 -- start start 2023-10-14T16:54:58.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.972+0000 7f93b56c2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93b00a5230 0x7f93b01468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.972+0000 7f93b56c2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93b0137100 0x7f93b0146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.972+0000 7f93b56c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b009bc60 0x7f93b009c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.972+0000 7f93b56c2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b00a6340 con 0x7f93b009bc60 2023-10-14T16:54:58.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.972+0000 7f93b56c2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b009fcc0 con 0x7f93b00a5230 2023-10-14T16:54:58.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.972+0000 7f93b56c2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b00a5620 con 0x7f93b0137100 2023-10-14T16:54:58.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.972+0000 7f93af7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b009bc60 0x7f93b009c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93af7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b009bc60 0x7f93b009c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53184/0 (socket says 172.21.15.8:53184) 2023-10-14T16:54:58.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93af7fe700 1 -- 172.21.15.8:0/2992930553 learned_addr learned my addr 172.21.15.8:0/2992930553 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:58.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93aeffd700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93b00a5230 0x7f93b01468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93ae7fc700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93b0137100 0x7f93b0146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93af7fe700 1 -- 172.21.15.8:0/2992930553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93b0137100 msgr2=0x7f93b0146e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93af7fe700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93b0137100 0x7f93b0146e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93af7fe700 1 -- 172.21.15.8:0/2992930553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93b00a5230 msgr2=0x7f93b01468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:58.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93af7fe700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93b00a5230 0x7f93b01468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:58.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93af7fe700 1 -- 172.21.15.8:0/2992930553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a0009ae0 con 0x7f93b009bc60 2023-10-14T16:54:58.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93af7fe700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b009bc60 0x7f93b009c100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93a800d890 tx=0x7f93a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:58.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93a6ffd700 1 -- 172.21.15.8:0/2992930553 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a80125f0 con 0x7f93b009bc60 2023-10-14T16:54:58.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93a6ffd700 1 -- 172.21.15.8:0/2992930553 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a8012770 con 0x7f93b009bc60 2023-10-14T16:54:58.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93b56c2700 1 -- 172.21.15.8:0/2992930553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b009f5a0 con 0x7f93b009bc60 2023-10-14T16:54:58.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93a6ffd700 1 -- 172.21.15.8:0/2992930553 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8012b30 con 0x7f93b009bc60 2023-10-14T16:54:58.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.973+0000 7f93b56c2700 1 -- 172.21.15.8:0/2992930553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b009ef80 con 0x7f93b009bc60 2023-10-14T16:54:58.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.974+0000 7f93b56c2700 1 -- 172.21.15.8:0/2992930553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b002b440 con 0x7f93b009bc60 2023-10-14T16:54:58.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.974+0000 7f93a6ffd700 1 -- 172.21.15.8:0/2992930553 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93a801e460 con 0x7f93b009bc60 2023-10-14T16:54:58.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.975+0000 7f93a6ffd700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9390066f60 0x7f9390069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:58.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.975+0000 7f93a6ffd700 1 -- 172.21.15.8:0/2992930553 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f93a8084440 con 0x7f93b009bc60 2023-10-14T16:54:58.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.975+0000 7f93aeffd700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9390066f60 0x7f9390069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:58.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.975+0000 7f93aeffd700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9390066f60 0x7f9390069410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f93a0009880 tx=0x7f93a0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:58.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:58.979+0000 7f93a6ffd700 1 -- 172.21.15.8:0/2992930553 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93a8051c10 con 0x7f93b009bc60 2023-10-14T16:54:59.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.167+0000 7f93b56c2700 1 -- 172.21.15.8:0/2992930553 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93b00639b0 con 0x7f9390066f60 2023-10-14T16:54:59.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.175+0000 7f93a6ffd700 1 -- 172.21.15.8:0/2992930553 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271306 (secure 0 0 0) 0x7f93b00639b0 con 0x7f9390066f60 2023-10-14T16:54:59.180 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.179+0000 7f93b56c2700 1 -- 172.21.15.8:0/2992930553 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9390066f60 msgr2=0x7f9390069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.179+0000 7f93b56c2700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9390066f60 0x7f9390069410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f93a0009880 tx=0x7f93a0018000 comp rx=0 tx=0).stop 2023-10-14T16:54:59.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.179+0000 7f93b56c2700 1 -- 172.21.15.8:0/2992930553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b009bc60 msgr2=0x7f93b009c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.179+0000 7f93b56c2700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b009bc60 0x7f93b009c100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93a800d890 tx=0x7f93a8008040 comp rx=0 tx=0).stop 2023-10-14T16:54:59.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.179+0000 7f93b56c2700 1 -- 172.21.15.8:0/2992930553 shutdown_connections 2023-10-14T16:54:59.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.179+0000 7f93b56c2700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9390066f60 0x7f9390069410 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.179+0000 7f93b56c2700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93b009bc60 0x7f93b009c100 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.179+0000 7f93b56c2700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93b00a5230 0x7f93b01468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.179+0000 7f93b56c2700 1 --2- 172.21.15.8:0/2992930553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93b0137100 0x7f93b0146e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.179+0000 7f93b56c2700 1 -- 172.21.15.8:0/2992930553 >> 172.21.15.8:0/2992930553 conn(0x7f93b006a8d0 msgr2=0x7f93b01345e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:59.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.179+0000 7f93b56c2700 1 -- 172.21.15.8:0/2992930553 shutdown_connections 2023-10-14T16:54:59.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.179+0000 7f93b56c2700 1 -- 172.21.15.8:0/2992930553 wait complete. 2023-10-14T16:54:59.185 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T16:54:59.191 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-14T16:54:57.981680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1190956,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":1189120,"kb_avail":376296404,"statfs":{"total":386547056640,"available":385327517696,"internally_reserved":0,"allocated":1847296,"data_stored":1382091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1217658880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.909284"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097675+0000","last_change":"2023-10-14T16:54:55.097675+0000","last_active":"2023-10-14T16:54:55.097675+0000","last_peered":"2023-10-14T16:54:55.097675+0000","last_clean":"2023-10-14T16:54:55.097675+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T16:54:55.097675+0000","last_undegraded":"2023-10-14T16:54:55.097675+0000","last_fullsized":"2023-10-14T16:54:55.097675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103871+0000","last_change":"2023-10-14T16:54:55.097479+0000","last_active":"2023-10-14T16:54:55.103871+0000","last_peered":"2023-10-14T16:54:55.103871+0000","last_clean":"2023-10-14T16:54:55.103871+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T16:54:55.103871+0000","last_undegraded":"2023-10-14T16:54:55.103871+0000","last_fullsized":"2023-10-14T16:54:55.103871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108409+0000","last_change":"2023-10-14T16:54:55.104594+0000","last_active":"2023-10-14T16:54:55.108409+0000","last_peered":"2023-10-14T16:54:55.108409+0000","last_clean":"2023-10-14T16:54:55.108409+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T16:54:55.108409+0000","last_undegraded":"2023-10-14T16:54:55.108409+0000","last_fullsized":"2023-10-14T16:54:55.108409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:56.343441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.104504+0000","last_change":"2023-10-14T16:54:55.095745+0000","last_active":"2023-10-14T16:54:55.104504+0000","last_peered":"2023-10-14T16:54:55.104504+0000","last_clean":"2023-10-14T16:54:55.104504+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T16:54:55.104504+0000","last_undegraded":"2023-10-14T16:54:55.104504+0000","last_fullsized":"2023-10-14T16:54:55.104504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:05.483417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097176+0000","last_change":"2023-10-14T16:54:55.097176+0000","last_active":"2023-10-14T16:54:55.097176+0000","last_peered":"2023-10-14T16:54:55.097176+0000","last_clean":"2023-10-14T16:54:55.097176+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T16:54:55.097176+0000","last_undegraded":"2023-10-14T16:54:55.097176+0000","last_fullsized":"2023-10-14T16:54:55.097176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098736+0000","last_change":"2023-10-14T16:54:55.093518+0000","last_active":"2023-10-14T16:54:55.098736+0000","last_peered":"2023-10-14T16:54:55.098736+0000","last_clean":"2023-10-14T16:54:55.098736+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T16:54:55.098736+0000","last_undegraded":"2023-10-14T16:54:55.098736+0000","last_fullsized":"2023-10-14T16:54:55.098736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:59.572769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098385+0000","last_change":"2023-10-14T16:54:55.093397+0000","last_active":"2023-10-14T16:54:55.098385+0000","last_peered":"2023-10-14T16:54:55.098385+0000","last_clean":"2023-10-14T16:54:55.098385+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T16:54:55.098385+0000","last_undegraded":"2023-10-14T16:54:55.098385+0000","last_fullsized":"2023-10-14T16:54:55.098385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:15:51.621106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098357+0000","last_change":"2023-10-14T16:54:55.093119+0000","last_active":"2023-10-14T16:54:55.098357+0000","last_peered":"2023-10-14T16:54:55.098357+0000","last_clean":"2023-10-14T16:54:55.098357+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T16:54:55.098357+0000","last_undegraded":"2023-10-14T16:54:55.098357+0000","last_fullsized":"2023-10-14T16:54:55.098357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:40.295415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097926+0000","last_change":"2023-10-14T16:54:55.097926+0000","last_active":"2023-10-14T16:54:55.097926+0000","last_peered":"2023-10-14T16:54:55.097926+0000","last_clean":"2023-10-14T16:54:55.097926+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T16:54:55.097926+0000","last_undegraded":"2023-10-14T16:54:55.097926+0000","last_fullsized":"2023-10-14T16:54:55.097926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098770+0000","last_change":"2023-10-14T16:54:55.094293+0000","last_active":"2023-10-14T16:54:55.098770+0000","last_peered":"2023-10-14T16:54:55.098770+0000","last_clean":"2023-10-14T16:54:55.098770+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T16:54:55.098770+0000","last_undegraded":"2023-10-14T16:54:55.098770+0000","last_fullsized":"2023-10-14T16:54:55.098770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:54:37.853332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103951+0000","last_change":"2023-10-14T16:54:55.097944+0000","last_active":"2023-10-14T16:54:55.103951+0000","last_peered":"2023-10-14T16:54:55.103951+0000","last_clean":"2023-10-14T16:54:55.103951+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T16:54:55.103951+0000","last_undegraded":"2023-10-14T16:54:55.103951+0000","last_fullsized":"2023-10-14T16:54:55.103951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:18:19.208533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107384+0000","last_change":"2023-10-14T16:54:55.100123+0000","last_active":"2023-10-14T16:54:55.107384+0000","last_peered":"2023-10-14T16:54:55.107384+0000","last_clean":"2023-10-14T16:54:55.107384+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T16:54:55.107384+0000","last_undegraded":"2023-10-14T16:54:55.107384+0000","last_fullsized":"2023-10-14T16:54:55.107384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092337+0000","last_change":"2023-10-14T16:54:55.092337+0000","last_active":"2023-10-14T16:54:55.092337+0000","last_peered":"2023-10-14T16:54:55.092337+0000","last_clean":"2023-10-14T16:54:55.092337+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T16:54:55.092337+0000","last_undegraded":"2023-10-14T16:54:55.092337+0000","last_fullsized":"2023-10-14T16:54:55.092337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:13.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109719+0000","last_change":"2023-10-14T16:54:55.107518+0000","last_active":"2023-10-14T16:54:55.109719+0000","last_peered":"2023-10-14T16:54:55.109719+0000","last_clean":"2023-10-14T16:54:55.109719+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T16:54:55.109719+0000","last_undegraded":"2023-10-14T16:54:55.109719+0000","last_fullsized":"2023-10-14T16:54:55.109719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103788+0000","last_change":"2023-10-14T16:54:55.097498+0000","last_active":"2023-10-14T16:54:55.103788+0000","last_peered":"2023-10-14T16:54:55.103788+0000","last_clean":"2023-10-14T16:54:55.103788+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T16:54:55.103788+0000","last_undegraded":"2023-10-14T16:54:55.103788+0000","last_fullsized":"2023-10-14T16:54:55.103788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098786+0000","last_change":"2023-10-14T16:54:55.094124+0000","last_active":"2023-10-14T16:54:55.098786+0000","last_peered":"2023-10-14T16:54:55.098786+0000","last_clean":"2023-10-14T16:54:55.098786+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T16:54:55.098786+0000","last_undegraded":"2023-10-14T16:54:55.098786+0000","last_fullsized":"2023-10-14T16:54:55.098786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:41:12.510526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096559+0000","last_change":"2023-10-14T16:54:55.096559+0000","last_active":"2023-10-14T16:54:55.096559+0000","last_peered":"2023-10-14T16:54:55.096559+0000","last_clean":"2023-10-14T16:54:55.096559+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T16:54:55.096559+0000","last_undegraded":"2023-10-14T16:54:55.096559+0000","last_fullsized":"2023-10-14T16:54:55.096559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106652+0000","last_change":"2023-10-14T16:54:55.100473+0000","last_active":"2023-10-14T16:54:55.106652+0000","last_peered":"2023-10-14T16:54:55.106652+0000","last_clean":"2023-10-14T16:54:55.106652+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T16:54:55.106652+0000","last_undegraded":"2023-10-14T16:54:55.106652+0000","last_fullsized":"2023-10-14T16:54:55.106652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.091193+0000","last_change":"2023-10-14T16:54:55.091193+0000","last_active":"2023-10-14T16:54:55.091193+0000","last_peered":"2023-10-14T16:54:55.091193+0000","last_clean":"2023-10-14T16:54:55.091193+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T16:54:55.091193+0000","last_undegraded":"2023-10-14T16:54:55.091193+0000","last_fullsized":"2023-10-14T16:54:55.091193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106722+0000","last_change":"2023-10-14T16:54:55.100781+0000","last_active":"2023-10-14T16:54:55.106722+0000","last_peered":"2023-10-14T16:54:55.106722+0000","last_clean":"2023-10-14T16:54:55.106722+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T16:54:55.106722+0000","last_undegraded":"2023-10-14T16:54:55.106722+0000","last_fullsized":"2023-10-14T16:54:55.106722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109399+0000","last_change":"2023-10-14T16:54:55.107643+0000","last_active":"2023-10-14T16:54:55.109399+0000","last_peered":"2023-10-14T16:54:55.109399+0000","last_clean":"2023-10-14T16:54:55.109399+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T16:54:55.109399+0000","last_undegraded":"2023-10-14T16:54:55.109399+0000","last_fullsized":"2023-10-14T16:54:55.109399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096743+0000","last_change":"2023-10-14T16:54:55.096743+0000","last_active":"2023-10-14T16:54:55.096743+0000","last_peered":"2023-10-14T16:54:55.096743+0000","last_clean":"2023-10-14T16:54:55.096743+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T16:54:55.096743+0000","last_undegraded":"2023-10-14T16:54:55.096743+0000","last_fullsized":"2023-10-14T16:54:55.096743+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110324+0000","last_change":"2023-10-14T16:54:55.102779+0000","last_active":"2023-10-14T16:54:55.110324+0000","last_peered":"2023-10-14T16:54:55.110324+0000","last_clean":"2023-10-14T16:54:55.110324+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T16:54:55.110324+0000","last_undegraded":"2023-10-14T16:54:55.110324+0000","last_fullsized":"2023-10-14T16:54:55.110324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106674+0000","last_change":"2023-10-14T16:54:55.100535+0000","last_active":"2023-10-14T16:54:55.106674+0000","last_peered":"2023-10-14T16:54:55.106674+0000","last_clean":"2023-10-14T16:54:55.106674+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T16:54:55.106674+0000","last_undegraded":"2023-10-14T16:54:55.106674+0000","last_fullsized":"2023-10-14T16:54:55.106674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108676+0000","last_change":"2023-10-14T16:54:55.100833+0000","last_active":"2023-10-14T16:54:55.108676+0000","last_peered":"2023-10-14T16:54:55.108676+0000","last_clean":"2023-10-14T16:54:55.108676+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T16:54:55.108676+0000","last_undegraded":"2023-10-14T16:54:55.108676+0000","last_fullsized":"2023-10-14T16:54:55.108676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111018+0000","last_change":"2023-10-14T16:54:55.107516+0000","last_active":"2023-10-14T16:54:55.111018+0000","last_peered":"2023-10-14T16:54:55.111018+0000","last_clean":"2023-10-14T16:54:55.111018+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T16:54:55.111018+0000","last_undegraded":"2023-10-14T16:54:55.111018+0000","last_fullsized":"2023-10-14T16:54:55.111018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108427+0000","last_change":"2023-10-14T16:54:55.104794+0000","last_active":"2023-10-14T16:54:55.108427+0000","last_peered":"2023-10-14T16:54:55.108427+0000","last_clean":"2023-10-14T16:54:55.108427+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T16:54:55.108427+0000","last_undegraded":"2023-10-14T16:54:55.108427+0000","last_fullsized":"2023-10-14T16:54:55.108427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:46.761206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.112011+0000","last_change":"2023-10-14T16:54:54.101946+0000","last_active":"2023-10-14T16:54:55.112011+0000","last_peered":"2023-10-14T16:54:55.112011+0000","last_clean":"2023-10-14T16:54:55.112011+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T16:54:55.112011+0000","last_undegraded":"2023-10-14T16:54:55.112011+0000","last_fullsized":"2023-10-14T16:54:55.112011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097502+0000","last_change":"2023-10-14T16:54:55.097502+0000","last_active":"2023-10-14T16:54:55.097502+0000","last_peered":"2023-10-14T16:54:55.097502+0000","last_clean":"2023-10-14T16:54:55.097502+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T16:54:55.097502+0000","last_undegraded":"2023-10-14T16:54:55.097502+0000","last_fullsized":"2023-10-14T16:54:55.097502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092311+0000","last_change":"2023-10-14T16:54:54.096872+0000","last_active":"2023-10-14T16:54:55.092311+0000","last_peered":"2023-10-14T16:54:55.092311+0000","last_clean":"2023-10-14T16:54:55.092311+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T16:54:55.092311+0000","last_undegraded":"2023-10-14T16:54:55.092311+0000","last_fullsized":"2023-10-14T16:54:55.092311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090799+0000","last_change":"2023-10-14T16:54:55.090799+0000","last_active":"2023-10-14T16:54:55.090799+0000","last_peered":"2023-10-14T16:54:55.090799+0000","last_clean":"2023-10-14T16:54:55.090799+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T16:54:55.090799+0000","last_undegraded":"2023-10-14T16:54:55.090799+0000","last_fullsized":"2023-10-14T16:54:55.090799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093342+0000","last_change":"2023-10-14T16:54:54.094974+0000","last_active":"2023-10-14T16:54:55.093342+0000","last_peered":"2023-10-14T16:54:55.093342+0000","last_clean":"2023-10-14T16:54:55.093342+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T16:54:55.093342+0000","last_undegraded":"2023-10-14T16:54:55.093342+0000","last_fullsized":"2023-10-14T16:54:55.093342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107286+0000","last_change":"2023-10-14T16:54:55.100446+0000","last_active":"2023-10-14T16:54:55.107286+0000","last_peered":"2023-10-14T16:54:55.107286+0000","last_clean":"2023-10-14T16:54:55.107286+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T16:54:55.107286+0000","last_undegraded":"2023-10-14T16:54:55.107286+0000","last_fullsized":"2023-10-14T16:54:55.107286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T16:54:54.100158+0000","last_change":"2023-10-14T16:54:54.098193+0000","last_active":"2023-10-14T16:54:54.100158+0000","last_peered":"2023-10-14T16:54:54.100158+0000","last_clean":"2023-10-14T16:54:54.100158+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T16:54:54.100158+0000","last_undegraded":"2023-10-14T16:54:54.100158+0000","last_fullsized":"2023-10-14T16:54:54.100158+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:33.333473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106735+0000","last_change":"2023-10-14T16:54:55.099120+0000","last_active":"2023-10-14T16:54:55.106735+0000","last_peered":"2023-10-14T16:54:55.106735+0000","last_clean":"2023-10-14T16:54:55.106735+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T16:54:55.106735+0000","last_undegraded":"2023-10-14T16:54:55.106735+0000","last_fullsized":"2023-10-14T16:54:55.106735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090823+0000","last_change":"2023-10-14T16:54:54.100620+0000","last_active":"2023-10-14T16:54:55.090823+0000","last_peered":"2023-10-14T16:54:55.090823+0000","last_clean":"2023-10-14T16:54:55.090823+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T16:54:55.090823+0000","last_undegraded":"2023-10-14T16:54:55.090823+0000","last_fullsized":"2023-10-14T16:54:55.090823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090564+0000","last_change":"2023-10-14T16:54:55.090564+0000","last_active":"2023-10-14T16:54:55.090564+0000","last_peered":"2023-10-14T16:54:55.090564+0000","last_clean":"2023-10-14T16:54:55.090564+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T16:54:55.090564+0000","last_undegraded":"2023-10-14T16:54:55.090564+0000","last_fullsized":"2023-10-14T16:54:55.090564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108412+0000","last_change":"2023-10-14T16:54:54.097908+0000","last_active":"2023-10-14T16:54:55.108412+0000","last_peered":"2023-10-14T16:54:55.108412+0000","last_clean":"2023-10-14T16:54:55.108412+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T16:54:55.108412+0000","last_undegraded":"2023-10-14T16:54:55.108412+0000","last_fullsized":"2023-10-14T16:54:55.108412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110759+0000","last_change":"2023-10-14T16:54:55.104734+0000","last_active":"2023-10-14T16:54:55.110759+0000","last_peered":"2023-10-14T16:54:55.110759+0000","last_clean":"2023-10-14T16:54:55.110759+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T16:54:55.110759+0000","last_undegraded":"2023-10-14T16:54:55.110759+0000","last_fullsized":"2023-10-14T16:54:55.110759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110608+0000","last_change":"2023-10-14T16:54:54.098933+0000","last_active":"2023-10-14T16:54:55.110608+0000","last_peered":"2023-10-14T16:54:55.110608+0000","last_clean":"2023-10-14T16:54:55.110608+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T16:54:55.110608+0000","last_undegraded":"2023-10-14T16:54:55.110608+0000","last_fullsized":"2023-10-14T16:54:55.110608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:47.391039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103770+0000","last_change":"2023-10-14T16:54:55.096816+0000","last_active":"2023-10-14T16:54:55.103770+0000","last_peered":"2023-10-14T16:54:55.103770+0000","last_clean":"2023-10-14T16:54:55.103770+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T16:54:55.103770+0000","last_undegraded":"2023-10-14T16:54:55.103770+0000","last_fullsized":"2023-10-14T16:54:55.103770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106918+0000","last_change":"2023-10-14T16:54:54.103486+0000","last_active":"2023-10-14T16:54:55.106918+0000","last_peered":"2023-10-14T16:54:55.106918+0000","last_clean":"2023-10-14T16:54:55.106918+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T16:54:55.106918+0000","last_undegraded":"2023-10-14T16:54:55.106918+0000","last_fullsized":"2023-10-14T16:54:55.106918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111007+0000","last_change":"2023-10-14T16:54:55.108934+0000","last_active":"2023-10-14T16:54:55.111007+0000","last_peered":"2023-10-14T16:54:55.111007+0000","last_clean":"2023-10-14T16:54:55.111007+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T16:54:55.111007+0000","last_undegraded":"2023-10-14T16:54:55.111007+0000","last_fullsized":"2023-10-14T16:54:55.111007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T16:54:54.098983+0000","last_change":"2023-10-14T16:54:54.098087+0000","last_active":"2023-10-14T16:54:54.098983+0000","last_peered":"2023-10-14T16:54:54.098983+0000","last_clean":"2023-10-14T16:54:54.098983+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T16:54:54.098983+0000","last_undegraded":"2023-10-14T16:54:54.098983+0000","last_fullsized":"2023-10-14T16:54:54.098983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:48.428626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108444+0000","last_change":"2023-10-14T16:54:55.104902+0000","last_active":"2023-10-14T16:54:55.108444+0000","last_peered":"2023-10-14T16:54:55.108444+0000","last_clean":"2023-10-14T16:54:55.108444+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T16:54:55.108444+0000","last_undegraded":"2023-10-14T16:54:55.108444+0000","last_fullsized":"2023-10-14T16:54:55.108444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:21:19.831648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085257+0000","last_change":"2023-10-14T16:54:54.099046+0000","last_active":"2023-10-14T16:54:55.085257+0000","last_peered":"2023-10-14T16:54:55.085257+0000","last_clean":"2023-10-14T16:54:55.085257+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T16:54:55.085257+0000","last_undegraded":"2023-10-14T16:54:55.085257+0000","last_fullsized":"2023-10-14T16:54:55.085257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:13.092692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092929+0000","last_change":"2023-10-14T16:54:55.092929+0000","last_active":"2023-10-14T16:54:55.092929+0000","last_peered":"2023-10-14T16:54:55.092929+0000","last_clean":"2023-10-14T16:54:55.092929+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T16:54:55.092929+0000","last_undegraded":"2023-10-14T16:54:55.092929+0000","last_fullsized":"2023-10-14T16:54:55.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:06.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109884+0000","last_change":"2023-10-14T16:54:54.099281+0000","last_active":"2023-10-14T16:54:55.109884+0000","last_peered":"2023-10-14T16:54:55.109884+0000","last_clean":"2023-10-14T16:54:55.109884+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T16:54:55.109884+0000","last_undegraded":"2023-10-14T16:54:55.109884+0000","last_fullsized":"2023-10-14T16:54:55.109884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099743+0000","last_change":"2023-10-14T16:54:55.099743+0000","last_active":"2023-10-14T16:54:55.099743+0000","last_peered":"2023-10-14T16:54:55.099743+0000","last_clean":"2023-10-14T16:54:55.099743+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T16:54:55.099743+0000","last_undegraded":"2023-10-14T16:54:55.099743+0000","last_fullsized":"2023-10-14T16:54:55.099743+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108028+0000","last_change":"2023-10-14T16:54:54.100726+0000","last_active":"2023-10-14T16:54:55.108028+0000","last_peered":"2023-10-14T16:54:55.108028+0000","last_clean":"2023-10-14T16:54:55.108028+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T16:54:55.108028+0000","last_undegraded":"2023-10-14T16:54:55.108028+0000","last_fullsized":"2023-10-14T16:54:55.108028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098409+0000","last_change":"2023-10-14T16:54:55.093470+0000","last_active":"2023-10-14T16:54:55.098409+0000","last_peered":"2023-10-14T16:54:55.098409+0000","last_clean":"2023-10-14T16:54:55.098409+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T16:54:55.098409+0000","last_undegraded":"2023-10-14T16:54:55.098409+0000","last_fullsized":"2023-10-14T16:54:55.098409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.112167+0000","last_change":"2023-10-14T16:54:54.097646+0000","last_active":"2023-10-14T16:54:55.112167+0000","last_peered":"2023-10-14T16:54:55.112167+0000","last_clean":"2023-10-14T16:54:55.112167+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T16:54:55.112167+0000","last_undegraded":"2023-10-14T16:54:55.112167+0000","last_fullsized":"2023-10-14T16:54:55.112167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103764+0000","last_change":"2023-10-14T16:54:55.097471+0000","last_active":"2023-10-14T16:54:55.103764+0000","last_peered":"2023-10-14T16:54:55.103764+0000","last_clean":"2023-10-14T16:54:55.103764+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T16:54:55.103764+0000","last_undegraded":"2023-10-14T16:54:55.103764+0000","last_fullsized":"2023-10-14T16:54:55.103764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108356+0000","last_change":"2023-10-14T16:54:54.100923+0000","last_active":"2023-10-14T16:54:55.108356+0000","last_peered":"2023-10-14T16:54:55.108356+0000","last_clean":"2023-10-14T16:54:55.108356+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T16:54:55.108356+0000","last_undegraded":"2023-10-14T16:54:55.108356+0000","last_fullsized":"2023-10-14T16:54:55.108356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.104043+0000","last_change":"2023-10-14T16:54:55.096945+0000","last_active":"2023-10-14T16:54:55.104043+0000","last_peered":"2023-10-14T16:54:55.104043+0000","last_clean":"2023-10-14T16:54:55.104043+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T16:54:55.104043+0000","last_undegraded":"2023-10-14T16:54:55.104043+0000","last_fullsized":"2023-10-14T16:54:55.104043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.084866+0000","last_change":"2023-10-14T16:54:54.099363+0000","last_active":"2023-10-14T16:54:55.084866+0000","last_peered":"2023-10-14T16:54:55.084866+0000","last_clean":"2023-10-14T16:54:55.084866+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T16:54:55.084866+0000","last_undegraded":"2023-10-14T16:54:55.084866+0000","last_fullsized":"2023-10-14T16:54:55.084866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.124832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097957+0000","last_change":"2023-10-14T16:54:55.097957+0000","last_active":"2023-10-14T16:54:55.097957+0000","last_peered":"2023-10-14T16:54:55.097957+0000","last_clean":"2023-10-14T16:54:55.097957+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T16:54:55.097957+0000","last_undegraded":"2023-10-14T16:54:55.097957+0000","last_fullsized":"2023-10-14T16:54:55.097957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110707+0000","last_change":"2023-10-14T16:54:54.093771+0000","last_active":"2023-10-14T16:54:55.110707+0000","last_peered":"2023-10-14T16:54:55.110707+0000","last_clean":"2023-10-14T16:54:55.110707+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T16:54:55.110707+0000","last_undegraded":"2023-10-14T16:54:55.110707+0000","last_fullsized":"2023-10-14T16:54:55.110707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106694+0000","last_change":"2023-10-14T16:54:55.100663+0000","last_active":"2023-10-14T16:54:55.106694+0000","last_peered":"2023-10-14T16:54:55.106694+0000","last_clean":"2023-10-14T16:54:55.106694+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T16:54:55.106694+0000","last_undegraded":"2023-10-14T16:54:55.106694+0000","last_fullsized":"2023-10-14T16:54:55.106694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085907+0000","last_change":"2023-10-14T16:54:54.103401+0000","last_active":"2023-10-14T16:54:55.085907+0000","last_peered":"2023-10-14T16:54:55.085907+0000","last_clean":"2023-10-14T16:54:55.085907+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T16:54:55.085907+0000","last_undegraded":"2023-10-14T16:54:55.085907+0000","last_fullsized":"2023-10-14T16:54:55.085907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:28.931284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099217+0000","last_change":"2023-10-14T16:54:55.096406+0000","last_active":"2023-10-14T16:54:55.099217+0000","last_peered":"2023-10-14T16:54:55.099217+0000","last_clean":"2023-10-14T16:54:55.099217+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T16:54:55.099217+0000","last_undegraded":"2023-10-14T16:54:55.099217+0000","last_fullsized":"2023-10-14T16:54:55.099217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085465+0000","last_change":"2023-10-14T16:54:54.099084+0000","last_active":"2023-10-14T16:54:55.085465+0000","last_peered":"2023-10-14T16:54:55.085465+0000","last_clean":"2023-10-14T16:54:55.085465+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T16:54:55.085465+0000","last_undegraded":"2023-10-14T16:54:55.085465+0000","last_fullsized":"2023-10-14T16:54:55.085465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:27.318420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096109+0000","last_change":"2023-10-14T16:54:55.094077+0000","last_active":"2023-10-14T16:54:55.096109+0000","last_peered":"2023-10-14T16:54:55.096109+0000","last_clean":"2023-10-14T16:54:55.096109+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T16:54:55.096109+0000","last_undegraded":"2023-10-14T16:54:55.096109+0000","last_fullsized":"2023-10-14T16:54:55.096109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:12.562614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093276+0000","last_change":"2023-10-14T16:54:54.095927+0000","last_active":"2023-10-14T16:54:55.093276+0000","last_peered":"2023-10-14T16:54:55.093276+0000","last_clean":"2023-10-14T16:54:55.093276+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T16:54:55.093276+0000","last_undegraded":"2023-10-14T16:54:55.093276+0000","last_fullsized":"2023-10-14T16:54:55.093276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110839+0000","last_change":"2023-10-14T16:54:55.106702+0000","last_active":"2023-10-14T16:54:55.110839+0000","last_peered":"2023-10-14T16:54:55.110839+0000","last_clean":"2023-10-14T16:54:55.110839+0000","last_became_active":"2023-10-14T16:54:55.105853+0000","last_became_peered":"2023-10-14T16:54:55.105853+0000","last_unstale":"2023-10-14T16:54:55.110839+0000","last_undegraded":"2023-10-14T16:54:55.110839+0000","last_fullsized":"2023-10-14T16:54:55.110839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110438+0000","last_change":"2023-10-14T16:54:54.092032+0000","last_active":"2023-10-14T16:54:55.110438+0000","last_peered":"2023-10-14T16:54:55.110438+0000","last_clean":"2023-10-14T16:54:55.110438+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T16:54:55.110438+0000","last_undegraded":"2023-10-14T16:54:55.110438+0000","last_fullsized":"2023-10-14T16:54:55.110438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090798+0000","last_change":"2023-10-14T16:54:49.689264+0000","last_active":"2023-10-14T16:54:55.090798+0000","last_peered":"2023-10-14T16:54:55.090798+0000","last_clean":"2023-10-14T16:54:55.090798+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T16:54:55.090798+0000","last_undegraded":"2023-10-14T16:54:55.090798+0000","last_fullsized":"2023-10-14T16:54:55.090798+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092208+0000","last_change":"2023-10-14T16:54:55.092208+0000","last_active":"2023-10-14T16:54:55.092208+0000","last_peered":"2023-10-14T16:54:55.092208+0000","last_clean":"2023-10-14T16:54:55.092208+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T16:54:55.092208+0000","last_undegraded":"2023-10-14T16:54:55.092208+0000","last_fullsized":"2023-10-14T16:54:55.092208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.094564+0000","last_change":"2023-10-14T16:54:49.063336+0000","last_active":"2023-10-14T16:54:55.094564+0000","last_peered":"2023-10-14T16:54:55.094564+0000","last_clean":"2023-10-14T16:54:55.094564+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T16:54:55.094564+0000","last_undegraded":"2023-10-14T16:54:55.094564+0000","last_fullsized":"2023-10-14T16:54:55.094564+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T16:54:54.094906+0000","last_change":"2023-10-14T16:54:54.093189+0000","last_active":"2023-10-14T16:54:54.094906+0000","last_peered":"2023-10-14T16:54:54.094906+0000","last_clean":"2023-10-14T16:54:54.094906+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T16:54:54.094906+0000","last_undegraded":"2023-10-14T16:54:54.094906+0000","last_fullsized":"2023-10-14T16:54:54.094906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:47.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096057+0000","last_change":"2023-10-14T16:54:55.094019+0000","last_active":"2023-10-14T16:54:55.096057+0000","last_peered":"2023-10-14T16:54:55.096057+0000","last_clean":"2023-10-14T16:54:55.096057+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T16:54:55.096057+0000","last_undegraded":"2023-10-14T16:54:55.096057+0000","last_fullsized":"2023-10-14T16:54:55.096057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:48.395824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092213+0000","last_change":"2023-10-14T16:54:49.063688+0000","last_active":"2023-10-14T16:54:55.092213+0000","last_peered":"2023-10-14T16:54:55.092213+0000","last_clean":"2023-10-14T16:54:55.092213+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T16:54:55.092213+0000","last_undegraded":"2023-10-14T16:54:55.092213+0000","last_fullsized":"2023-10-14T16:54:55.092213+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:29.004325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'117","reported_seq":163,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085888+0000","last_change":"2023-10-14T16:54:49.063307+0000","last_active":"2023-10-14T16:54:55.085888+0000","last_peered":"2023-10-14T16:54:55.085888+0000","last_clean":"2023-10-14T16:54:55.085888+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T16:54:55.085888+0000","last_undegraded":"2023-10-14T16:54:55.085888+0000","last_fullsized":"2023-10-14T16:54:55.085888+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T16:54:54.100203+0000","last_change":"2023-10-14T16:54:54.098588+0000","last_active":"2023-10-14T16:54:54.100203+0000","last_peered":"2023-10-14T16:54:54.100203+0000","last_clean":"2023-10-14T16:54:54.100203+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T16:54:54.100203+0000","last_undegraded":"2023-10-14T16:54:54.100203+0000","last_fullsized":"2023-10-14T16:54:54.100203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:18.107600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096261+0000","last_change":"2023-10-14T16:54:55.096261+0000","last_active":"2023-10-14T16:54:55.096261+0000","last_peered":"2023-10-14T16:54:55.096261+0000","last_clean":"2023-10-14T16:54:55.096261+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T16:54:55.096261+0000","last_undegraded":"2023-10-14T16:54:55.096261+0000","last_fullsized":"2023-10-14T16:54:55.096261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090234+0000","last_change":"2023-10-14T16:54:49.689356+0000","last_active":"2023-10-14T16:54:55.090234+0000","last_peered":"2023-10-14T16:54:55.090234+0000","last_clean":"2023-10-14T16:54:55.090234+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T16:54:55.090234+0000","last_undegraded":"2023-10-14T16:54:55.090234+0000","last_fullsized":"2023-10-14T16:54:55.090234+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093393+0000","last_change":"2023-10-14T16:54:54.093196+0000","last_active":"2023-10-14T16:54:55.093393+0000","last_peered":"2023-10-14T16:54:55.093393+0000","last_clean":"2023-10-14T16:54:55.093393+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T16:54:55.093393+0000","last_undegraded":"2023-10-14T16:54:55.093393+0000","last_fullsized":"2023-10-14T16:54:55.093393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110822+0000","last_change":"2023-10-14T16:54:55.106633+0000","last_active":"2023-10-14T16:54:55.110822+0000","last_peered":"2023-10-14T16:54:55.110822+0000","last_clean":"2023-10-14T16:54:55.110822+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T16:54:55.110822+0000","last_undegraded":"2023-10-14T16:54:55.110822+0000","last_fullsized":"2023-10-14T16:54:55.110822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085827+0000","last_change":"2023-10-14T16:54:49.689595+0000","last_active":"2023-10-14T16:54:55.085827+0000","last_peered":"2023-10-14T16:54:55.085827+0000","last_clean":"2023-10-14T16:54:55.085827+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T16:54:55.085827+0000","last_undegraded":"2023-10-14T16:54:55.085827+0000","last_fullsized":"2023-10-14T16:54:55.085827+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:46:44.177180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.091900+0000","last_change":"2023-10-14T16:54:54.099381+0000","last_active":"2023-10-14T16:54:55.091900+0000","last_peered":"2023-10-14T16:54:55.091900+0000","last_clean":"2023-10-14T16:54:55.091900+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T16:54:55.091900+0000","last_undegraded":"2023-10-14T16:54:55.091900+0000","last_fullsized":"2023-10-14T16:54:55.091900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099236+0000","last_change":"2023-10-14T16:54:55.096667+0000","last_active":"2023-10-14T16:54:55.099236+0000","last_peered":"2023-10-14T16:54:55.099236+0000","last_clean":"2023-10-14T16:54:55.099236+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T16:54:55.099236+0000","last_undegraded":"2023-10-14T16:54:55.099236+0000","last_fullsized":"2023-10-14T16:54:55.099236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085362+0000","last_change":"2023-10-14T16:54:49.689614+0000","last_active":"2023-10-14T16:54:55.085362+0000","last_peered":"2023-10-14T16:54:55.085362+0000","last_clean":"2023-10-14T16:54:55.085362+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T16:54:55.085362+0000","last_undegraded":"2023-10-14T16:54:55.085362+0000","last_fullsized":"2023-10-14T16:54:55.085362+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:09.272835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090680+0000","last_change":"2023-10-14T16:54:54.100656+0000","last_active":"2023-10-14T16:54:55.090680+0000","last_peered":"2023-10-14T16:54:55.090680+0000","last_clean":"2023-10-14T16:54:55.090680+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T16:54:55.090680+0000","last_undegraded":"2023-10-14T16:54:55.090680+0000","last_fullsized":"2023-10-14T16:54:55.090680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111077+0000","last_change":"2023-10-14T16:54:55.109319+0000","last_active":"2023-10-14T16:54:55.111077+0000","last_peered":"2023-10-14T16:54:55.111077+0000","last_clean":"2023-10-14T16:54:55.111077+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T16:54:55.111077+0000","last_undegraded":"2023-10-14T16:54:55.111077+0000","last_fullsized":"2023-10-14T16:54:55.111077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.087246+0000","last_change":"2023-10-14T16:54:49.689836+0000","last_active":"2023-10-14T16:54:55.087246+0000","last_peered":"2023-10-14T16:54:55.087246+0000","last_clean":"2023-10-14T16:54:55.087246+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T16:54:55.087246+0000","last_undegraded":"2023-10-14T16:54:55.087246+0000","last_fullsized":"2023-10-14T16:54:55.087246+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:24.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.094686+0000","last_change":"2023-10-14T16:54:54.096618+0000","last_active":"2023-10-14T16:54:55.094686+0000","last_peered":"2023-10-14T16:54:55.094686+0000","last_clean":"2023-10-14T16:54:55.094686+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T16:54:55.094686+0000","last_undegraded":"2023-10-14T16:54:55.094686+0000","last_fullsized":"2023-10-14T16:54:55.094686+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090211+0000","last_change":"2023-10-14T16:54:55.090211+0000","last_active":"2023-10-14T16:54:55.090211+0000","last_peered":"2023-10-14T16:54:55.090211+0000","last_clean":"2023-10-14T16:54:55.090211+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T16:54:55.090211+0000","last_undegraded":"2023-10-14T16:54:55.090211+0000","last_fullsized":"2023-10-14T16:54:55.090211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085714+0000","last_change":"2023-10-14T16:54:49.064767+0000","last_active":"2023-10-14T16:54:55.085714+0000","last_peered":"2023-10-14T16:54:55.085714+0000","last_clean":"2023-10-14T16:54:55.085714+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T16:54:55.085714+0000","last_undegraded":"2023-10-14T16:54:55.085714+0000","last_fullsized":"2023-10-14T16:54:55.085714+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:34:26.616500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090367+0000","last_change":"2023-10-14T16:54:54.106280+0000","last_active":"2023-10-14T16:54:55.090367+0000","last_peered":"2023-10-14T16:54:55.090367+0000","last_clean":"2023-10-14T16:54:55.090367+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T16:54:55.090367+0000","last_undegraded":"2023-10-14T16:54:55.090367+0000","last_fullsized":"2023-10-14T16:54:55.090367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107145+0000","last_change":"2023-10-14T16:54:55.100415+0000","last_active":"2023-10-14T16:54:55.107145+0000","last_peered":"2023-10-14T16:54:55.107145+0000","last_clean":"2023-10-14T16:54:55.107145+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T16:54:55.107145+0000","last_undegraded":"2023-10-14T16:54:55.107145+0000","last_fullsized":"2023-10-14T16:54:55.107145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.081993+0000","last_change":"2023-10-14T16:54:54.102987+0000","last_active":"2023-10-14T16:54:55.081993+0000","last_peered":"2023-10-14T16:54:55.081993+0000","last_clean":"2023-10-14T16:54:55.081993+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T16:54:55.081993+0000","last_undegraded":"2023-10-14T16:54:55.081993+0000","last_fullsized":"2023-10-14T16:54:55.081993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111066+0000","last_change":"2023-10-14T16:54:55.109338+0000","last_active":"2023-10-14T16:54:55.111066+0000","last_peered":"2023-10-14T16:54:55.111066+0000","last_clean":"2023-10-14T16:54:55.111066+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T16:54:55.111066+0000","last_undegraded":"2023-10-14T16:54:55.111066+0000","last_fullsized":"2023-10-14T16:54:55.111066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108122+0000","last_change":"2023-10-14T16:54:54.095975+0000","last_active":"2023-10-14T16:54:55.108122+0000","last_peered":"2023-10-14T16:54:55.108122+0000","last_clean":"2023-10-14T16:54:55.108122+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T16:54:55.108122+0000","last_undegraded":"2023-10-14T16:54:55.108122+0000","last_fullsized":"2023-10-14T16:54:55.108122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.105361+0000","last_change":"2023-10-14T16:54:55.098957+0000","last_active":"2023-10-14T16:54:55.105361+0000","last_peered":"2023-10-14T16:54:55.105361+0000","last_clean":"2023-10-14T16:54:55.105361+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T16:54:55.105361+0000","last_undegraded":"2023-10-14T16:54:55.105361+0000","last_fullsized":"2023-10-14T16:54:55.105361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107000+0000","last_change":"2023-10-14T16:54:54.103049+0000","last_active":"2023-10-14T16:54:55.107000+0000","last_peered":"2023-10-14T16:54:55.107000+0000","last_clean":"2023-10-14T16:54:55.107000+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T16:54:55.107000+0000","last_undegraded":"2023-10-14T16:54:55.107000+0000","last_fullsized":"2023-10-14T16:54:55.107000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:17:46.369733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.104062+0000","last_change":"2023-10-14T16:54:55.097880+0000","last_active":"2023-10-14T16:54:55.104062+0000","last_peered":"2023-10-14T16:54:55.104062+0000","last_clean":"2023-10-14T16:54:55.104062+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T16:54:55.104062+0000","last_undegraded":"2023-10-14T16:54:55.104062+0000","last_fullsized":"2023-10-14T16:54:55.104062+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.082097+0000","last_change":"2023-10-14T16:54:54.095418+0000","last_active":"2023-10-14T16:54:55.082097+0000","last_peered":"2023-10-14T16:54:55.082097+0000","last_clean":"2023-10-14T16:54:55.082097+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T16:54:55.082097+0000","last_undegraded":"2023-10-14T16:54:55.082097+0000","last_fullsized":"2023-10-14T16:54:55.082097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:42.952466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097431+0000","last_change":"2023-10-14T16:54:55.097431+0000","last_active":"2023-10-14T16:54:55.097431+0000","last_peered":"2023-10-14T16:54:55.097431+0000","last_clean":"2023-10-14T16:54:55.097431+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T16:54:55.097431+0000","last_undegraded":"2023-10-14T16:54:55.097431+0000","last_fullsized":"2023-10-14T16:54:55.097431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109491+0000","last_change":"2023-10-14T16:54:54.098491+0000","last_active":"2023-10-14T16:54:55.109491+0000","last_peered":"2023-10-14T16:54:55.109491+0000","last_clean":"2023-10-14T16:54:55.109491+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T16:54:55.109491+0000","last_undegraded":"2023-10-14T16:54:55.109491+0000","last_fullsized":"2023-10-14T16:54:55.109491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108426+0000","last_change":"2023-10-14T16:54:55.107411+0000","last_active":"2023-10-14T16:54:55.108426+0000","last_peered":"2023-10-14T16:54:55.108426+0000","last_clean":"2023-10-14T16:54:55.108426+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T16:54:55.108426+0000","last_undegraded":"2023-10-14T16:54:55.108426+0000","last_fullsized":"2023-10-14T16:54:55.108426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109637+0000","last_change":"2023-10-14T16:54:55.107839+0000","last_active":"2023-10-14T16:54:55.109637+0000","last_peered":"2023-10-14T16:54:55.109637+0000","last_clean":"2023-10-14T16:54:55.109637+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T16:54:55.109637+0000","last_undegraded":"2023-10-14T16:54:55.109637+0000","last_fullsized":"2023-10-14T16:54:55.109637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103549+0000","last_change":"2023-10-14T16:54:55.094659+0000","last_active":"2023-10-14T16:54:55.103549+0000","last_peered":"2023-10-14T16:54:55.103549+0000","last_clean":"2023-10-14T16:54:55.103549+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T16:54:55.103549+0000","last_undegraded":"2023-10-14T16:54:55.103549+0000","last_fullsized":"2023-10-14T16:54:55.103549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108453+0000","last_change":"2023-10-14T16:54:55.105319+0000","last_active":"2023-10-14T16:54:55.108453+0000","last_peered":"2023-10-14T16:54:55.108453+0000","last_clean":"2023-10-14T16:54:55.108453+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T16:54:55.108453+0000","last_undegraded":"2023-10-14T16:54:55.108453+0000","last_fullsized":"2023-10-14T16:54:55.108453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097385+0000","last_change":"2023-10-14T16:54:55.097385+0000","last_active":"2023-10-14T16:54:55.097385+0000","last_peered":"2023-10-14T16:54:55.097385+0000","last_clean":"2023-10-14T16:54:55.097385+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T16:54:55.097385+0000","last_undegraded":"2023-10-14T16:54:55.097385+0000","last_fullsized":"2023-10-14T16:54:55.097385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111056+0000","last_change":"2023-10-14T16:54:55.109138+0000","last_active":"2023-10-14T16:54:55.111056+0000","last_peered":"2023-10-14T16:54:55.111056+0000","last_clean":"2023-10-14T16:54:55.111056+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T16:54:55.111056+0000","last_undegraded":"2023-10-14T16:54:55.111056+0000","last_fullsized":"2023-10-14T16:54:55.111056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298044,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073796,"statfs":{"total":96636764160,"available":96331567104,"internally_reserved":0,"allocated":774144,"data_stored":642998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":176128,"data_stored":52096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":46215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298016,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073824,"statfs":{"total":96636764160,"available":96331595776,"internally_reserved":0,"allocated":745472,"data_stored":640782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T16:54:59.197 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T16:54:59.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.348+0000 7eff3b466700 1 Processor -- start 2023-10-14T16:54:59.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.348+0000 7eff3b466700 1 -- start start 2023-10-14T16:54:59.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.349+0000 7eff3b466700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7eff340a2370 0x7eff34137210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:59.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.349+0000 7eff3b466700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff34137750 0x7eff34067d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:59.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.349+0000 7eff3b466700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff340a3a90 con 0x7eff340a3550 2023-10-14T16:54:59.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.349+0000 7eff3b466700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3406c5b0 con 0x7eff340a2370 2023-10-14T16:54:59.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.349+0000 7eff3b466700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff34136dc0 con 0x7eff34137750 2023-10-14T16:54:59.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.349+0000 7eff39202700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7eff340a2370 0x7eff34137210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:59.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.349+0000 7eff39202700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7eff340a2370 0x7eff34137210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53188/0 (socket says 172.21.15.8:53188) 2023-10-14T16:54:59.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.349+0000 7eff39202700 1 -- 172.21.15.8:0/1849126350 learned_addr learned my addr 172.21.15.8:0/1849126350 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:59.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.349+0000 7eff39a03700 1 --2- 172.21.15.8:0/1849126350 >> v2:172.21.15.155:3300/0 conn(0x7eff34137750 0x7eff34067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:59.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.349+0000 7eff33fff700 1 -- 172.21.15.8:0/1849126350 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926560375 0 0) 0x7eff340a3a90 con 0x7eff340a3550 2023-10-14T16:54:59.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.349+0000 7eff33fff700 1 -- 172.21.15.8:0/1849126350 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff1c003570 con 0x7eff340a3550 2023-10-14T16:54:59.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.350+0000 7eff39202700 1 -- 172.21.15.8:0/1849126350 >> v2:172.21.15.155:3300/0 conn(0x7eff34137750 msgr2=0x7eff34067d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:59.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.350+0000 7eff39202700 1 --2- 172.21.15.8:0/1849126350 >> v2:172.21.15.155:3300/0 conn(0x7eff34137750 0x7eff34067d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.350+0000 7eff39202700 1 -- 172.21.15.8:0/1849126350 >> v1:172.21.15.8:6789/0 conn(0x7eff340a3550 legacy=0x7eff34067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.350+0000 7eff39202700 1 -- 172.21.15.8:0/1849126350 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff340a2fb0 con 0x7eff340a2370 2023-10-14T16:54:59.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.350+0000 7eff39202700 1 --2- 172.21.15.8:0/1849126350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff340a2370 0x7eff34137210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7eff340a6b10 tx=0x7eff2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5292825cd88478 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:59.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.350+0000 7eff33fff700 1 -- 172.21.15.8:0/1849126350 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c00b640 con 0x7eff340a2370 2023-10-14T16:54:59.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.350+0000 7eff33fff700 1 -- 172.21.15.8:0/1849126350 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c00b7a0 con 0x7eff340a2370 2023-10-14T16:54:59.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.350+0000 7eff33fff700 1 -- 172.21.15.8:0/1849126350 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c00bb40 con 0x7eff340a2370 2023-10-14T16:54:59.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.351+0000 7eff3b466700 1 -- 172.21.15.8:0/1849126350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff340a2370 msgr2=0x7eff34137210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.351+0000 7eff3b466700 1 --2- 172.21.15.8:0/1849126350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff340a2370 0x7eff34137210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7eff340a6b10 tx=0x7eff2c009250 comp rx=0 tx=0).stop 2023-10-14T16:54:59.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.351+0000 7eff3b466700 1 -- 172.21.15.8:0/1849126350 shutdown_connections 2023-10-14T16:54:59.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.351+0000 7eff3b466700 1 --2- 172.21.15.8:0/1849126350 >> v2:172.21.15.155:3300/0 conn(0x7eff34137750 0x7eff34067d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.351+0000 7eff3b466700 1 --2- 172.21.15.8:0/1849126350 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff340a2370 0x7eff34137210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.351+0000 7eff3b466700 1 -- 172.21.15.8:0/1849126350 >> 172.21.15.8:0/1849126350 conn(0x7eff340701c0 msgr2=0x7eff340705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:59.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.351+0000 7eff3b466700 1 -- 172.21.15.8:0/1849126350 shutdown_connections 2023-10-14T16:54:59.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.351+0000 7eff3b466700 1 -- 172.21.15.8:0/1849126350 wait complete. 2023-10-14T16:54:59.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff3b466700 1 Processor -- start 2023-10-14T16:54:59.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff3b466700 1 -- start start 2023-10-14T16:54:59.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff3b466700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff340a3550 0x7eff34099e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:59.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff3b466700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff34137750 0x7eff3409a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:59.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff3b466700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff341337b0 0x7eff3409a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:59.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff3b466700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff34134270 con 0x7eff34137750 2023-10-14T16:54:59.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff3b466700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3409c830 con 0x7eff341337b0 2023-10-14T16:54:59.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff3b466700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3409b920 con 0x7eff340a3550 2023-10-14T16:54:59.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff38a01700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff34137750 0x7eff3409a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:59.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff38a01700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff34137750 0x7eff3409a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53194/0 (socket says 172.21.15.8:53194) 2023-10-14T16:54:59.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff38a01700 1 -- 172.21.15.8:0/438644613 learned_addr learned my addr 172.21.15.8:0/438644613 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:59.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff39202700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff340a3550 0x7eff34099e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:59.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.352+0000 7eff39a03700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff341337b0 0x7eff3409a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:59.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.353+0000 7eff38a01700 1 -- 172.21.15.8:0/438644613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff340a3550 msgr2=0x7eff34099e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.353+0000 7eff38a01700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff340a3550 0x7eff34099e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.353+0000 7eff38a01700 1 -- 172.21.15.8:0/438644613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff341337b0 msgr2=0x7eff3409a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.353+0000 7eff38a01700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff341337b0 0x7eff3409a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.353+0000 7eff38a01700 1 -- 172.21.15.8:0/438644613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c009490 con 0x7eff34137750 2023-10-14T16:54:59.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.353+0000 7eff38a01700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff34137750 0x7eff3409a3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7eff2800c790 tx=0x7eff28007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:59.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.353+0000 7eff317fa700 1 -- 172.21.15.8:0/438644613 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff28010510 con 0x7eff34137750 2023-10-14T16:54:59.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.353+0000 7eff317fa700 1 -- 172.21.15.8:0/438644613 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff28010690 con 0x7eff34137750 2023-10-14T16:54:59.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.353+0000 7eff3b466700 1 -- 172.21.15.8:0/438644613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3409bbe0 con 0x7eff34137750 2023-10-14T16:54:59.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.353+0000 7eff317fa700 1 -- 172.21.15.8:0/438644613 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff28010a50 con 0x7eff34137750 2023-10-14T16:54:59.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.353+0000 7eff3b466700 1 -- 172.21.15.8:0/438644613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff34131400 con 0x7eff34137750 2023-10-14T16:54:59.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.354+0000 7eff3b466700 1 -- 172.21.15.8:0/438644613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff341340c0 con 0x7eff34137750 2023-10-14T16:54:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.355+0000 7eff317fa700 1 -- 172.21.15.8:0/438644613 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff2801b3b0 con 0x7eff34137750 2023-10-14T16:54:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.355+0000 7eff317fa700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7eff20066f30 0x7eff200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.355+0000 7eff317fa700 1 -- 172.21.15.8:0/438644613 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7eff28083790 con 0x7eff34137750 2023-10-14T16:54:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.355+0000 7eff39202700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7eff20066f30 0x7eff200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:59.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.355+0000 7eff39202700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7eff20066f30 0x7eff200693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff340a6b10 tx=0x7eff2c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:59.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.359+0000 7eff317fa700 1 -- 172.21.15.8:0/438644613 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff28050f60 con 0x7eff34137750 2023-10-14T16:54:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.546+0000 7eff3b466700 1 -- 172.21.15.8:0/438644613 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff3406b680 con 0x7eff20066f30 2023-10-14T16:54:59.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.553+0000 7eff317fa700 1 -- 172.21.15.8:0/438644613 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271306 (secure 0 0 0) 0x7eff3406b680 con 0x7eff20066f30 2023-10-14T16:54:59.557 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:59.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.557+0000 7eff3b466700 1 -- 172.21.15.8:0/438644613 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7eff20066f30 msgr2=0x7eff200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.557+0000 7eff3b466700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7eff20066f30 0x7eff200693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff340a6b10 tx=0x7eff2c017000 comp rx=0 tx=0).stop 2023-10-14T16:54:59.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.557+0000 7eff3b466700 1 -- 172.21.15.8:0/438644613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff34137750 msgr2=0x7eff3409a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.557+0000 7eff3b466700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff34137750 0x7eff3409a3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7eff2800c790 tx=0x7eff28007e10 comp rx=0 tx=0).stop 2023-10-14T16:54:59.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.557+0000 7eff3b466700 1 -- 172.21.15.8:0/438644613 shutdown_connections 2023-10-14T16:54:59.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.557+0000 7eff3b466700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7eff20066f30 0x7eff200693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.557+0000 7eff3b466700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff341337b0 0x7eff3409a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.557+0000 7eff3b466700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff340a3550 0x7eff34099e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.557+0000 7eff3b466700 1 --2- 172.21.15.8:0/438644613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff34137750 0x7eff3409a3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.557+0000 7eff3b466700 1 -- 172.21.15.8:0/438644613 >> 172.21.15.8:0/438644613 conn(0x7eff340701c0 msgr2=0x7eff34067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:59.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.557+0000 7eff3b466700 1 -- 172.21.15.8:0/438644613 shutdown_connections 2023-10-14T16:54:59.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.557+0000 7eff3b466700 1 -- 172.21.15.8:0/438644613 wait complete. 2023-10-14T16:54:59.562 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T16:54:59.569 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-14T16:54:57.981680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1190956,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":1189120,"kb_avail":376296404,"statfs":{"total":386547056640,"available":385327517696,"internally_reserved":0,"allocated":1847296,"data_stored":1382091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1217658880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.909284"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097675+0000","last_change":"2023-10-14T16:54:55.097675+0000","last_active":"2023-10-14T16:54:55.097675+0000","last_peered":"2023-10-14T16:54:55.097675+0000","last_clean":"2023-10-14T16:54:55.097675+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T16:54:55.097675+0000","last_undegraded":"2023-10-14T16:54:55.097675+0000","last_fullsized":"2023-10-14T16:54:55.097675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103871+0000","last_change":"2023-10-14T16:54:55.097479+0000","last_active":"2023-10-14T16:54:55.103871+0000","last_peered":"2023-10-14T16:54:55.103871+0000","last_clean":"2023-10-14T16:54:55.103871+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T16:54:55.103871+0000","last_undegraded":"2023-10-14T16:54:55.103871+0000","last_fullsized":"2023-10-14T16:54:55.103871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108409+0000","last_change":"2023-10-14T16:54:55.104594+0000","last_active":"2023-10-14T16:54:55.108409+0000","last_peered":"2023-10-14T16:54:55.108409+0000","last_clean":"2023-10-14T16:54:55.108409+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T16:54:55.108409+0000","last_undegraded":"2023-10-14T16:54:55.108409+0000","last_fullsized":"2023-10-14T16:54:55.108409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:56.343441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.104504+0000","last_change":"2023-10-14T16:54:55.095745+0000","last_active":"2023-10-14T16:54:55.104504+0000","last_peered":"2023-10-14T16:54:55.104504+0000","last_clean":"2023-10-14T16:54:55.104504+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T16:54:55.104504+0000","last_undegraded":"2023-10-14T16:54:55.104504+0000","last_fullsized":"2023-10-14T16:54:55.104504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:05.483417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097176+0000","last_change":"2023-10-14T16:54:55.097176+0000","last_active":"2023-10-14T16:54:55.097176+0000","last_peered":"2023-10-14T16:54:55.097176+0000","last_clean":"2023-10-14T16:54:55.097176+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T16:54:55.097176+0000","last_undegraded":"2023-10-14T16:54:55.097176+0000","last_fullsized":"2023-10-14T16:54:55.097176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098736+0000","last_change":"2023-10-14T16:54:55.093518+0000","last_active":"2023-10-14T16:54:55.098736+0000","last_peered":"2023-10-14T16:54:55.098736+0000","last_clean":"2023-10-14T16:54:55.098736+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T16:54:55.098736+0000","last_undegraded":"2023-10-14T16:54:55.098736+0000","last_fullsized":"2023-10-14T16:54:55.098736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:59.572769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098385+0000","last_change":"2023-10-14T16:54:55.093397+0000","last_active":"2023-10-14T16:54:55.098385+0000","last_peered":"2023-10-14T16:54:55.098385+0000","last_clean":"2023-10-14T16:54:55.098385+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T16:54:55.098385+0000","last_undegraded":"2023-10-14T16:54:55.098385+0000","last_fullsized":"2023-10-14T16:54:55.098385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:15:51.621106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098357+0000","last_change":"2023-10-14T16:54:55.093119+0000","last_active":"2023-10-14T16:54:55.098357+0000","last_peered":"2023-10-14T16:54:55.098357+0000","last_clean":"2023-10-14T16:54:55.098357+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T16:54:55.098357+0000","last_undegraded":"2023-10-14T16:54:55.098357+0000","last_fullsized":"2023-10-14T16:54:55.098357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:40.295415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097926+0000","last_change":"2023-10-14T16:54:55.097926+0000","last_active":"2023-10-14T16:54:55.097926+0000","last_peered":"2023-10-14T16:54:55.097926+0000","last_clean":"2023-10-14T16:54:55.097926+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T16:54:55.097926+0000","last_undegraded":"2023-10-14T16:54:55.097926+0000","last_fullsized":"2023-10-14T16:54:55.097926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098770+0000","last_change":"2023-10-14T16:54:55.094293+0000","last_active":"2023-10-14T16:54:55.098770+0000","last_peered":"2023-10-14T16:54:55.098770+0000","last_clean":"2023-10-14T16:54:55.098770+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T16:54:55.098770+0000","last_undegraded":"2023-10-14T16:54:55.098770+0000","last_fullsized":"2023-10-14T16:54:55.098770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:54:37.853332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103951+0000","last_change":"2023-10-14T16:54:55.097944+0000","last_active":"2023-10-14T16:54:55.103951+0000","last_peered":"2023-10-14T16:54:55.103951+0000","last_clean":"2023-10-14T16:54:55.103951+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T16:54:55.103951+0000","last_undegraded":"2023-10-14T16:54:55.103951+0000","last_fullsized":"2023-10-14T16:54:55.103951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:18:19.208533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107384+0000","last_change":"2023-10-14T16:54:55.100123+0000","last_active":"2023-10-14T16:54:55.107384+0000","last_peered":"2023-10-14T16:54:55.107384+0000","last_clean":"2023-10-14T16:54:55.107384+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T16:54:55.107384+0000","last_undegraded":"2023-10-14T16:54:55.107384+0000","last_fullsized":"2023-10-14T16:54:55.107384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092337+0000","last_change":"2023-10-14T16:54:55.092337+0000","last_active":"2023-10-14T16:54:55.092337+0000","last_peered":"2023-10-14T16:54:55.092337+0000","last_clean":"2023-10-14T16:54:55.092337+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T16:54:55.092337+0000","last_undegraded":"2023-10-14T16:54:55.092337+0000","last_fullsized":"2023-10-14T16:54:55.092337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:13.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109719+0000","last_change":"2023-10-14T16:54:55.107518+0000","last_active":"2023-10-14T16:54:55.109719+0000","last_peered":"2023-10-14T16:54:55.109719+0000","last_clean":"2023-10-14T16:54:55.109719+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T16:54:55.109719+0000","last_undegraded":"2023-10-14T16:54:55.109719+0000","last_fullsized":"2023-10-14T16:54:55.109719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103788+0000","last_change":"2023-10-14T16:54:55.097498+0000","last_active":"2023-10-14T16:54:55.103788+0000","last_peered":"2023-10-14T16:54:55.103788+0000","last_clean":"2023-10-14T16:54:55.103788+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T16:54:55.103788+0000","last_undegraded":"2023-10-14T16:54:55.103788+0000","last_fullsized":"2023-10-14T16:54:55.103788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098786+0000","last_change":"2023-10-14T16:54:55.094124+0000","last_active":"2023-10-14T16:54:55.098786+0000","last_peered":"2023-10-14T16:54:55.098786+0000","last_clean":"2023-10-14T16:54:55.098786+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T16:54:55.098786+0000","last_undegraded":"2023-10-14T16:54:55.098786+0000","last_fullsized":"2023-10-14T16:54:55.098786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:41:12.510526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096559+0000","last_change":"2023-10-14T16:54:55.096559+0000","last_active":"2023-10-14T16:54:55.096559+0000","last_peered":"2023-10-14T16:54:55.096559+0000","last_clean":"2023-10-14T16:54:55.096559+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T16:54:55.096559+0000","last_undegraded":"2023-10-14T16:54:55.096559+0000","last_fullsized":"2023-10-14T16:54:55.096559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106652+0000","last_change":"2023-10-14T16:54:55.100473+0000","last_active":"2023-10-14T16:54:55.106652+0000","last_peered":"2023-10-14T16:54:55.106652+0000","last_clean":"2023-10-14T16:54:55.106652+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T16:54:55.106652+0000","last_undegraded":"2023-10-14T16:54:55.106652+0000","last_fullsized":"2023-10-14T16:54:55.106652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.091193+0000","last_change":"2023-10-14T16:54:55.091193+0000","last_active":"2023-10-14T16:54:55.091193+0000","last_peered":"2023-10-14T16:54:55.091193+0000","last_clean":"2023-10-14T16:54:55.091193+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T16:54:55.091193+0000","last_undegraded":"2023-10-14T16:54:55.091193+0000","last_fullsized":"2023-10-14T16:54:55.091193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106722+0000","last_change":"2023-10-14T16:54:55.100781+0000","last_active":"2023-10-14T16:54:55.106722+0000","last_peered":"2023-10-14T16:54:55.106722+0000","last_clean":"2023-10-14T16:54:55.106722+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T16:54:55.106722+0000","last_undegraded":"2023-10-14T16:54:55.106722+0000","last_fullsized":"2023-10-14T16:54:55.106722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109399+0000","last_change":"2023-10-14T16:54:55.107643+0000","last_active":"2023-10-14T16:54:55.109399+0000","last_peered":"2023-10-14T16:54:55.109399+0000","last_clean":"2023-10-14T16:54:55.109399+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T16:54:55.109399+0000","last_undegraded":"2023-10-14T16:54:55.109399+0000","last_fullsized":"2023-10-14T16:54:55.109399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096743+0000","last_change":"2023-10-14T16:54:55.096743+0000","last_active":"2023-10-14T16:54:55.096743+0000","last_peered":"2023-10-14T16:54:55.096743+0000","last_clean":"2023-10-14T16:54:55.096743+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T16:54:55.096743+0000","last_undegraded":"2023-10-14T16:54:55.096743+0000","last_fullsized":"2023-10-14T16:54:55.096743+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110324+0000","last_change":"2023-10-14T16:54:55.102779+0000","last_active":"2023-10-14T16:54:55.110324+0000","last_peered":"2023-10-14T16:54:55.110324+0000","last_clean":"2023-10-14T16:54:55.110324+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T16:54:55.110324+0000","last_undegraded":"2023-10-14T16:54:55.110324+0000","last_fullsized":"2023-10-14T16:54:55.110324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106674+0000","last_change":"2023-10-14T16:54:55.100535+0000","last_active":"2023-10-14T16:54:55.106674+0000","last_peered":"2023-10-14T16:54:55.106674+0000","last_clean":"2023-10-14T16:54:55.106674+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T16:54:55.106674+0000","last_undegraded":"2023-10-14T16:54:55.106674+0000","last_fullsized":"2023-10-14T16:54:55.106674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108676+0000","last_change":"2023-10-14T16:54:55.100833+0000","last_active":"2023-10-14T16:54:55.108676+0000","last_peered":"2023-10-14T16:54:55.108676+0000","last_clean":"2023-10-14T16:54:55.108676+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T16:54:55.108676+0000","last_undegraded":"2023-10-14T16:54:55.108676+0000","last_fullsized":"2023-10-14T16:54:55.108676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111018+0000","last_change":"2023-10-14T16:54:55.107516+0000","last_active":"2023-10-14T16:54:55.111018+0000","last_peered":"2023-10-14T16:54:55.111018+0000","last_clean":"2023-10-14T16:54:55.111018+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T16:54:55.111018+0000","last_undegraded":"2023-10-14T16:54:55.111018+0000","last_fullsized":"2023-10-14T16:54:55.111018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108427+0000","last_change":"2023-10-14T16:54:55.104794+0000","last_active":"2023-10-14T16:54:55.108427+0000","last_peered":"2023-10-14T16:54:55.108427+0000","last_clean":"2023-10-14T16:54:55.108427+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T16:54:55.108427+0000","last_undegraded":"2023-10-14T16:54:55.108427+0000","last_fullsized":"2023-10-14T16:54:55.108427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:46.761206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.112011+0000","last_change":"2023-10-14T16:54:54.101946+0000","last_active":"2023-10-14T16:54:55.112011+0000","last_peered":"2023-10-14T16:54:55.112011+0000","last_clean":"2023-10-14T16:54:55.112011+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T16:54:55.112011+0000","last_undegraded":"2023-10-14T16:54:55.112011+0000","last_fullsized":"2023-10-14T16:54:55.112011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097502+0000","last_change":"2023-10-14T16:54:55.097502+0000","last_active":"2023-10-14T16:54:55.097502+0000","last_peered":"2023-10-14T16:54:55.097502+0000","last_clean":"2023-10-14T16:54:55.097502+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T16:54:55.097502+0000","last_undegraded":"2023-10-14T16:54:55.097502+0000","last_fullsized":"2023-10-14T16:54:55.097502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092311+0000","last_change":"2023-10-14T16:54:54.096872+0000","last_active":"2023-10-14T16:54:55.092311+0000","last_peered":"2023-10-14T16:54:55.092311+0000","last_clean":"2023-10-14T16:54:55.092311+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T16:54:55.092311+0000","last_undegraded":"2023-10-14T16:54:55.092311+0000","last_fullsized":"2023-10-14T16:54:55.092311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090799+0000","last_change":"2023-10-14T16:54:55.090799+0000","last_active":"2023-10-14T16:54:55.090799+0000","last_peered":"2023-10-14T16:54:55.090799+0000","last_clean":"2023-10-14T16:54:55.090799+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T16:54:55.090799+0000","last_undegraded":"2023-10-14T16:54:55.090799+0000","last_fullsized":"2023-10-14T16:54:55.090799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093342+0000","last_change":"2023-10-14T16:54:54.094974+0000","last_active":"2023-10-14T16:54:55.093342+0000","last_peered":"2023-10-14T16:54:55.093342+0000","last_clean":"2023-10-14T16:54:55.093342+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T16:54:55.093342+0000","last_undegraded":"2023-10-14T16:54:55.093342+0000","last_fullsized":"2023-10-14T16:54:55.093342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107286+0000","last_change":"2023-10-14T16:54:55.100446+0000","last_active":"2023-10-14T16:54:55.107286+0000","last_peered":"2023-10-14T16:54:55.107286+0000","last_clean":"2023-10-14T16:54:55.107286+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T16:54:55.107286+0000","last_undegraded":"2023-10-14T16:54:55.107286+0000","last_fullsized":"2023-10-14T16:54:55.107286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T16:54:54.100158+0000","last_change":"2023-10-14T16:54:54.098193+0000","last_active":"2023-10-14T16:54:54.100158+0000","last_peered":"2023-10-14T16:54:54.100158+0000","last_clean":"2023-10-14T16:54:54.100158+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T16:54:54.100158+0000","last_undegraded":"2023-10-14T16:54:54.100158+0000","last_fullsized":"2023-10-14T16:54:54.100158+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:33.333473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106735+0000","last_change":"2023-10-14T16:54:55.099120+0000","last_active":"2023-10-14T16:54:55.106735+0000","last_peered":"2023-10-14T16:54:55.106735+0000","last_clean":"2023-10-14T16:54:55.106735+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T16:54:55.106735+0000","last_undegraded":"2023-10-14T16:54:55.106735+0000","last_fullsized":"2023-10-14T16:54:55.106735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090823+0000","last_change":"2023-10-14T16:54:54.100620+0000","last_active":"2023-10-14T16:54:55.090823+0000","last_peered":"2023-10-14T16:54:55.090823+0000","last_clean":"2023-10-14T16:54:55.090823+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T16:54:55.090823+0000","last_undegraded":"2023-10-14T16:54:55.090823+0000","last_fullsized":"2023-10-14T16:54:55.090823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090564+0000","last_change":"2023-10-14T16:54:55.090564+0000","last_active":"2023-10-14T16:54:55.090564+0000","last_peered":"2023-10-14T16:54:55.090564+0000","last_clean":"2023-10-14T16:54:55.090564+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T16:54:55.090564+0000","last_undegraded":"2023-10-14T16:54:55.090564+0000","last_fullsized":"2023-10-14T16:54:55.090564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108412+0000","last_change":"2023-10-14T16:54:54.097908+0000","last_active":"2023-10-14T16:54:55.108412+0000","last_peered":"2023-10-14T16:54:55.108412+0000","last_clean":"2023-10-14T16:54:55.108412+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T16:54:55.108412+0000","last_undegraded":"2023-10-14T16:54:55.108412+0000","last_fullsized":"2023-10-14T16:54:55.108412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110759+0000","last_change":"2023-10-14T16:54:55.104734+0000","last_active":"2023-10-14T16:54:55.110759+0000","last_peered":"2023-10-14T16:54:55.110759+0000","last_clean":"2023-10-14T16:54:55.110759+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T16:54:55.110759+0000","last_undegraded":"2023-10-14T16:54:55.110759+0000","last_fullsized":"2023-10-14T16:54:55.110759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110608+0000","last_change":"2023-10-14T16:54:54.098933+0000","last_active":"2023-10-14T16:54:55.110608+0000","last_peered":"2023-10-14T16:54:55.110608+0000","last_clean":"2023-10-14T16:54:55.110608+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T16:54:55.110608+0000","last_undegraded":"2023-10-14T16:54:55.110608+0000","last_fullsized":"2023-10-14T16:54:55.110608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:47.391039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103770+0000","last_change":"2023-10-14T16:54:55.096816+0000","last_active":"2023-10-14T16:54:55.103770+0000","last_peered":"2023-10-14T16:54:55.103770+0000","last_clean":"2023-10-14T16:54:55.103770+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T16:54:55.103770+0000","last_undegraded":"2023-10-14T16:54:55.103770+0000","last_fullsized":"2023-10-14T16:54:55.103770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106918+0000","last_change":"2023-10-14T16:54:54.103486+0000","last_active":"2023-10-14T16:54:55.106918+0000","last_peered":"2023-10-14T16:54:55.106918+0000","last_clean":"2023-10-14T16:54:55.106918+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T16:54:55.106918+0000","last_undegraded":"2023-10-14T16:54:55.106918+0000","last_fullsized":"2023-10-14T16:54:55.106918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111007+0000","last_change":"2023-10-14T16:54:55.108934+0000","last_active":"2023-10-14T16:54:55.111007+0000","last_peered":"2023-10-14T16:54:55.111007+0000","last_clean":"2023-10-14T16:54:55.111007+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T16:54:55.111007+0000","last_undegraded":"2023-10-14T16:54:55.111007+0000","last_fullsized":"2023-10-14T16:54:55.111007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T16:54:54.098983+0000","last_change":"2023-10-14T16:54:54.098087+0000","last_active":"2023-10-14T16:54:54.098983+0000","last_peered":"2023-10-14T16:54:54.098983+0000","last_clean":"2023-10-14T16:54:54.098983+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T16:54:54.098983+0000","last_undegraded":"2023-10-14T16:54:54.098983+0000","last_fullsized":"2023-10-14T16:54:54.098983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:48.428626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108444+0000","last_change":"2023-10-14T16:54:55.104902+0000","last_active":"2023-10-14T16:54:55.108444+0000","last_peered":"2023-10-14T16:54:55.108444+0000","last_clean":"2023-10-14T16:54:55.108444+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T16:54:55.108444+0000","last_undegraded":"2023-10-14T16:54:55.108444+0000","last_fullsized":"2023-10-14T16:54:55.108444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:21:19.831648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085257+0000","last_change":"2023-10-14T16:54:54.099046+0000","last_active":"2023-10-14T16:54:55.085257+0000","last_peered":"2023-10-14T16:54:55.085257+0000","last_clean":"2023-10-14T16:54:55.085257+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T16:54:55.085257+0000","last_undegraded":"2023-10-14T16:54:55.085257+0000","last_fullsized":"2023-10-14T16:54:55.085257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:13.092692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092929+0000","last_change":"2023-10-14T16:54:55.092929+0000","last_active":"2023-10-14T16:54:55.092929+0000","last_peered":"2023-10-14T16:54:55.092929+0000","last_clean":"2023-10-14T16:54:55.092929+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T16:54:55.092929+0000","last_undegraded":"2023-10-14T16:54:55.092929+0000","last_fullsized":"2023-10-14T16:54:55.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:06.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109884+0000","last_change":"2023-10-14T16:54:54.099281+0000","last_active":"2023-10-14T16:54:55.109884+0000","last_peered":"2023-10-14T16:54:55.109884+0000","last_clean":"2023-10-14T16:54:55.109884+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T16:54:55.109884+0000","last_undegraded":"2023-10-14T16:54:55.109884+0000","last_fullsized":"2023-10-14T16:54:55.109884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099743+0000","last_change":"2023-10-14T16:54:55.099743+0000","last_active":"2023-10-14T16:54:55.099743+0000","last_peered":"2023-10-14T16:54:55.099743+0000","last_clean":"2023-10-14T16:54:55.099743+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T16:54:55.099743+0000","last_undegraded":"2023-10-14T16:54:55.099743+0000","last_fullsized":"2023-10-14T16:54:55.099743+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108028+0000","last_change":"2023-10-14T16:54:54.100726+0000","last_active":"2023-10-14T16:54:55.108028+0000","last_peered":"2023-10-14T16:54:55.108028+0000","last_clean":"2023-10-14T16:54:55.108028+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T16:54:55.108028+0000","last_undegraded":"2023-10-14T16:54:55.108028+0000","last_fullsized":"2023-10-14T16:54:55.108028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098409+0000","last_change":"2023-10-14T16:54:55.093470+0000","last_active":"2023-10-14T16:54:55.098409+0000","last_peered":"2023-10-14T16:54:55.098409+0000","last_clean":"2023-10-14T16:54:55.098409+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T16:54:55.098409+0000","last_undegraded":"2023-10-14T16:54:55.098409+0000","last_fullsized":"2023-10-14T16:54:55.098409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.112167+0000","last_change":"2023-10-14T16:54:54.097646+0000","last_active":"2023-10-14T16:54:55.112167+0000","last_peered":"2023-10-14T16:54:55.112167+0000","last_clean":"2023-10-14T16:54:55.112167+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T16:54:55.112167+0000","last_undegraded":"2023-10-14T16:54:55.112167+0000","last_fullsized":"2023-10-14T16:54:55.112167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103764+0000","last_change":"2023-10-14T16:54:55.097471+0000","last_active":"2023-10-14T16:54:55.103764+0000","last_peered":"2023-10-14T16:54:55.103764+0000","last_clean":"2023-10-14T16:54:55.103764+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T16:54:55.103764+0000","last_undegraded":"2023-10-14T16:54:55.103764+0000","last_fullsized":"2023-10-14T16:54:55.103764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108356+0000","last_change":"2023-10-14T16:54:54.100923+0000","last_active":"2023-10-14T16:54:55.108356+0000","last_peered":"2023-10-14T16:54:55.108356+0000","last_clean":"2023-10-14T16:54:55.108356+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T16:54:55.108356+0000","last_undegraded":"2023-10-14T16:54:55.108356+0000","last_fullsized":"2023-10-14T16:54:55.108356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.104043+0000","last_change":"2023-10-14T16:54:55.096945+0000","last_active":"2023-10-14T16:54:55.104043+0000","last_peered":"2023-10-14T16:54:55.104043+0000","last_clean":"2023-10-14T16:54:55.104043+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T16:54:55.104043+0000","last_undegraded":"2023-10-14T16:54:55.104043+0000","last_fullsized":"2023-10-14T16:54:55.104043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.084866+0000","last_change":"2023-10-14T16:54:54.099363+0000","last_active":"2023-10-14T16:54:55.084866+0000","last_peered":"2023-10-14T16:54:55.084866+0000","last_clean":"2023-10-14T16:54:55.084866+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T16:54:55.084866+0000","last_undegraded":"2023-10-14T16:54:55.084866+0000","last_fullsized":"2023-10-14T16:54:55.084866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.124832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097957+0000","last_change":"2023-10-14T16:54:55.097957+0000","last_active":"2023-10-14T16:54:55.097957+0000","last_peered":"2023-10-14T16:54:55.097957+0000","last_clean":"2023-10-14T16:54:55.097957+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T16:54:55.097957+0000","last_undegraded":"2023-10-14T16:54:55.097957+0000","last_fullsized":"2023-10-14T16:54:55.097957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110707+0000","last_change":"2023-10-14T16:54:54.093771+0000","last_active":"2023-10-14T16:54:55.110707+0000","last_peered":"2023-10-14T16:54:55.110707+0000","last_clean":"2023-10-14T16:54:55.110707+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T16:54:55.110707+0000","last_undegraded":"2023-10-14T16:54:55.110707+0000","last_fullsized":"2023-10-14T16:54:55.110707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106694+0000","last_change":"2023-10-14T16:54:55.100663+0000","last_active":"2023-10-14T16:54:55.106694+0000","last_peered":"2023-10-14T16:54:55.106694+0000","last_clean":"2023-10-14T16:54:55.106694+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T16:54:55.106694+0000","last_undegraded":"2023-10-14T16:54:55.106694+0000","last_fullsized":"2023-10-14T16:54:55.106694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085907+0000","last_change":"2023-10-14T16:54:54.103401+0000","last_active":"2023-10-14T16:54:55.085907+0000","last_peered":"2023-10-14T16:54:55.085907+0000","last_clean":"2023-10-14T16:54:55.085907+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T16:54:55.085907+0000","last_undegraded":"2023-10-14T16:54:55.085907+0000","last_fullsized":"2023-10-14T16:54:55.085907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:28.931284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099217+0000","last_change":"2023-10-14T16:54:55.096406+0000","last_active":"2023-10-14T16:54:55.099217+0000","last_peered":"2023-10-14T16:54:55.099217+0000","last_clean":"2023-10-14T16:54:55.099217+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T16:54:55.099217+0000","last_undegraded":"2023-10-14T16:54:55.099217+0000","last_fullsized":"2023-10-14T16:54:55.099217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085465+0000","last_change":"2023-10-14T16:54:54.099084+0000","last_active":"2023-10-14T16:54:55.085465+0000","last_peered":"2023-10-14T16:54:55.085465+0000","last_clean":"2023-10-14T16:54:55.085465+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T16:54:55.085465+0000","last_undegraded":"2023-10-14T16:54:55.085465+0000","last_fullsized":"2023-10-14T16:54:55.085465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:27.318420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096109+0000","last_change":"2023-10-14T16:54:55.094077+0000","last_active":"2023-10-14T16:54:55.096109+0000","last_peered":"2023-10-14T16:54:55.096109+0000","last_clean":"2023-10-14T16:54:55.096109+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T16:54:55.096109+0000","last_undegraded":"2023-10-14T16:54:55.096109+0000","last_fullsized":"2023-10-14T16:54:55.096109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:12.562614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093276+0000","last_change":"2023-10-14T16:54:54.095927+0000","last_active":"2023-10-14T16:54:55.093276+0000","last_peered":"2023-10-14T16:54:55.093276+0000","last_clean":"2023-10-14T16:54:55.093276+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T16:54:55.093276+0000","last_undegraded":"2023-10-14T16:54:55.093276+0000","last_fullsized":"2023-10-14T16:54:55.093276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110839+0000","last_change":"2023-10-14T16:54:55.106702+0000","last_active":"2023-10-14T16:54:55.110839+0000","last_peered":"2023-10-14T16:54:55.110839+0000","last_clean":"2023-10-14T16:54:55.110839+0000","last_became_active":"2023-10-14T16:54:55.105853+0000","last_became_peered":"2023-10-14T16:54:55.105853+0000","last_unstale":"2023-10-14T16:54:55.110839+0000","last_undegraded":"2023-10-14T16:54:55.110839+0000","last_fullsized":"2023-10-14T16:54:55.110839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110438+0000","last_change":"2023-10-14T16:54:54.092032+0000","last_active":"2023-10-14T16:54:55.110438+0000","last_peered":"2023-10-14T16:54:55.110438+0000","last_clean":"2023-10-14T16:54:55.110438+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T16:54:55.110438+0000","last_undegraded":"2023-10-14T16:54:55.110438+0000","last_fullsized":"2023-10-14T16:54:55.110438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090798+0000","last_change":"2023-10-14T16:54:49.689264+0000","last_active":"2023-10-14T16:54:55.090798+0000","last_peered":"2023-10-14T16:54:55.090798+0000","last_clean":"2023-10-14T16:54:55.090798+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T16:54:55.090798+0000","last_undegraded":"2023-10-14T16:54:55.090798+0000","last_fullsized":"2023-10-14T16:54:55.090798+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092208+0000","last_change":"2023-10-14T16:54:55.092208+0000","last_active":"2023-10-14T16:54:55.092208+0000","last_peered":"2023-10-14T16:54:55.092208+0000","last_clean":"2023-10-14T16:54:55.092208+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T16:54:55.092208+0000","last_undegraded":"2023-10-14T16:54:55.092208+0000","last_fullsized":"2023-10-14T16:54:55.092208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.094564+0000","last_change":"2023-10-14T16:54:49.063336+0000","last_active":"2023-10-14T16:54:55.094564+0000","last_peered":"2023-10-14T16:54:55.094564+0000","last_clean":"2023-10-14T16:54:55.094564+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T16:54:55.094564+0000","last_undegraded":"2023-10-14T16:54:55.094564+0000","last_fullsized":"2023-10-14T16:54:55.094564+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T16:54:54.094906+0000","last_change":"2023-10-14T16:54:54.093189+0000","last_active":"2023-10-14T16:54:54.094906+0000","last_peered":"2023-10-14T16:54:54.094906+0000","last_clean":"2023-10-14T16:54:54.094906+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T16:54:54.094906+0000","last_undegraded":"2023-10-14T16:54:54.094906+0000","last_fullsized":"2023-10-14T16:54:54.094906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:47.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096057+0000","last_change":"2023-10-14T16:54:55.094019+0000","last_active":"2023-10-14T16:54:55.096057+0000","last_peered":"2023-10-14T16:54:55.096057+0000","last_clean":"2023-10-14T16:54:55.096057+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T16:54:55.096057+0000","last_undegraded":"2023-10-14T16:54:55.096057+0000","last_fullsized":"2023-10-14T16:54:55.096057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:48.395824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092213+0000","last_change":"2023-10-14T16:54:49.063688+0000","last_active":"2023-10-14T16:54:55.092213+0000","last_peered":"2023-10-14T16:54:55.092213+0000","last_clean":"2023-10-14T16:54:55.092213+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T16:54:55.092213+0000","last_undegraded":"2023-10-14T16:54:55.092213+0000","last_fullsized":"2023-10-14T16:54:55.092213+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:29.004325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'117","reported_seq":163,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085888+0000","last_change":"2023-10-14T16:54:49.063307+0000","last_active":"2023-10-14T16:54:55.085888+0000","last_peered":"2023-10-14T16:54:55.085888+0000","last_clean":"2023-10-14T16:54:55.085888+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T16:54:55.085888+0000","last_undegraded":"2023-10-14T16:54:55.085888+0000","last_fullsized":"2023-10-14T16:54:55.085888+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T16:54:54.100203+0000","last_change":"2023-10-14T16:54:54.098588+0000","last_active":"2023-10-14T16:54:54.100203+0000","last_peered":"2023-10-14T16:54:54.100203+0000","last_clean":"2023-10-14T16:54:54.100203+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T16:54:54.100203+0000","last_undegraded":"2023-10-14T16:54:54.100203+0000","last_fullsized":"2023-10-14T16:54:54.100203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:18.107600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096261+0000","last_change":"2023-10-14T16:54:55.096261+0000","last_active":"2023-10-14T16:54:55.096261+0000","last_peered":"2023-10-14T16:54:55.096261+0000","last_clean":"2023-10-14T16:54:55.096261+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T16:54:55.096261+0000","last_undegraded":"2023-10-14T16:54:55.096261+0000","last_fullsized":"2023-10-14T16:54:55.096261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090234+0000","last_change":"2023-10-14T16:54:49.689356+0000","last_active":"2023-10-14T16:54:55.090234+0000","last_peered":"2023-10-14T16:54:55.090234+0000","last_clean":"2023-10-14T16:54:55.090234+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T16:54:55.090234+0000","last_undegraded":"2023-10-14T16:54:55.090234+0000","last_fullsized":"2023-10-14T16:54:55.090234+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093393+0000","last_change":"2023-10-14T16:54:54.093196+0000","last_active":"2023-10-14T16:54:55.093393+0000","last_peered":"2023-10-14T16:54:55.093393+0000","last_clean":"2023-10-14T16:54:55.093393+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T16:54:55.093393+0000","last_undegraded":"2023-10-14T16:54:55.093393+0000","last_fullsized":"2023-10-14T16:54:55.093393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110822+0000","last_change":"2023-10-14T16:54:55.106633+0000","last_active":"2023-10-14T16:54:55.110822+0000","last_peered":"2023-10-14T16:54:55.110822+0000","last_clean":"2023-10-14T16:54:55.110822+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T16:54:55.110822+0000","last_undegraded":"2023-10-14T16:54:55.110822+0000","last_fullsized":"2023-10-14T16:54:55.110822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085827+0000","last_change":"2023-10-14T16:54:49.689595+0000","last_active":"2023-10-14T16:54:55.085827+0000","last_peered":"2023-10-14T16:54:55.085827+0000","last_clean":"2023-10-14T16:54:55.085827+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T16:54:55.085827+0000","last_undegraded":"2023-10-14T16:54:55.085827+0000","last_fullsized":"2023-10-14T16:54:55.085827+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:46:44.177180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.091900+0000","last_change":"2023-10-14T16:54:54.099381+0000","last_active":"2023-10-14T16:54:55.091900+0000","last_peered":"2023-10-14T16:54:55.091900+0000","last_clean":"2023-10-14T16:54:55.091900+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T16:54:55.091900+0000","last_undegraded":"2023-10-14T16:54:55.091900+0000","last_fullsized":"2023-10-14T16:54:55.091900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099236+0000","last_change":"2023-10-14T16:54:55.096667+0000","last_active":"2023-10-14T16:54:55.099236+0000","last_peered":"2023-10-14T16:54:55.099236+0000","last_clean":"2023-10-14T16:54:55.099236+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T16:54:55.099236+0000","last_undegraded":"2023-10-14T16:54:55.099236+0000","last_fullsized":"2023-10-14T16:54:55.099236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085362+0000","last_change":"2023-10-14T16:54:49.689614+0000","last_active":"2023-10-14T16:54:55.085362+0000","last_peered":"2023-10-14T16:54:55.085362+0000","last_clean":"2023-10-14T16:54:55.085362+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T16:54:55.085362+0000","last_undegraded":"2023-10-14T16:54:55.085362+0000","last_fullsized":"2023-10-14T16:54:55.085362+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:09.272835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090680+0000","last_change":"2023-10-14T16:54:54.100656+0000","last_active":"2023-10-14T16:54:55.090680+0000","last_peered":"2023-10-14T16:54:55.090680+0000","last_clean":"2023-10-14T16:54:55.090680+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T16:54:55.090680+0000","last_undegraded":"2023-10-14T16:54:55.090680+0000","last_fullsized":"2023-10-14T16:54:55.090680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111077+0000","last_change":"2023-10-14T16:54:55.109319+0000","last_active":"2023-10-14T16:54:55.111077+0000","last_peered":"2023-10-14T16:54:55.111077+0000","last_clean":"2023-10-14T16:54:55.111077+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T16:54:55.111077+0000","last_undegraded":"2023-10-14T16:54:55.111077+0000","last_fullsized":"2023-10-14T16:54:55.111077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.087246+0000","last_change":"2023-10-14T16:54:49.689836+0000","last_active":"2023-10-14T16:54:55.087246+0000","last_peered":"2023-10-14T16:54:55.087246+0000","last_clean":"2023-10-14T16:54:55.087246+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T16:54:55.087246+0000","last_undegraded":"2023-10-14T16:54:55.087246+0000","last_fullsized":"2023-10-14T16:54:55.087246+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:24.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.094686+0000","last_change":"2023-10-14T16:54:54.096618+0000","last_active":"2023-10-14T16:54:55.094686+0000","last_peered":"2023-10-14T16:54:55.094686+0000","last_clean":"2023-10-14T16:54:55.094686+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T16:54:55.094686+0000","last_undegraded":"2023-10-14T16:54:55.094686+0000","last_fullsized":"2023-10-14T16:54:55.094686+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090211+0000","last_change":"2023-10-14T16:54:55.090211+0000","last_active":"2023-10-14T16:54:55.090211+0000","last_peered":"2023-10-14T16:54:55.090211+0000","last_clean":"2023-10-14T16:54:55.090211+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T16:54:55.090211+0000","last_undegraded":"2023-10-14T16:54:55.090211+0000","last_fullsized":"2023-10-14T16:54:55.090211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085714+0000","last_change":"2023-10-14T16:54:49.064767+0000","last_active":"2023-10-14T16:54:55.085714+0000","last_peered":"2023-10-14T16:54:55.085714+0000","last_clean":"2023-10-14T16:54:55.085714+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T16:54:55.085714+0000","last_undegraded":"2023-10-14T16:54:55.085714+0000","last_fullsized":"2023-10-14T16:54:55.085714+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:34:26.616500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090367+0000","last_change":"2023-10-14T16:54:54.106280+0000","last_active":"2023-10-14T16:54:55.090367+0000","last_peered":"2023-10-14T16:54:55.090367+0000","last_clean":"2023-10-14T16:54:55.090367+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T16:54:55.090367+0000","last_undegraded":"2023-10-14T16:54:55.090367+0000","last_fullsized":"2023-10-14T16:54:55.090367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107145+0000","last_change":"2023-10-14T16:54:55.100415+0000","last_active":"2023-10-14T16:54:55.107145+0000","last_peered":"2023-10-14T16:54:55.107145+0000","last_clean":"2023-10-14T16:54:55.107145+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T16:54:55.107145+0000","last_undegraded":"2023-10-14T16:54:55.107145+0000","last_fullsized":"2023-10-14T16:54:55.107145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.081993+0000","last_change":"2023-10-14T16:54:54.102987+0000","last_active":"2023-10-14T16:54:55.081993+0000","last_peered":"2023-10-14T16:54:55.081993+0000","last_clean":"2023-10-14T16:54:55.081993+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T16:54:55.081993+0000","last_undegraded":"2023-10-14T16:54:55.081993+0000","last_fullsized":"2023-10-14T16:54:55.081993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111066+0000","last_change":"2023-10-14T16:54:55.109338+0000","last_active":"2023-10-14T16:54:55.111066+0000","last_peered":"2023-10-14T16:54:55.111066+0000","last_clean":"2023-10-14T16:54:55.111066+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T16:54:55.111066+0000","last_undegraded":"2023-10-14T16:54:55.111066+0000","last_fullsized":"2023-10-14T16:54:55.111066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108122+0000","last_change":"2023-10-14T16:54:54.095975+0000","last_active":"2023-10-14T16:54:55.108122+0000","last_peered":"2023-10-14T16:54:55.108122+0000","last_clean":"2023-10-14T16:54:55.108122+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T16:54:55.108122+0000","last_undegraded":"2023-10-14T16:54:55.108122+0000","last_fullsized":"2023-10-14T16:54:55.108122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.105361+0000","last_change":"2023-10-14T16:54:55.098957+0000","last_active":"2023-10-14T16:54:55.105361+0000","last_peered":"2023-10-14T16:54:55.105361+0000","last_clean":"2023-10-14T16:54:55.105361+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T16:54:55.105361+0000","last_undegraded":"2023-10-14T16:54:55.105361+0000","last_fullsized":"2023-10-14T16:54:55.105361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107000+0000","last_change":"2023-10-14T16:54:54.103049+0000","last_active":"2023-10-14T16:54:55.107000+0000","last_peered":"2023-10-14T16:54:55.107000+0000","last_clean":"2023-10-14T16:54:55.107000+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T16:54:55.107000+0000","last_undegraded":"2023-10-14T16:54:55.107000+0000","last_fullsized":"2023-10-14T16:54:55.107000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:17:46.369733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.104062+0000","last_change":"2023-10-14T16:54:55.097880+0000","last_active":"2023-10-14T16:54:55.104062+0000","last_peered":"2023-10-14T16:54:55.104062+0000","last_clean":"2023-10-14T16:54:55.104062+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T16:54:55.104062+0000","last_undegraded":"2023-10-14T16:54:55.104062+0000","last_fullsized":"2023-10-14T16:54:55.104062+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.082097+0000","last_change":"2023-10-14T16:54:54.095418+0000","last_active":"2023-10-14T16:54:55.082097+0000","last_peered":"2023-10-14T16:54:55.082097+0000","last_clean":"2023-10-14T16:54:55.082097+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T16:54:55.082097+0000","last_undegraded":"2023-10-14T16:54:55.082097+0000","last_fullsized":"2023-10-14T16:54:55.082097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:42.952466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097431+0000","last_change":"2023-10-14T16:54:55.097431+0000","last_active":"2023-10-14T16:54:55.097431+0000","last_peered":"2023-10-14T16:54:55.097431+0000","last_clean":"2023-10-14T16:54:55.097431+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T16:54:55.097431+0000","last_undegraded":"2023-10-14T16:54:55.097431+0000","last_fullsized":"2023-10-14T16:54:55.097431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109491+0000","last_change":"2023-10-14T16:54:54.098491+0000","last_active":"2023-10-14T16:54:55.109491+0000","last_peered":"2023-10-14T16:54:55.109491+0000","last_clean":"2023-10-14T16:54:55.109491+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T16:54:55.109491+0000","last_undegraded":"2023-10-14T16:54:55.109491+0000","last_fullsized":"2023-10-14T16:54:55.109491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108426+0000","last_change":"2023-10-14T16:54:55.107411+0000","last_active":"2023-10-14T16:54:55.108426+0000","last_peered":"2023-10-14T16:54:55.108426+0000","last_clean":"2023-10-14T16:54:55.108426+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T16:54:55.108426+0000","last_undegraded":"2023-10-14T16:54:55.108426+0000","last_fullsized":"2023-10-14T16:54:55.108426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109637+0000","last_change":"2023-10-14T16:54:55.107839+0000","last_active":"2023-10-14T16:54:55.109637+0000","last_peered":"2023-10-14T16:54:55.109637+0000","last_clean":"2023-10-14T16:54:55.109637+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T16:54:55.109637+0000","last_undegraded":"2023-10-14T16:54:55.109637+0000","last_fullsized":"2023-10-14T16:54:55.109637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103549+0000","last_change":"2023-10-14T16:54:55.094659+0000","last_active":"2023-10-14T16:54:55.103549+0000","last_peered":"2023-10-14T16:54:55.103549+0000","last_clean":"2023-10-14T16:54:55.103549+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T16:54:55.103549+0000","last_undegraded":"2023-10-14T16:54:55.103549+0000","last_fullsized":"2023-10-14T16:54:55.103549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108453+0000","last_change":"2023-10-14T16:54:55.105319+0000","last_active":"2023-10-14T16:54:55.108453+0000","last_peered":"2023-10-14T16:54:55.108453+0000","last_clean":"2023-10-14T16:54:55.108453+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T16:54:55.108453+0000","last_undegraded":"2023-10-14T16:54:55.108453+0000","last_fullsized":"2023-10-14T16:54:55.108453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097385+0000","last_change":"2023-10-14T16:54:55.097385+0000","last_active":"2023-10-14T16:54:55.097385+0000","last_peered":"2023-10-14T16:54:55.097385+0000","last_clean":"2023-10-14T16:54:55.097385+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T16:54:55.097385+0000","last_undegraded":"2023-10-14T16:54:55.097385+0000","last_fullsized":"2023-10-14T16:54:55.097385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111056+0000","last_change":"2023-10-14T16:54:55.109138+0000","last_active":"2023-10-14T16:54:55.111056+0000","last_peered":"2023-10-14T16:54:55.111056+0000","last_clean":"2023-10-14T16:54:55.111056+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T16:54:55.111056+0000","last_undegraded":"2023-10-14T16:54:55.111056+0000","last_fullsized":"2023-10-14T16:54:55.111056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298044,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073796,"statfs":{"total":96636764160,"available":96331567104,"internally_reserved":0,"allocated":774144,"data_stored":642998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":176128,"data_stored":52096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":46215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298016,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073824,"statfs":{"total":96636764160,"available":96331595776,"internally_reserved":0,"allocated":745472,"data_stored":640782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T16:54:59.575 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T16:54:59.575 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T16:54:59.576 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T16:54:59.576 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T16:54:59.576 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T16:54:59.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.727+0000 7efd6cb86700 1 Processor -- start 2023-10-14T16:54:59.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.727+0000 7efd6cb86700 1 -- start start 2023-10-14T16:54:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.727+0000 7efd6cb86700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efd680a6940 0x7efd680a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.727+0000 7efd6cb86700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efd6813c1a0 0x7efd6813e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.727+0000 7efd6cb86700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd680a2df0 con 0x7efd680a25c0 2023-10-14T16:54:59.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.727+0000 7efd6cb86700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd681338f0 con 0x7efd680a6940 2023-10-14T16:54:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.727+0000 7efd6cb86700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd68133ae0 con 0x7efd6813c1a0 2023-10-14T16:54:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.727+0000 7efd6659c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efd680a6940 0x7efd680a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.727+0000 7efd65d9b700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7efd680a25c0 0x7efd68133f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42346/0 (socket says 172.21.15.8:42346) 2023-10-14T16:54:59.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.727+0000 7efd6659c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7efd680a6940 0x7efd680a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53204/0 (socket says 172.21.15.8:53204) 2023-10-14T16:54:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.727+0000 7efd65d9b700 1 -- 172.21.15.8:0/4055955403 learned_addr learned my addr 172.21.15.8:0/4055955403 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:54:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd66d9d700 1 --2- 172.21.15.8:0/4055955403 >> v2:172.21.15.155:3300/0 conn(0x7efd6813c1a0 0x7efd6813e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd6659c700 1 -- 172.21.15.8:0/4055955403 >> v2:172.21.15.155:3300/0 conn(0x7efd6813c1a0 msgr2=0x7efd6813e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:54:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd6659c700 1 --2- 172.21.15.8:0/4055955403 >> v2:172.21.15.155:3300/0 conn(0x7efd6813c1a0 0x7efd6813e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd6659c700 1 -- 172.21.15.8:0/4055955403 >> v1:172.21.15.8:6789/0 conn(0x7efd680a25c0 legacy=0x7efd68133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd6659c700 1 -- 172.21.15.8:0/4055955403 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680a1b90 con 0x7efd680a6940 2023-10-14T16:54:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd6559a700 1 -- 172.21.15.8:0/4055955403 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025128470 0 0) 0x7efd680a2df0 con 0x7efd680a25c0 2023-10-14T16:54:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd66d9d700 1 --2- 172.21.15.8:0/4055955403 >> v2:172.21.15.155:3300/0 conn(0x7efd6813c1a0 0x7efd6813e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:54:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd6659c700 1 --2- 172.21.15.8:0/4055955403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd680a6940 0x7efd680a1310 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd680a7450 tx=0x7efd600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47aa3d4354904e79 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd6559a700 1 -- 172.21.15.8:0/4055955403 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6000b6b0 con 0x7efd680a6940 2023-10-14T16:54:59.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd6559a700 1 -- 172.21.15.8:0/4055955403 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6000b810 con 0x7efd680a6940 2023-10-14T16:54:59.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd6559a700 1 -- 172.21.15.8:0/4055955403 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6000bbb0 con 0x7efd680a6940 2023-10-14T16:54:59.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd6cb86700 1 -- 172.21.15.8:0/4055955403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd680a6940 msgr2=0x7efd680a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.728+0000 7efd6cb86700 1 --2- 172.21.15.8:0/4055955403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd680a6940 0x7efd680a1310 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd680a7450 tx=0x7efd600091a0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.729+0000 7efd6cb86700 1 -- 172.21.15.8:0/4055955403 shutdown_connections 2023-10-14T16:54:59.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.729+0000 7efd6cb86700 1 --2- 172.21.15.8:0/4055955403 >> v2:172.21.15.155:3300/0 conn(0x7efd6813c1a0 0x7efd6813e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.729+0000 7efd6cb86700 1 --2- 172.21.15.8:0/4055955403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd680a6940 0x7efd680a1310 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.729+0000 7efd6cb86700 1 -- 172.21.15.8:0/4055955403 >> 172.21.15.8:0/4055955403 conn(0x7efd6806acd0 msgr2=0x7efd680701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:59.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.729+0000 7efd6cb86700 1 -- 172.21.15.8:0/4055955403 shutdown_connections 2023-10-14T16:54:59.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.729+0000 7efd6cb86700 1 -- 172.21.15.8:0/4055955403 wait complete. 2023-10-14T16:54:59.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.729+0000 7efd6cb86700 1 Processor -- start 2023-10-14T16:54:59.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.729+0000 7efd6cb86700 1 -- start start 2023-10-14T16:54:59.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd6cb86700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd680a25c0 0x7efd68139550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:59.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd6cb86700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd6813c1a0 0x7efd68139a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:59.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd6cb86700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd68139fd0 0x7efd68146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:59.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd6cb86700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd680a13c0 con 0x7efd68139fd0 2023-10-14T16:54:59.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd6cb86700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6813afc0 con 0x7efd6813c1a0 2023-10-14T16:54:59.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd6cb86700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6813a9e0 con 0x7efd680a25c0 2023-10-14T16:54:59.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd66d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd68139fd0 0x7efd68146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:59.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd66d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd68139fd0 0x7efd68146890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53212/0 (socket says 172.21.15.8:53212) 2023-10-14T16:54:59.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd66d9d700 1 -- 172.21.15.8:0/3251346784 learned_addr learned my addr 172.21.15.8:0/3251346784 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:54:59.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd6659c700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd680a25c0 0x7efd68139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:59.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd65d9b700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd6813c1a0 0x7efd68139a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:59.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd66d9d700 1 -- 172.21.15.8:0/3251346784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd680a25c0 msgr2=0x7efd68139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd66d9d700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd680a25c0 0x7efd68139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd66d9d700 1 -- 172.21.15.8:0/3251346784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd6813c1a0 msgr2=0x7efd68139a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd66d9d700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd6813c1a0 0x7efd68139a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd66d9d700 1 -- 172.21.15.8:0/3251346784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd60009420 con 0x7efd68139fd0 2023-10-14T16:54:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.730+0000 7efd66d9d700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd68139fd0 0x7efd68146890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd5800cf50 tx=0x7efd58007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.731+0000 7efd5e7fc700 1 -- 172.21.15.8:0/3251346784 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800acc0 con 0x7efd68139fd0 2023-10-14T16:54:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.731+0000 7efd5e7fc700 1 -- 172.21.15.8:0/3251346784 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5800ae40 con 0x7efd68139fd0 2023-10-14T16:54:59.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.731+0000 7efd6cb86700 1 -- 172.21.15.8:0/3251346784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd68097e60 con 0x7efd68139fd0 2023-10-14T16:54:59.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.731+0000 7efd5e7fc700 1 -- 172.21.15.8:0/3251346784 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58016680 con 0x7efd68139fd0 2023-10-14T16:54:59.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.731+0000 7efd6cb86700 1 -- 172.21.15.8:0/3251346784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd68097710 con 0x7efd68139fd0 2023-10-14T16:54:59.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.732+0000 7efd6cb86700 1 -- 172.21.15.8:0/3251346784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd680708d0 con 0x7efd68139fd0 2023-10-14T16:54:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.732+0000 7efd5e7fc700 1 -- 172.21.15.8:0/3251346784 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd580169f0 con 0x7efd68139fd0 2023-10-14T16:54:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.732+0000 7efd5e7fc700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7efd48066f30 0x7efd480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:54:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.732+0000 7efd5e7fc700 1 -- 172.21.15.8:0/3251346784 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7efd58012070 con 0x7efd68139fd0 2023-10-14T16:54:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.732+0000 7efd6659c700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7efd48066f30 0x7efd480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:54:59.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.733+0000 7efd6659c700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7efd48066f30 0x7efd480693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efd600093f0 tx=0x7efd60017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:54:59.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.737+0000 7efd5e7fc700 1 -- 172.21.15.8:0/3251346784 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd58056200 con 0x7efd68139fd0 2023-10-14T16:54:59.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.983+0000 7efd6cb86700 1 -- 172.21.15.8:0/3251346784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7efd680a1e50 con 0x7efd68139fd0 2023-10-14T16:54:59.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.986+0000 7efd5e7fc700 1 -- 172.21.15.8:0/3251346784 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163690 (secure 0 0 0) 0x7efd58055d90 con 0x7efd68139fd0 2023-10-14T16:54:59.989 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:54:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.989+0000 7efd6cb86700 1 -- 172.21.15.8:0/3251346784 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7efd48066f30 msgr2=0x7efd480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.989+0000 7efd6cb86700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7efd48066f30 0x7efd480693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efd600093f0 tx=0x7efd60017000 comp rx=0 tx=0).stop 2023-10-14T16:54:59.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.989+0000 7efd6cb86700 1 -- 172.21.15.8:0/3251346784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd68139fd0 msgr2=0x7efd68146890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:54:59.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.989+0000 7efd6cb86700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd68139fd0 0x7efd68146890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd5800cf50 tx=0x7efd58007850 comp rx=0 tx=0).stop 2023-10-14T16:54:59.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.989+0000 7efd6cb86700 1 -- 172.21.15.8:0/3251346784 shutdown_connections 2023-10-14T16:54:59.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.989+0000 7efd6cb86700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7efd48066f30 0x7efd480693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.989+0000 7efd6cb86700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd68139fd0 0x7efd68146890 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.989+0000 7efd6cb86700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd680a25c0 0x7efd68139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.989+0000 7efd6cb86700 1 --2- 172.21.15.8:0/3251346784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd6813c1a0 0x7efd68139a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:54:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.989+0000 7efd6cb86700 1 -- 172.21.15.8:0/3251346784 >> 172.21.15.8:0/3251346784 conn(0x7efd6806acd0 msgr2=0x7efd681307c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:54:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.989+0000 7efd6cb86700 1 -- 172.21.15.8:0/3251346784 shutdown_connections 2023-10-14T16:54:59.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:54:59.989+0000 7efd6cb86700 1 -- 172.21.15.8:0/3251346784 wait complete. 2023-10-14T16:55:00.002 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":5,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":86003},{"type":"v1","addr":"172.21.15.8:6817","nonce":86003}]},"active_addr":"172.21.15.8:6817/86003","active_change":"2023-10-14T16:54:43.974951+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4120,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":1913898093}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":739094604}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":1243943401}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":463797875}]}]} 2023-10-14T16:55:00.007 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T16:55:00.008 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T16:55:00.008 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T16:55:00.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.127+0000 7f058de79700 1 Processor -- start 2023-10-14T16:55:00.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.127+0000 7f058de79700 1 -- start start 2023-10-14T16:55:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f058de79700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f058809e7f0 0x7f058813bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f058de79700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f058813c420 0x7f058813e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f058de79700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058809ed10 con 0x7f0588070410 2023-10-14T16:55:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f058de79700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058809e360 con 0x7f058809e7f0 2023-10-14T16:55:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f058de79700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058809f020 con 0x7f058813c420 2023-10-14T16:55:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f0586ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f058809e7f0 0x7f058813bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f0586ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f058809e7f0 0x7f058813bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53228/0 (socket says 172.21.15.8:53228) 2023-10-14T16:55:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f0586ffd700 1 -- 172.21.15.8:0/553211865 learned_addr learned my addr 172.21.15.8:0/553211865 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:00.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f0587fff700 1 --2- 172.21.15.8:0/553211865 >> v2:172.21.15.155:3300/0 conn(0x7f058813c420 0x7f058813e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f0586ffd700 1 -- 172.21.15.8:0/553211865 >> v2:172.21.15.155:3300/0 conn(0x7f058813c420 msgr2=0x7f058813e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:00.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f0586ffd700 1 --2- 172.21.15.8:0/553211865 >> v2:172.21.15.155:3300/0 conn(0x7f058813c420 0x7f058813e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f0586ffd700 1 -- 172.21.15.8:0/553211865 >> v1:172.21.15.155:6789/0 conn(0x7f0588070410 legacy=0x7f0588137340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:00.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f0586ffd700 1 -- 172.21.15.8:0/553211865 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0588137a50 con 0x7f058809e7f0 2023-10-14T16:55:00.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.128+0000 7f0586ffd700 1 --2- 172.21.15.8:0/553211865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f058809e7f0 0x7f058813bee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f058806a880 tx=0x7f057c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa31ae039e6ad347 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.129+0000 7f05867fc700 1 -- 172.21.15.8:0/553211865 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00b820 con 0x7f058809e7f0 2023-10-14T16:55:00.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.129+0000 7f05867fc700 1 -- 172.21.15.8:0/553211865 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c00b980 con 0x7f058809e7f0 2023-10-14T16:55:00.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.129+0000 7f05867fc700 1 -- 172.21.15.8:0/553211865 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00bd20 con 0x7f058809e7f0 2023-10-14T16:55:00.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.129+0000 7f058de79700 1 -- 172.21.15.8:0/553211865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f058809e7f0 msgr2=0x7f058813bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.129+0000 7f058de79700 1 --2- 172.21.15.8:0/553211865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f058809e7f0 0x7f058813bee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f058806a880 tx=0x7f057c009250 comp rx=0 tx=0).stop 2023-10-14T16:55:00.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.129+0000 7f058de79700 1 -- 172.21.15.8:0/553211865 shutdown_connections 2023-10-14T16:55:00.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.129+0000 7f058de79700 1 --2- 172.21.15.8:0/553211865 >> v2:172.21.15.155:3300/0 conn(0x7f058813c420 0x7f058813e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.129+0000 7f058de79700 1 --2- 172.21.15.8:0/553211865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f058809e7f0 0x7f058813bee0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.129+0000 7f058de79700 1 -- 172.21.15.8:0/553211865 >> 172.21.15.8:0/553211865 conn(0x7f0588067820 msgr2=0x7f0588067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:00.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.129+0000 7f058de79700 1 -- 172.21.15.8:0/553211865 shutdown_connections 2023-10-14T16:55:00.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.129+0000 7f058de79700 1 -- 172.21.15.8:0/553211865 wait complete. 2023-10-14T16:55:00.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.130+0000 7f058de79700 1 Processor -- start 2023-10-14T16:55:00.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.130+0000 7f058de79700 1 -- start start 2023-10-14T16:55:00.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f058de79700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f058809e7f0 0x7f0588146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f058de79700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f058813c420 0x7f0588146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f058de79700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f058811d730 0x7f0588147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f058de79700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058809c6f0 con 0x7f058811d730 2023-10-14T16:55:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f058de79700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058809c920 con 0x7f058809e7f0 2023-10-14T16:55:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f058de79700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058809bde0 con 0x7f058813c420 2023-10-14T16:55:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f0587fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f058811d730 0x7f0588147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f0587fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f058811d730 0x7f0588147380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53240/0 (socket says 172.21.15.8:53240) 2023-10-14T16:55:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f0587fff700 1 -- 172.21.15.8:0/764177164 learned_addr learned my addr 172.21.15.8:0/764177164 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f05877fe700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f058809e7f0 0x7f0588146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f0586ffd700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f058813c420 0x7f0588146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f0587fff700 1 -- 172.21.15.8:0/764177164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f058813c420 msgr2=0x7f0588146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f0587fff700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f058813c420 0x7f0588146e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f0587fff700 1 -- 172.21.15.8:0/764177164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f058809e7f0 msgr2=0x7f0588146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f0587fff700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f058809e7f0 0x7f0588146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f0587fff700 1 -- 172.21.15.8:0/764177164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c0094f0 con 0x7f058811d730 2023-10-14T16:55:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f0586ffd700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f058813c420 0x7f0588146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f05877fe700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f058809e7f0 0x7f0588146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f0587fff700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f058811d730 0x7f0588147380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0580007f20 tx=0x7f0580009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f056f7fe700 1 -- 172.21.15.8:0/764177164 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058000eca0 con 0x7f058811d730 2023-10-14T16:55:00.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f056f7fe700 1 -- 172.21.15.8:0/764177164 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058000ee20 con 0x7f058811d730 2023-10-14T16:55:00.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f058de79700 1 -- 172.21.15.8:0/764177164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058811dbc0 con 0x7f058811d730 2023-10-14T16:55:00.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f056f7fe700 1 -- 172.21.15.8:0/764177164 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0580014670 con 0x7f058811d730 2023-10-14T16:55:00.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.131+0000 7f058de79700 1 -- 172.21.15.8:0/764177164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058809fe40 con 0x7f058811d730 2023-10-14T16:55:00.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.132+0000 7f058de79700 1 -- 172.21.15.8:0/764177164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0588068330 con 0x7f058811d730 2023-10-14T16:55:00.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.133+0000 7f056f7fe700 1 -- 172.21.15.8:0/764177164 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05800149e0 con 0x7f058811d730 2023-10-14T16:55:00.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.133+0000 7f056f7fe700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0574066f30 0x7f05740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.133+0000 7f05877fe700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0574066f30 0x7f05740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.133+0000 7f056f7fe700 1 -- 172.21.15.8:0/764177164 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f05800846c0 con 0x7f058811d730 2023-10-14T16:55:00.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.134+0000 7f05877fe700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0574066f30 0x7f05740693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0578007fd0 tx=0x7f0578009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.137+0000 7f056f7fe700 1 -- 172.21.15.8:0/764177164 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0580051e90 con 0x7f058811d730 2023-10-14T16:55:00.191 INFO:tasks.ceph.mds.a.smithi008.stderr:2023-10-14T16:55:00.189+0000 7f9915162700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T16:55:00.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.332+0000 7f058de79700 1 -- 172.21.15.8:0/764177164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0588136cc0 con 0x7f058811d730 2023-10-14T16:55:00.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.333+0000 7f056f7fe700 1 -- 172.21.15.8:0/764177164 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12158 (secure 0 0 0) 0x7f058006ff90 con 0x7f058811d730 2023-10-14T16:55:00.334 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:55:00.334 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:56.078671+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-14T16:54:52.330193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-14T16:54:53.459270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:55:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.335+0000 7f058de79700 1 -- 172.21.15.8:0/764177164 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0574066f30 msgr2=0x7f05740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.335+0000 7f058de79700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0574066f30 0x7f05740693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0578007fd0 tx=0x7f0578009040 comp rx=0 tx=0).stop 2023-10-14T16:55:00.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.335+0000 7f058de79700 1 -- 172.21.15.8:0/764177164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f058811d730 msgr2=0x7f0588147380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.335+0000 7f058de79700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f058811d730 0x7f0588147380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0580007f20 tx=0x7f0580009860 comp rx=0 tx=0).stop 2023-10-14T16:55:00.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.335+0000 7f058de79700 1 -- 172.21.15.8:0/764177164 shutdown_connections 2023-10-14T16:55:00.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.335+0000 7f058de79700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0574066f30 0x7f05740693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.335+0000 7f058de79700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f058811d730 0x7f0588147380 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.335+0000 7f058de79700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f058809e7f0 0x7f0588146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.335+0000 7f058de79700 1 --2- 172.21.15.8:0/764177164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f058813c420 0x7f0588146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.335+0000 7f058de79700 1 -- 172.21.15.8:0/764177164 >> 172.21.15.8:0/764177164 conn(0x7f0588067820 msgr2=0x7f05880a6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:00.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.335+0000 7f058de79700 1 -- 172.21.15.8:0/764177164 shutdown_connections 2023-10-14T16:55:00.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.335+0000 7f058de79700 1 -- 172.21.15.8:0/764177164 wait complete. 2023-10-14T16:55:00.348 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T16:55:00.349 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T16:55:00.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.467+0000 7f739bf48700 1 Processor -- start 2023-10-14T16:55:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.467+0000 7f739bf48700 1 -- start start 2023-10-14T16:55:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.467+0000 7f739bf48700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f73940a6940 0x7f73940a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.467+0000 7f739bf48700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f73940a25c0 0x7f7394133f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.467+0000 7f739bf48700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73940a2df0 con 0x7f7394134450 2023-10-14T16:55:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.467+0000 7f739bf48700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73941338f0 con 0x7f73940a25c0 2023-10-14T16:55:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.467+0000 7f739bf48700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7394134860 con 0x7f73940a6940 2023-10-14T16:55:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.467+0000 7f73994e3700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f73940a25c0 0x7f7394133f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.467+0000 7f73994e3700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f73940a25c0 0x7f7394133f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53254/0 (socket says 172.21.15.8:53254) 2023-10-14T16:55:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.467+0000 7f739a4e5700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7394134450 0x7f7394136e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42362/0 (socket says 172.21.15.8:42362) 2023-10-14T16:55:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.467+0000 7f73994e3700 1 -- 172.21.15.8:0/2062450371 learned_addr learned my addr 172.21.15.8:0/2062450371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.468+0000 7f7399ce4700 1 --2- 172.21.15.8:0/2062450371 >> v2:172.21.15.155:3300/0 conn(0x7f73940a6940 0x7f73940a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.468+0000 7f73994e3700 1 -- 172.21.15.8:0/2062450371 >> v2:172.21.15.155:3300/0 conn(0x7f73940a6940 msgr2=0x7f73940a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.468+0000 7f73994e3700 1 --2- 172.21.15.8:0/2062450371 >> v2:172.21.15.155:3300/0 conn(0x7f73940a6940 0x7f73940a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.468+0000 7f73994e3700 1 -- 172.21.15.8:0/2062450371 >> v1:172.21.15.8:6789/0 conn(0x7f7394134450 legacy=0x7f7394136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.468+0000 7f73994e3700 1 -- 172.21.15.8:0/2062450371 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394133ae0 con 0x7f73940a25c0 2023-10-14T16:55:00.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.468+0000 7f7398ce2700 1 -- 172.21.15.8:0/2062450371 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682628471 0 0) 0x7f73940a2df0 con 0x7f7394134450 2023-10-14T16:55:00.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.468+0000 7f7399ce4700 1 --2- 172.21.15.8:0/2062450371 >> v2:172.21.15.155:3300/0 conn(0x7f73940a6940 0x7f73940a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:00.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.468+0000 7f73994e3700 1 --2- 172.21.15.8:0/2062450371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73940a25c0 0x7f7394133f10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f73940647e0 tx=0x7f7388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb1c70a6240fc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.468+0000 7f7398ce2700 1 -- 172.21.15.8:0/2062450371 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738800b820 con 0x7f73940a25c0 2023-10-14T16:55:00.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.468+0000 7f7398ce2700 1 -- 172.21.15.8:0/2062450371 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738800b980 con 0x7f73940a25c0 2023-10-14T16:55:00.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.468+0000 7f7398ce2700 1 -- 172.21.15.8:0/2062450371 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738800bd20 con 0x7f73940a25c0 2023-10-14T16:55:00.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.469+0000 7f739bf48700 1 -- 172.21.15.8:0/2062450371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73940a25c0 msgr2=0x7f7394133f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.469+0000 7f739bf48700 1 --2- 172.21.15.8:0/2062450371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73940a25c0 0x7f7394133f10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f73940647e0 tx=0x7f7388009250 comp rx=0 tx=0).stop 2023-10-14T16:55:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.469+0000 7f739bf48700 1 -- 172.21.15.8:0/2062450371 shutdown_connections 2023-10-14T16:55:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.469+0000 7f739bf48700 1 --2- 172.21.15.8:0/2062450371 >> v2:172.21.15.155:3300/0 conn(0x7f73940a6940 0x7f73940a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.469+0000 7f739bf48700 1 --2- 172.21.15.8:0/2062450371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73940a25c0 0x7f7394133f10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.469+0000 7f739bf48700 1 -- 172.21.15.8:0/2062450371 >> 172.21.15.8:0/2062450371 conn(0x7f739406acd0 msgr2=0x7f73940701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.469+0000 7f739bf48700 1 -- 172.21.15.8:0/2062450371 shutdown_connections 2023-10-14T16:55:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.469+0000 7f739bf48700 1 -- 172.21.15.8:0/2062450371 wait complete. 2023-10-14T16:55:00.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f739bf48700 1 Processor -- start 2023-10-14T16:55:00.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f739bf48700 1 -- start start 2023-10-14T16:55:00.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f739bf48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73940a25c0 0x7f7394095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f739bf48700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7394134450 0x7f7394095fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f739bf48700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73940a0380 0x7f73940964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f739bf48700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7394098a20 con 0x7f73940a25c0 2023-10-14T16:55:00.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f739bf48700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7394098fc0 con 0x7f7394134450 2023-10-14T16:55:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f739bf48700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7394099780 con 0x7f73940a0380 2023-10-14T16:55:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f7399ce4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73940a25c0 0x7f7394095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f7399ce4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73940a25c0 0x7f7394095a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53264/0 (socket says 172.21.15.8:53264) 2023-10-14T16:55:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f7399ce4700 1 -- 172.21.15.8:0/1721172845 learned_addr learned my addr 172.21.15.8:0/1721172845 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f739a4e5700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73940a0380 0x7f73940964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f73994e3700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7394134450 0x7f7394095fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f7399ce4700 1 -- 172.21.15.8:0/1721172845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73940a0380 msgr2=0x7f73940964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f7399ce4700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73940a0380 0x7f73940964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f7399ce4700 1 -- 172.21.15.8:0/1721172845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7394134450 msgr2=0x7f7394095fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f7399ce4700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7394134450 0x7f7394095fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f7399ce4700 1 -- 172.21.15.8:0/1721172845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73880094f0 con 0x7f73940a25c0 2023-10-14T16:55:00.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.470+0000 7f73994e3700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7394134450 0x7f7394095fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:55:00.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.471+0000 7f7399ce4700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73940a25c0 0x7f7394095a70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f738c00e8d0 tx=0x7f738c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.471+0000 7f7391ffb700 1 -- 172.21.15.8:0/1721172845 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c00ee70 con 0x7f73940a25c0 2023-10-14T16:55:00.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.471+0000 7f7391ffb700 1 -- 172.21.15.8:0/1721172845 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c00c5e0 con 0x7f73940a25c0 2023-10-14T16:55:00.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.471+0000 7f739bf48700 1 -- 172.21.15.8:0/1721172845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7394097610 con 0x7f73940a25c0 2023-10-14T16:55:00.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.471+0000 7f7391ffb700 1 -- 172.21.15.8:0/1721172845 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c00c980 con 0x7f73940a25c0 2023-10-14T16:55:00.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.471+0000 7f739bf48700 1 -- 172.21.15.8:0/1721172845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7394099450 con 0x7f73940a25c0 2023-10-14T16:55:00.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.472+0000 7f739bf48700 1 -- 172.21.15.8:0/1721172845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73940708d0 con 0x7f73940a25c0 2023-10-14T16:55:00.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.472+0000 7f7391ffb700 1 -- 172.21.15.8:0/1721172845 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f738c013410 con 0x7f73940a25c0 2023-10-14T16:55:00.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.473+0000 7f7391ffb700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7380066f30 0x7f73800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.473+0000 7f7391ffb700 1 -- 172.21.15.8:0/1721172845 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f738c084060 con 0x7f73940a25c0 2023-10-14T16:55:00.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.473+0000 7f73994e3700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7380066f30 0x7f73800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.473+0000 7f73994e3700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7380066f30 0x7f73800693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f73940647e0 tx=0x7f7388017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.477+0000 7f7391ffb700 1 -- 172.21.15.8:0/1721172845 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f738c051830 con 0x7f73940a25c0 2023-10-14T16:55:00.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.673+0000 7f739bf48700 1 -- 172.21.15.8:0/1721172845 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73940639b0 con 0x7f73940a25c0 2023-10-14T16:55:00.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.674+0000 7f7391ffb700 1 -- 172.21.15.8:0/1721172845 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12158 (secure 0 0 0) 0x7f738c054e50 con 0x7f73940a25c0 2023-10-14T16:55:00.675 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:55:00.675 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:56.078671+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-14T16:54:52.330193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-14T16:54:53.459270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:55:00.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.676+0000 7f739bf48700 1 -- 172.21.15.8:0/1721172845 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7380066f30 msgr2=0x7f73800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.676+0000 7f739bf48700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7380066f30 0x7f73800693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f73940647e0 tx=0x7f7388017000 comp rx=0 tx=0).stop 2023-10-14T16:55:00.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.676+0000 7f739bf48700 1 -- 172.21.15.8:0/1721172845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73940a25c0 msgr2=0x7f7394095a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.676+0000 7f739bf48700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73940a25c0 0x7f7394095a70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f738c00e8d0 tx=0x7f738c008040 comp rx=0 tx=0).stop 2023-10-14T16:55:00.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.676+0000 7f739bf48700 1 -- 172.21.15.8:0/1721172845 shutdown_connections 2023-10-14T16:55:00.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.676+0000 7f739bf48700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7380066f30 0x7f73800693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.676+0000 7f739bf48700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73940a0380 0x7f73940964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.676+0000 7f739bf48700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73940a25c0 0x7f7394095a70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.676+0000 7f739bf48700 1 --2- 172.21.15.8:0/1721172845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7394134450 0x7f7394095fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.676+0000 7f739bf48700 1 -- 172.21.15.8:0/1721172845 >> 172.21.15.8:0/1721172845 conn(0x7f739406acd0 msgr2=0x7f73940a9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.676+0000 7f739bf48700 1 -- 172.21.15.8:0/1721172845 shutdown_connections 2023-10-14T16:55:00.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.676+0000 7f739bf48700 1 -- 172.21.15.8:0/1721172845 wait complete. 2023-10-14T16:55:00.690 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T16:55:00.691 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T16:55:00.692 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T16:55:00.693 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-14T16:55:00.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.818+0000 7f5ce7080700 1 Processor -- start 2023-10-14T16:55:00.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.818+0000 7f20044c9700 1 Processor -- start 2023-10-14T16:55:00.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.818+0000 7f20044c9700 1 -- start start 2023-10-14T16:55:00.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.818+0000 7f5ce7080700 1 -- start start 2023-10-14T16:55:00.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.818+0000 7fcb5ddc7700 1 Processor -- start 2023-10-14T16:55:00.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.818+0000 7f2cb57d5700 1 Processor -- start 2023-10-14T16:55:00.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.818+0000 7fcb5ddc7700 1 -- start start 2023-10-14T16:55:00.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.818+0000 7f2cb57d5700 1 -- start start 2023-10-14T16:55:00.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f2cb57d5700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2cb006d650 0x7f2cb0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f2cb57d5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb0139d50 0x7f2cb013c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f2cb57d5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb01315b0 con 0x7f2cb006dee0 2023-10-14T16:55:00.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f2cb57d5700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb006f880 con 0x7f2cb006d650 2023-10-14T16:55:00.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f2cb57d5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb006e3b0 con 0x7f2cb0139d50 2023-10-14T16:55:00.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f20044c9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1ffc0a1310 0x7f1ffc13f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f20044c9700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc0a2df0 con 0x7f1ffc0a6940 2023-10-14T16:55:00.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f20044c9700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc133ae0 con 0x7f1ffc0a25c0 2023-10-14T16:55:00.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f20044c9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc1338f0 con 0x7f1ffc0a1310 2023-10-14T16:55:00.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7fcb5ddc7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb5806d620 0x7fcb5806af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7fcb5ddc7700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5806caf0 con 0x7fcb58097560 2023-10-14T16:55:00.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7fcb5ddc7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5806d020 con 0x7fcb5806b480 2023-10-14T16:55:00.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7fcb5ddc7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5806da10 con 0x7fcb5806d620 2023-10-14T16:55:00.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f5ce7080700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5ce013b270 0x7f5ce013d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f5ce7080700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce006b760 con 0x7f5ce0070410 2023-10-14T16:55:00.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f2caffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2cb006d650 0x7f2cb0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f2cb4fd4700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb0139d50 0x7f2cb013c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f2caffff700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2cb006d650 0x7f2cb0131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.8:34666/0 (socket says 172.21.15.8:34666) 2023-10-14T16:55:00.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f2caffff700 1 -- 172.21.15.8:0/2190058126 learned_addr learned my addr 172.21.15.8:0/2190058126 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:00.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f5ce7080700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce006ba00 con 0x7f5ce0135410 2023-10-14T16:55:00.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f5ce7080700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce00a1af0 con 0x7f5ce013b270 2023-10-14T16:55:00.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7fcb57fff700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fcb5806b480 0x7fcb581345b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.8:44626/0 (socket says 172.21.15.8:44626) 2023-10-14T16:55:00.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7fcb57fff700 1 -- 172.21.15.8:0/303888885 learned_addr learned my addr 172.21.15.8:0/303888885 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:00.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7fcb577fe700 1 --1- 172.21.15.8:0/303888885 >> v1:172.21.15.8:6789/0 conn(0x7fcb58097560 0x7fcb58096a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42388/0 (socket says 172.21.15.8:42388) 2023-10-14T16:55:00.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f5ce587d700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5ce0135410 0x7f5ce0139b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.8:44616/0 (socket says 172.21.15.8:44616) 2023-10-14T16:55:00.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f5ce587d700 1 -- 172.21.15.8:0/2361013789 learned_addr learned my addr 172.21.15.8:0/2361013789 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:00.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f5ce687f700 1 --2- 172.21.15.8:0/2361013789 >> v2:172.21.15.8:3300/0 conn(0x7f5ce013b270 0x7f5ce013d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7fcb56ffd700 1 --2- 172.21.15.8:0/303888885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb5806d620 0x7fcb5806af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f2002265700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1ffc0a6940 0x7f1ffc133f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42376/0 (socket says 172.21.15.8:42376) 2023-10-14T16:55:00.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f2002265700 1 -- 172.21.15.8:0/1793668767 learned_addr learned my addr 172.21.15.8:0/1793668767 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:00.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.819+0000 7f2002a66700 1 --2- 172.21.15.8:0/1793668767 >> v2:172.21.15.155:3300/0 conn(0x7f1ffc0a1310 0x7f1ffc13f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2002a66700 1 -- 172.21.15.8:0/1793668767 >> v1:172.21.15.155:6789/0 conn(0x7f1ffc0a25c0 legacy=0x7f1ffc13c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2002a66700 1 -- 172.21.15.8:0/1793668767 >> v1:172.21.15.8:6789/0 conn(0x7f1ffc0a6940 legacy=0x7f1ffc133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2001263700 1 -- 172.21.15.8:0/1793668767 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618036683 0 0) 0x7f1ffc0a2df0 con 0x7f1ffc0a6940 2023-10-14T16:55:00.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2002a66700 1 -- 172.21.15.8:0/1793668767 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc0a1720 con 0x7f1ffc0a1310 2023-10-14T16:55:00.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f5ce687f700 1 -- 172.21.15.8:0/2361013789 >> v1:172.21.15.155:6789/0 conn(0x7f5ce0135410 legacy=0x7f5ce0139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f5ce687f700 1 -- 172.21.15.8:0/2361013789 >> v1:172.21.15.8:6789/0 conn(0x7f5ce0070410 legacy=0x7f5ce0134d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:00.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f5ce687f700 1 -- 172.21.15.8:0/2361013789 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce006bd80 con 0x7f5ce013b270 2023-10-14T16:55:00.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2cb4fd4700 1 -- 172.21.15.8:0/2190058126 >> v2:172.21.15.155:3300/0 conn(0x7f2cb006d650 msgr2=0x7f2cb0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:00.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2cb4fd4700 1 --2- 172.21.15.8:0/2190058126 >> v2:172.21.15.155:3300/0 conn(0x7f2cb006d650 0x7f2cb0131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2cb4fd4700 1 -- 172.21.15.8:0/2190058126 >> v1:172.21.15.155:6789/0 conn(0x7f2cb006dee0 legacy=0x7f2cb0131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7fcb567fc700 1 -- 172.21.15.8:0/303888885 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180240310 0 0) 0x7fcb5806d020 con 0x7fcb5806b480 2023-10-14T16:55:00.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7fcb567fc700 1 -- 172.21.15.8:0/303888885 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb40003570 con 0x7fcb5806b480 2023-10-14T16:55:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2cb4fd4700 1 -- 172.21.15.8:0/2190058126 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb00a6850 con 0x7f2cb0139d50 2023-10-14T16:55:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2caffff700 1 --2- 172.21.15.8:0/2190058126 >> v2:172.21.15.155:3300/0 conn(0x7f2cb006d650 0x7f2cb0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:00.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7fcb56ffd700 1 -- 172.21.15.8:0/303888885 >> v1:172.21.15.155:6789/0 conn(0x7fcb5806b480 legacy=0x7fcb581345b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7fcb56ffd700 1 -- 172.21.15.8:0/303888885 >> v1:172.21.15.8:6789/0 conn(0x7fcb58097560 legacy=0x7fcb58096a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7fcb56ffd700 1 -- 172.21.15.8:0/303888885 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5806aca0 con 0x7fcb5806d620 2023-10-14T16:55:00.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2002a66700 1 --2- 172.21.15.8:0/1793668767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ffc0a1310 0x7f1ffc13f8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009e60 tx=0x7f1ff4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=303118cf8de40f36 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f5ce687f700 1 --2- 172.21.15.8:0/2361013789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce013b270 0x7f5ce013d650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009e60 tx=0x7f5cd8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17b283c7333ac4b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2cb4fd4700 1 --2- 172.21.15.8:0/2190058126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb0139d50 0x7f2cb013c130 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009e60 tx=0x7f2ca8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcf28223b6b5e001 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2001263700 1 -- 172.21.15.8:0/1793668767 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff400e070 con 0x7f1ffc0a1310 2023-10-14T16:55:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f5ce507c700 1 -- 172.21.15.8:0/2361013789 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd800e070 con 0x7f5ce013b270 2023-10-14T16:55:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f5ce507c700 1 -- 172.21.15.8:0/2361013789 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd800bbf0 con 0x7f5ce013b270 2023-10-14T16:55:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f5ce507c700 1 -- 172.21.15.8:0/2361013789 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8012430 con 0x7f5ce013b270 2023-10-14T16:55:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7fcb56ffd700 1 --2- 172.21.15.8:0/303888885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb5806d620 0x7fcb5806af40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009910 tx=0x7fcb4c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f90c66a356342e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2001263700 1 -- 172.21.15.8:0/1793668767 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff400bc30 con 0x7f1ffc0a1310 2023-10-14T16:55:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2001263700 1 -- 172.21.15.8:0/1793668767 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4012430 con 0x7f1ffc0a1310 2023-10-14T16:55:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2caeffd700 1 -- 172.21.15.8:0/2190058126 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca800e070 con 0x7f2cb0139d50 2023-10-14T16:55:00.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2caeffd700 1 -- 172.21.15.8:0/2190058126 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca800bb60 con 0x7f2cb0139d50 2023-10-14T16:55:00.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7f2caeffd700 1 -- 172.21.15.8:0/2190058126 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8012430 con 0x7f2cb0139d50 2023-10-14T16:55:00.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7fcb567fc700 1 -- 172.21.15.8:0/303888885 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00b680 con 0x7fcb5806d620 2023-10-14T16:55:00.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.820+0000 7fcb567fc700 1 -- 172.21.15.8:0/303888885 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c00b7e0 con 0x7fcb5806d620 2023-10-14T16:55:00.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7fcb567fc700 1 -- 172.21.15.8:0/303888885 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00bba0 con 0x7fcb5806d620 2023-10-14T16:55:00.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f20044c9700 1 -- 172.21.15.8:0/1793668767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ffc0a1310 msgr2=0x7f1ffc13f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f20044c9700 1 --2- 172.21.15.8:0/1793668767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ffc0a1310 0x7f1ffc13f8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009e60 tx=0x7f1ff4009780 comp rx=0 tx=0).stop 2023-10-14T16:55:00.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f5ce7080700 1 -- 172.21.15.8:0/2361013789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce013b270 msgr2=0x7f5ce013d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f5ce7080700 1 --2- 172.21.15.8:0/2361013789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce013b270 0x7f5ce013d650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009e60 tx=0x7f5cd8009780 comp rx=0 tx=0).stop 2023-10-14T16:55:00.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f20044c9700 1 -- 172.21.15.8:0/1793668767 shutdown_connections 2023-10-14T16:55:00.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f20044c9700 1 --2- 172.21.15.8:0/1793668767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ffc0a1310 0x7f1ffc13f8d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f20044c9700 1 -- 172.21.15.8:0/1793668767 >> 172.21.15.8:0/1793668767 conn(0x7f1ffc06acd0 msgr2=0x7f1ffc0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f5ce7080700 1 -- 172.21.15.8:0/2361013789 shutdown_connections 2023-10-14T16:55:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f5ce7080700 1 --2- 172.21.15.8:0/2361013789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce013b270 0x7f5ce013d650 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f5ce7080700 1 -- 172.21.15.8:0/2361013789 >> 172.21.15.8:0/2361013789 conn(0x7f5ce00a2fc0 msgr2=0x7f5ce00a33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f5ce7080700 1 -- 172.21.15.8:0/2361013789 shutdown_connections 2023-10-14T16:55:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f5ce7080700 1 -- 172.21.15.8:0/2361013789 wait complete. 2023-10-14T16:55:00.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f20044c9700 1 -- 172.21.15.8:0/1793668767 shutdown_connections 2023-10-14T16:55:00.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f2cb57d5700 1 -- 172.21.15.8:0/2190058126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb0139d50 msgr2=0x7f2cb013c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f2cb57d5700 1 --2- 172.21.15.8:0/2190058126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb0139d50 0x7f2cb013c130 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009e60 tx=0x7f2ca8009780 comp rx=0 tx=0).stop 2023-10-14T16:55:00.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f20044c9700 1 -- 172.21.15.8:0/1793668767 wait complete. 2023-10-14T16:55:00.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f2cb57d5700 1 -- 172.21.15.8:0/2190058126 shutdown_connections 2023-10-14T16:55:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f2cb57d5700 1 --2- 172.21.15.8:0/2190058126 >> v2:172.21.15.155:3300/0 conn(0x7f2cb006d650 0x7f2cb0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/303888885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb5806d620 msgr2=0x7fcb5806af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f2cb57d5700 1 --2- 172.21.15.8:0/2190058126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb0139d50 0x7f2cb013c130 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7f2cb57d5700 1 -- 172.21.15.8:0/2190058126 >> 172.21.15.8:0/2190058126 conn(0x7f2cb0070c90 msgr2=0x7f2cb00a5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:00.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7fcb5ddc7700 1 --2- 172.21.15.8:0/303888885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb5806d620 0x7fcb5806af40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009910 tx=0x7fcb4c0091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/303888885 shutdown_connections 2023-10-14T16:55:00.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7fcb5ddc7700 1 --2- 172.21.15.8:0/303888885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb5806d620 0x7fcb5806af40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.821+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/303888885 >> 172.21.15.8:0/303888885 conn(0x7fcb580a5a60 msgr2=0x7fcb580a5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:00.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.822+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/303888885 shutdown_connections 2023-10-14T16:55:00.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.822+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/303888885 wait complete. 2023-10-14T16:55:00.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.822+0000 7f2cb57d5700 1 -- 172.21.15.8:0/2190058126 shutdown_connections 2023-10-14T16:55:00.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.822+0000 7f2cb57d5700 1 -- 172.21.15.8:0/2190058126 wait complete. 2023-10-14T16:55:00.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.822+0000 7f5ce7080700 1 Processor -- start 2023-10-14T16:55:00.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.822+0000 7f5ce7080700 1 -- start start 2023-10-14T16:55:00.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f20044c9700 1 Processor -- start 2023-10-14T16:55:00.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7fcb5ddc7700 1 Processor -- start 2023-10-14T16:55:00.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f20044c9700 1 -- start start 2023-10-14T16:55:00.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7fcb5ddc7700 1 -- start start 2023-10-14T16:55:00.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f2cb57d5700 1 Processor -- start 2023-10-14T16:55:00.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f20044c9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ffc0a1310 0x7f1ffc095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f20044c9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ffc0a25c0 0x7f1ffc095fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f20044c9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ffc138450 0x7f1ffc0964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f20044c9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0a0590 con 0x7f1ffc138450 2023-10-14T16:55:00.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f20044c9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc096bb0 con 0x7f1ffc0a1310 2023-10-14T16:55:00.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f20044c9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc098cf0 con 0x7f1ffc0a25c0 2023-10-14T16:55:00.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f5ce7080700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ce0135410 0x7f5ce0133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f5ce7080700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce013b270 0x7f5ce0134100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f5ce7080700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce0098480 0x7f5ce009abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f5ce7080700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0099770 con 0x7f5ce013b270 2023-10-14T16:55:00.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f5ce7080700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce009cae0 con 0x7f5ce0135410 2023-10-14T16:55:00.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f5ce7080700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00994d0 con 0x7f5ce0098480 2023-10-14T16:55:00.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f5ce587d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce013b270 0x7f5ce0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f2002a66700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ffc138450 0x7f1ffc0964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f2002a66700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ffc138450 0x7f1ffc0964f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53296/0 (socket says 172.21.15.8:53296) 2023-10-14T16:55:00.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f2002a66700 1 -- 172.21.15.8:0/571495117 learned_addr learned my addr 172.21.15.8:0/571495117 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:00.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f5ce587d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce013b270 0x7f5ce0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53310/0 (socket says 172.21.15.8:53310) 2023-10-14T16:55:00.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f5ce587d700 1 -- 172.21.15.8:0/1859848939 learned_addr learned my addr 172.21.15.8:0/1859848939 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:00.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f2002265700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ffc0a1310 0x7f1ffc095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f5ce687f700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce0098480 0x7f5ce009abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f2001a64700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ffc0a25c0 0x7f1ffc095fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7fcb5ddc7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb5806b480 0x7fcb58146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7fcb5ddc7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb5806d620 0x7fcb581472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7fcb5ddc7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb58134570 0x7fcb581477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7fcb5ddc7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb581361f0 con 0x7fcb58134570 2023-10-14T16:55:00.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7fcb5ddc7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5806f550 con 0x7fcb5806d620 2023-10-14T16:55:00.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7fcb5ddc7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb58134e70 con 0x7fcb5806b480 2023-10-14T16:55:00.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7fcb57fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb58134570 0x7fcb581477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7fcb577fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb5806b480 0x7fcb58146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7fcb57fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb58134570 0x7fcb581477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53316/0 (socket says 172.21.15.8:53316) 2023-10-14T16:55:00.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7fcb57fff700 1 -- 172.21.15.8:0/3718260637 learned_addr learned my addr 172.21.15.8:0/3718260637 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:00.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7fcb56ffd700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb5806d620 0x7fcb581472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2002a66700 1 -- 172.21.15.8:0/571495117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ffc0a25c0 msgr2=0x7f1ffc095fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2002a66700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ffc0a25c0 0x7f1ffc095fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2002a66700 1 -- 172.21.15.8:0/571495117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ffc0a1310 msgr2=0x7f1ffc095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2002a66700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ffc0a1310 0x7f1ffc095a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2002a66700 1 -- 172.21.15.8:0/571495117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff4009a20 con 0x7f1ffc138450 2023-10-14T16:55:00.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2002265700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ffc0a1310 0x7f1ffc095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:00.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f5ce607e700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ce0135410 0x7f5ce0133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f5ce587d700 1 -- 172.21.15.8:0/1859848939 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce0098480 msgr2=0x7f5ce009abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f5ce587d700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce0098480 0x7f5ce009abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f5ce587d700 1 -- 172.21.15.8:0/1859848939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ce0135410 msgr2=0x7f5ce0133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f5ce587d700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ce0135410 0x7f5ce0133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f5ce587d700 1 -- 172.21.15.8:0/1859848939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8009a20 con 0x7f5ce013b270 2023-10-14T16:55:00.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f5ce607e700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ce0135410 0x7f5ce0133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:55:00.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2002a66700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ffc138450 0x7f1ffc0964f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4013000 tx=0x7f1ff4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f5ce587d700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce013b270 0x7f5ce0134100 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000c7f0 tx=0x7f5cd0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.823+0000 7f2cb57d5700 1 -- start start 2023-10-14T16:55:00.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2cb57d5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb006dee0 0x7f2cb01446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2cb57d5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0139d50 0x7f2cb0144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7fcb56ffd700 1 -- 172.21.15.8:0/3718260637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb5806b480 msgr2=0x7fcb58146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2cb57d5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb009b580 0x7f2cb0145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2cb57d5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb012f100 con 0x7f2cb0139d50 2023-10-14T16:55:00.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2cb57d5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb009bb60 con 0x7f2cb006dee0 2023-10-14T16:55:00.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2cb57d5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb009ac60 con 0x7f2cb009b580 2023-10-14T16:55:00.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2caffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb006dee0 0x7f2cb01446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2caffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb006dee0 0x7f2cb01446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.8:34720/0 (socket says 172.21.15.8:34720) 2023-10-14T16:55:00.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2caffff700 1 -- 172.21.15.8:0/1262722206 learned_addr learned my addr 172.21.15.8:0/1262722206 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:00.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7fcb56ffd700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb5806b480 0x7fcb58146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7fcb56ffd700 1 -- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb58134570 msgr2=0x7fcb581477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7fcb56ffd700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb58134570 0x7fcb581477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7fcb56ffd700 1 -- 172.21.15.8:0/3718260637 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c009420 con 0x7fcb5806d620 2023-10-14T16:55:00.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7fcb577fe700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb5806b480 0x7fcb58146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:00.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2caf7fe700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0139d50 0x7f2cb0144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f1ff27fc700 1 -- 172.21.15.8:0/571495117 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff401b420 con 0x7f1ffc138450 2023-10-14T16:55:00.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7fcb57fff700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb58134570 0x7fcb581477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:00.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f5cd67fc700 1 -- 172.21.15.8:0/1859848939 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0005b30 con 0x7f5ce013b270 2023-10-14T16:55:00.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7f5cd67fc700 1 -- 172.21.15.8:0/1859848939 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd0005cb0 con 0x7f5ce013b270 2023-10-14T16:55:00.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7f5cd67fc700 1 -- 172.21.15.8:0/1859848939 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0004a80 con 0x7f5ce013b270 2023-10-14T16:55:00.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7fcb56ffd700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb5806d620 0x7fcb581472a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcb5806a1c0 tx=0x7fcb4c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7fcb3f7fe700 1 -- 172.21.15.8:0/3718260637 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c006ad0 con 0x7fcb5806d620 2023-10-14T16:55:00.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7fcb3f7fe700 1 -- 172.21.15.8:0/3718260637 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c00b950 con 0x7fcb5806d620 2023-10-14T16:55:00.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/3718260637 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb58135260 con 0x7fcb5806d620 2023-10-14T16:55:00.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/3718260637 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5813f680 con 0x7fcb5806d620 2023-10-14T16:55:00.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7fcb3f7fe700 1 -- 172.21.15.8:0/3718260637 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c01a430 con 0x7fcb5806d620 2023-10-14T16:55:00.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f1ff27fc700 1 -- 172.21.15.8:0/571495117 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff401b580 con 0x7f1ffc138450 2023-10-14T16:55:00.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f1ff27fc700 1 -- 172.21.15.8:0/571495117 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff401b940 con 0x7f1ffc138450 2023-10-14T16:55:00.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7f20044c9700 1 -- 172.21.15.8:0/571495117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ffc0a07e0 con 0x7f1ffc138450 2023-10-14T16:55:00.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7f20044c9700 1 -- 172.21.15.8:0/571495117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ffc099eb0 con 0x7f1ffc138450 2023-10-14T16:55:00.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2cb4fd4700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb009b580 0x7f2cb0145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.824+0000 7f2caffff700 1 -- 172.21.15.8:0/1262722206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb009b580 msgr2=0x7f2cb0145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7f2caffff700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb009b580 0x7f2cb0145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7f2caffff700 1 -- 172.21.15.8:0/1262722206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0139d50 msgr2=0x7f2cb0144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7f2caffff700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cb0139d50 0x7f2cb0144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7f2caffff700 1 -- 172.21.15.8:0/1262722206 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c980094f0 con 0x7f2cb006dee0 2023-10-14T16:55:00.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7f2caffff700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb006dee0 0x7f2cb01446c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800ec50 tx=0x7f2c98009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7f2ca7fff700 1 -- 172.21.15.8:0/1262722206 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980097d0 con 0x7f2cb006dee0 2023-10-14T16:55:00.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7f2ca7fff700 1 -- 172.21.15.8:0/1262722206 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9800c920 con 0x7f2cb006dee0 2023-10-14T16:55:00.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.825+0000 7f2ca7fff700 1 -- 172.21.15.8:0/1262722206 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800cca0 con 0x7f2cb006dee0 2023-10-14T16:55:00.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.826+0000 7f5ce7080700 1 -- 172.21.15.8:0/1859848939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce00999c0 con 0x7f5ce013b270 2023-10-14T16:55:00.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.826+0000 7f5ce7080700 1 -- 172.21.15.8:0/1859848939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce0134640 con 0x7f5ce013b270 2023-10-14T16:55:00.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.826+0000 7f20044c9700 1 -- 172.21.15.8:0/571495117 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ffc0708d0 con 0x7f1ffc138450 2023-10-14T16:55:00.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.826+0000 7f2cb57d5700 1 -- 172.21.15.8:0/1262722206 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca8009a20 con 0x7f2cb006dee0 2023-10-14T16:55:00.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.826+0000 7f2cb57d5700 1 -- 172.21.15.8:0/1262722206 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb009be30 con 0x7f2cb006dee0 2023-10-14T16:55:00.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.827+0000 7f5ce7080700 1 -- 172.21.15.8:0/1859848939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ce0029f60 con 0x7f5ce013b270 2023-10-14T16:55:00.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.827+0000 7fcb3f7fe700 1 -- 172.21.15.8:0/3718260637 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb4c01a820 con 0x7fcb5806d620 2023-10-14T16:55:00.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.827+0000 7f2cb57d5700 1 -- 172.21.15.8:0/1262722206 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2cb01309b0 con 0x7f2cb006dee0 2023-10-14T16:55:00.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.827+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/3718260637 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb38000f10 con 0x7fcb5806d620 2023-10-14T16:55:00.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.827+0000 7fcb3f7fe700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcb44066f30 0x7fcb440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.827+0000 7f1ff27fc700 1 -- 172.21.15.8:0/571495117 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ff401bcb0 con 0x7f1ffc138450 2023-10-14T16:55:00.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.827+0000 7fcb3f7fe700 1 -- 172.21.15.8:0/3718260637 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fcb4c085990 con 0x7fcb5806d620 2023-10-14T16:55:00.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.827+0000 7fcb577fe700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcb44066f30 0x7fcb440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7fcb3f7fe700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] conn(0x7fcb4406eb90 0x7fcb44070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7fcb3f7fe700 1 -- 172.21.15.8:0/3718260637 --> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb44071690 con 0x7fcb4406eb90 2023-10-14T16:55:00.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7fcb3f7fe700 1 -- 172.21.15.8:0/3718260637 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb4c08a240 con 0x7fcb5806d620 2023-10-14T16:55:00.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7fcb57fff700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] conn(0x7fcb4406eb90 0x7fcb44070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f2ca7fff700 1 -- 172.21.15.8:0/1262722206 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c98013680 con 0x7f2cb006dee0 2023-10-14T16:55:00.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f1ff27fc700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1fe0066f30 0x7f1fe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f1ff27fc700 1 -- 172.21.15.8:0/571495117 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f1ff4086310 con 0x7f1ffc138450 2023-10-14T16:55:00.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f2002265700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1fe0066f30 0x7f1fe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7fcb577fe700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcb44066f30 0x7fcb440693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcb48001710 tx=0x7fcb48007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f1ff27fc700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] conn(0x7f1fe006eb90 0x7f1fe0070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f1ff27fc700 1 -- 172.21.15.8:0/571495117 --> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fe0071690 con 0x7f1fe006eb90 2023-10-14T16:55:00.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f1ff27fc700 1 -- 172.21.15.8:0/571495117 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ff40866e0 con 0x7f1ffc138450 2023-10-14T16:55:00.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f2ca7fff700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2c90067000 0x7f2c900694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f2002265700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1fe0066f30 0x7f1fe00693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8007fd0 tx=0x7f1ff8007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f2caf7fe700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2c90067000 0x7f2c900694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f2ca7fff700 1 -- 172.21.15.8:0/1262722206 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f2c98084560 con 0x7f2cb006dee0 2023-10-14T16:55:00.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f5cd67fc700 1 -- 172.21.15.8:0/1859848939 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cd00070d0 con 0x7f5ce013b270 2023-10-14T16:55:00.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f5cd67fc700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5cc4066fb0 0x7f5cc4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f5cd67fc700 1 -- 172.21.15.8:0/1859848939 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f5cd0083360 con 0x7f5ce013b270 2023-10-14T16:55:00.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f5cd67fc700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] conn(0x7f5cc406eb90 0x7f5cc4070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f5cd67fc700 1 -- 172.21.15.8:0/1859848939 --> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cc4071690 con 0x7f5cc406eb90 2023-10-14T16:55:00.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.829+0000 7f5ce607e700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5cc4066fb0 0x7f5cc4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.829+0000 7f2ca7fff700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] conn(0x7f2c9006ebe0 0x7f2c90071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:00.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.829+0000 7f2ca7fff700 1 -- 172.21.15.8:0/1262722206 --> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c900716e0 con 0x7f2c9006ebe0 2023-10-14T16:55:00.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.829+0000 7f5ce687f700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] conn(0x7f5cc406eb90 0x7f5cc4070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.829+0000 7f2ca7fff700 1 -- 172.21.15.8:0/1262722206 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c98051db0 con 0x7f2cb006dee0 2023-10-14T16:55:00.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.828+0000 7f2001a64700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] conn(0x7f1fe006eb90 0x7f1fe0070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.829+0000 7f2cb4fd4700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] conn(0x7f2c9006ebe0 0x7f2c90071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:00.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.829+0000 7f5cd67fc700 1 -- 172.21.15.8:0/1859848939 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cd00011f0 con 0x7f5ce013b270 2023-10-14T16:55:00.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.829+0000 7fcb57fff700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] conn(0x7fcb4406eb90 0x7fcb44070fc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.829+0000 7f5ce687f700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] conn(0x7f5cc406eb90 0x7f5cc4070fc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.829+0000 7f5ce607e700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5cc4066fb0 0x7f5cc4069460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc006fd0 tx=0x7f5cdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.829+0000 7f2001a64700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] conn(0x7f1fe006eb90 0x7f1fe0070fc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.829+0000 7f2cb4fd4700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] conn(0x7f2c9006ebe0 0x7f2c90071010 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.830+0000 7f1ff27fc700 1 -- 172.21.15.8:0/571495117 <== osd.3 v2:172.21.15.155:6808/86170 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1fe0071690 con 0x7f1fe006eb90 2023-10-14T16:55:00.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.830+0000 7fcb3f7fe700 1 -- 172.21.15.8:0/3718260637 <== osd.1 v2:172.21.15.8:6802/86153 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fcb44071690 con 0x7fcb4406eb90 2023-10-14T16:55:00.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.830+0000 7f2ca7fff700 1 -- 172.21.15.8:0/1262722206 <== osd.2 v2:172.21.15.155:6800/86169 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2c900716e0 con 0x7f2c9006ebe0 2023-10-14T16:55:00.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.830+0000 7f5cd67fc700 1 -- 172.21.15.8:0/1859848939 <== osd.0 v2:172.21.15.8:6800/86152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5cc4071690 con 0x7f5cc406eb90 2023-10-14T16:55:00.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.839+0000 7f2caf7fe700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2c90067000 0x7f2c900694b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00a3630 tx=0x7f2ca0007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:00.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.845+0000 7f20044c9700 1 -- 172.21.15.8:0/571495117 --> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1ffc0a0780 con 0x7f1fe006eb90 2023-10-14T16:55:00.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.845+0000 7f5ce7080700 1 -- 172.21.15.8:0/1859848939 --> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ce0097990 con 0x7f5cc406eb90 2023-10-14T16:55:00.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f5cd67fc700 1 -- 172.21.15.8:0/1859848939 <== osd.0 v2:172.21.15.8:6800/86152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ce0097990 con 0x7f5cc406eb90 2023-10-14T16:55:00.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f1ff27fc700 1 -- 172.21.15.8:0/571495117 <== osd.3 v2:172.21.15.155:6808/86170 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1ffc0a0780 con 0x7f1fe006eb90 2023-10-14T16:55:00.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f5ce7080700 1 -- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] conn(0x7f5cc406eb90 msgr2=0x7f5cc4070fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f5ce7080700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] conn(0x7f5cc406eb90 0x7f5cc4070fc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f5ce7080700 1 -- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5cc4066fb0 msgr2=0x7f5cc4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f5ce7080700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5cc4066fb0 0x7f5cc4069460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc006fd0 tx=0x7f5cdc008040 comp rx=0 tx=0).stop 2023-10-14T16:55:00.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f5ce7080700 1 -- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce013b270 msgr2=0x7f5ce0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f5ce7080700 1 --2- 172.21.15.8:0/1859848939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ce013b270 0x7f5ce0134100 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000c7f0 tx=0x7f5cd0007f70 comp rx=0 tx=0).stop 2023-10-14T16:55:00.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f20044c9700 1 -- 172.21.15.8:0/571495117 >> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] conn(0x7f1fe006eb90 msgr2=0x7f1fe0070fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f20044c9700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] conn(0x7f1fe006eb90 0x7f1fe0070fc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f5ce687f700 1 -- 172.21.15.8:0/1859848939 reap_dead start 2023-10-14T16:55:00.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f20044c9700 1 -- 172.21.15.8:0/571495117 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1fe0066f30 msgr2=0x7f1fe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f20044c9700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1fe0066f30 0x7f1fe00693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8007fd0 tx=0x7f1ff8007d30 comp rx=0 tx=0).stop 2023-10-14T16:55:00.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f5ce7080700 1 -- 172.21.15.8:0/1859848939 shutdown_connections 2023-10-14T16:55:00.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f5ce7080700 1 -- 172.21.15.8:0/1859848939 >> 172.21.15.8:0/1859848939 conn(0x7f5ce00a2fc0 msgr2=0x7f5ce006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:00.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f20044c9700 1 -- 172.21.15.8:0/571495117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ffc138450 msgr2=0x7f1ffc0964f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f20044c9700 1 --2- 172.21.15.8:0/571495117 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ffc138450 0x7f1ffc0964f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4013000 tx=0x7f1ff4019000 comp rx=0 tx=0).stop 2023-10-14T16:55:00.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f2002a66700 1 -- 172.21.15.8:0/571495117 reap_dead start 2023-10-14T16:55:00.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f5ce7080700 1 -- 172.21.15.8:0/1859848939 shutdown_connections 2023-10-14T16:55:00.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.846+0000 7f5ce7080700 1 -- 172.21.15.8:0/1859848939 wait complete. 2023-10-14T16:55:00.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.850+0000 7f20044c9700 1 -- 172.21.15.8:0/571495117 shutdown_connections 2023-10-14T16:55:00.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.850+0000 7f20044c9700 1 -- 172.21.15.8:0/571495117 >> 172.21.15.8:0/571495117 conn(0x7f1ffc06acd0 msgr2=0x7f1ffc138eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:00.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.850+0000 7f20044c9700 1 -- 172.21.15.8:0/571495117 shutdown_connections 2023-10-14T16:55:00.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.850+0000 7f20044c9700 1 -- 172.21.15.8:0/571495117 wait complete. 2023-10-14T16:55:00.917 INFO:teuthology.orchestra.run.smithi008.stdout:38654705668 2023-10-14T16:55:00.918 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T16:55:00.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.861+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/3718260637 --> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb38002bc0 con 0x7fcb4406eb90 2023-10-14T16:55:00.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.861+0000 7f2cb57d5700 1 -- 172.21.15.8:0/1262722206 --> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2cb0069ba0 con 0x7f2c9006ebe0 2023-10-14T16:55:00.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7fcb3f7fe700 1 -- 172.21.15.8:0/3718260637 <== osd.1 v2:172.21.15.8:6802/86153 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb38002bc0 con 0x7fcb4406eb90 2023-10-14T16:55:00.921 INFO:teuthology.orchestra.run.smithi008.stdout:38654705670 2023-10-14T16:55:00.921 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T16:55:00.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] conn(0x7fcb4406eb90 msgr2=0x7fcb44070fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7fcb5ddc7700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] conn(0x7fcb4406eb90 0x7fcb44070fc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcb44066f30 msgr2=0x7fcb440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7fcb5ddc7700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcb44066f30 0x7fcb440693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcb48001710 tx=0x7fcb48007eb0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/3718260637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb5806d620 msgr2=0x7fcb581472a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7fcb5ddc7700 1 --2- 172.21.15.8:0/3718260637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb5806d620 0x7fcb581472a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcb5806a1c0 tx=0x7fcb4c017000 comp rx=0 tx=0).stop 2023-10-14T16:55:00.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7fcb57fff700 1 -- 172.21.15.8:0/3718260637 reap_dead start 2023-10-14T16:55:00.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/3718260637 shutdown_connections 2023-10-14T16:55:00.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/3718260637 >> 172.21.15.8:0/3718260637 conn(0x7fcb580a5a60 msgr2=0x7fcb5809b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:00.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7f2ca7fff700 1 -- 172.21.15.8:0/1262722206 <== osd.2 v2:172.21.15.155:6800/86169 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2cb0069ba0 con 0x7f2c9006ebe0 2023-10-14T16:55:00.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/3718260637 shutdown_connections 2023-10-14T16:55:00.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.862+0000 7fcb5ddc7700 1 -- 172.21.15.8:0/3718260637 wait complete. 2023-10-14T16:55:00.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.863+0000 7f2cb57d5700 1 -- 172.21.15.8:0/1262722206 >> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] conn(0x7f2c9006ebe0 msgr2=0x7f2c90071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.863+0000 7f2cb57d5700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] conn(0x7f2c9006ebe0 0x7f2c90071010 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.863+0000 7f2cb57d5700 1 -- 172.21.15.8:0/1262722206 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2c90067000 msgr2=0x7f2c900694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.863+0000 7f2cb57d5700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2c90067000 0x7f2c900694b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00a3630 tx=0x7f2ca0007ec0 comp rx=0 tx=0).stop 2023-10-14T16:55:00.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.863+0000 7f2cb57d5700 1 -- 172.21.15.8:0/1262722206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb006dee0 msgr2=0x7f2cb01446c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:00.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.863+0000 7f2cb57d5700 1 --2- 172.21.15.8:0/1262722206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb006dee0 0x7f2cb01446c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800ec50 tx=0x7f2c98009250 comp rx=0 tx=0).stop 2023-10-14T16:55:00.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.863+0000 7f2cb4fd4700 1 -- 172.21.15.8:0/1262722206 reap_dead start 2023-10-14T16:55:00.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.863+0000 7f2cb57d5700 1 -- 172.21.15.8:0/1262722206 shutdown_connections 2023-10-14T16:55:00.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.863+0000 7f2cb57d5700 1 -- 172.21.15.8:0/1262722206 >> 172.21.15.8:0/1262722206 conn(0x7f2cb0070c90 msgr2=0x7f2cb012e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:00.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.863+0000 7f2cb57d5700 1 -- 172.21.15.8:0/1262722206 shutdown_connections 2023-10-14T16:55:00.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:00.863+0000 7f2cb57d5700 1 -- 172.21.15.8:0/1262722206 wait complete. 2023-10-14T16:55:00.930 INFO:teuthology.orchestra.run.smithi008.stdout:38654705669 2023-10-14T16:55:00.930 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T16:55:00.931 INFO:teuthology.orchestra.run.smithi008.stdout:38654705670 2023-10-14T16:55:00.931 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T16:55:01.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7f53e6c8c700 1 Processor -- start 2023-10-14T16:55:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7fe8d610b700 1 Processor -- start 2023-10-14T16:55:01.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7fe8d610b700 1 -- start start 2023-10-14T16:55:01.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7f69a9e14700 1 Processor -- start 2023-10-14T16:55:01.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7fef8e65a700 1 Processor -- start 2023-10-14T16:55:01.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7f53e6c8c700 1 -- start start 2023-10-14T16:55:01.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7f69a9e14700 1 -- start start 2023-10-14T16:55:01.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7fef8e65a700 1 -- start start 2023-10-14T16:55:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7fe8d610b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d00a50a0 0x7fe8d0133d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7fe8d610b700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d006c410 con 0x7fe8d0134260 2023-10-14T16:55:01.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7fe8d610b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d006db60 con 0x7fe8d00a6500 2023-10-14T16:55:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7fe8d610b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d01338f0 con 0x7fe8d00a50a0 2023-10-14T16:55:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7f53e6c8c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f53e01355c0 0x7f53e0139ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f53e6c8c700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e006e200 con 0x7f53e002a1b0 2023-10-14T16:55:01.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7f69a9e14700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f69a406d0f0 0x7f69a4130f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7f69a9e14700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a40a1f80 con 0x7f69a406ec80 2023-10-14T16:55:01.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7f69a9e14700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a40a7cd0 con 0x7f69a4139cf0 2023-10-14T16:55:01.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7f69a9e14700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a406d770 con 0x7f69a406d0f0 2023-10-14T16:55:01.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f53e5c8a700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f53e002a1b0 0x7f53e0134eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42418/0 (socket says 172.21.15.8:42418) 2023-10-14T16:55:01.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f53e5c8a700 1 -- 172.21.15.8:0/637658849 learned_addr learned my addr 172.21.15.8:0/637658849 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:01.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f53e6c8c700 1 -- 172.21.15.8:0/637658849 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e006d850 con 0x7f53e006dce0 2023-10-14T16:55:01.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f53e6c8c700 1 -- 172.21.15.8:0/637658849 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e0134a60 con 0x7f53e01355c0 2023-10-14T16:55:01.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f69a37fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f69a406ec80 0x7f69a4130820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42416/0 (socket says 172.21.15.8:42416) 2023-10-14T16:55:01.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f69a37fe700 1 -- 172.21.15.8:0/268473151 learned_addr learned my addr 172.21.15.8:0/268473151 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:01.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fe8ceffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe8d0134260 0x7fe8d00a5df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42406/0 (socket says 172.21.15.8:42406) 2023-10-14T16:55:01.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fe8ceffd700 1 -- 172.21.15.8:0/117992521 learned_addr learned my addr 172.21.15.8:0/117992521 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:01.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f69a2ffd700 1 --2- 172.21.15.8:0/268473151 >> v2:172.21.15.155:3300/0 conn(0x7f69a406d0f0 0x7f69a4130f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fe8cf7fe700 1 --2- 172.21.15.8:0/117992521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d00a50a0 0x7fe8d0133d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f53e5489700 1 --2- 172.21.15.8:0/637658849 >> v2:172.21.15.8:3300/0 conn(0x7f53e01355c0 0x7f53e0139ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.087+0000 7fef8e65a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef880a6550 0x7fef88133e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef8e65a700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef880a6920 0x7fef88136d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef8e65a700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fef88111f90 0x7fef88137290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef8e65a700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef88133750 con 0x7fef88111f90 2023-10-14T16:55:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef8e65a700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef88133940 con 0x7fef880a6920 2023-10-14T16:55:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef8e65a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef88133be0 con 0x7fef880a6550 2023-10-14T16:55:01.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef87fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef880a6550 0x7fef88133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef87fff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef880a6550 0x7fef88133e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.8:55966/0 (socket says 172.21.15.8:55966) 2023-10-14T16:55:01.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef87fff700 1 -- 172.21.15.8:0/2386707479 learned_addr learned my addr 172.21.15.8:0/2386707479 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:01.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef877fe700 1 --2- 172.21.15.8:0/2386707479 >> v2:172.21.15.155:3300/0 conn(0x7fef880a6920 0x7fef88136d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fe8ce7fc700 1 -- 172.21.15.8:0/117992521 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031307092 0 0) 0x7fe8d006db60 con 0x7fe8d00a6500 2023-10-14T16:55:01.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fe8cf7fe700 1 -- 172.21.15.8:0/117992521 >> v1:172.21.15.155:6789/0 conn(0x7fe8d00a6500 legacy=0x7fe8d013bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fe8cf7fe700 1 -- 172.21.15.8:0/117992521 >> v1:172.21.15.8:6789/0 conn(0x7fe8d0134260 legacy=0x7fe8d00a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fe8cf7fe700 1 -- 172.21.15.8:0/117992521 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d006ba70 con 0x7fe8d00a50a0 2023-10-14T16:55:01.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f53e5489700 1 -- 172.21.15.8:0/637658849 >> v1:172.21.15.155:6789/0 conn(0x7f53e006dce0 legacy=0x7f53e013c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f53e5489700 1 -- 172.21.15.8:0/637658849 >> v1:172.21.15.8:6789/0 conn(0x7f53e002a1b0 legacy=0x7f53e0134eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f53e5489700 1 -- 172.21.15.8:0/637658849 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e006cfc0 con 0x7f53e01355c0 2023-10-14T16:55:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f69a2ffd700 1 -- 172.21.15.8:0/268473151 >> v1:172.21.15.155:6789/0 conn(0x7f69a4139cf0 legacy=0x7f69a413c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f69a2ffd700 1 -- 172.21.15.8:0/268473151 >> v1:172.21.15.8:6789/0 conn(0x7f69a406ec80 legacy=0x7f69a4130820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f69a2ffd700 1 -- 172.21.15.8:0/268473151 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a40a7f90 con 0x7f69a406d0f0 2023-10-14T16:55:01.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef8cbf7700 1 --2- 172.21.15.8:0/2386707479 >> v2:172.21.15.8:3300/0 conn(0x7fef88111f90 0x7fef88137290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef87fff700 1 -- 172.21.15.8:0/2386707479 >> v2:172.21.15.155:3300/0 conn(0x7fef880a6920 msgr2=0x7fef88136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:01.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef87fff700 1 --2- 172.21.15.8:0/2386707479 >> v2:172.21.15.155:3300/0 conn(0x7fef880a6920 0x7fef88136d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f53e5489700 1 --2- 172.21.15.8:0/637658849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53e01355c0 0x7f53e0139ce0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53d00098e0 tx=0x7f53d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1f1e2fc172c16e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:01.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef87fff700 1 -- 172.21.15.8:0/2386707479 >> v2:172.21.15.8:3300/0 conn(0x7fef88111f90 msgr2=0x7fef88137290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:01.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef87fff700 1 --2- 172.21.15.8:0/2386707479 >> v2:172.21.15.8:3300/0 conn(0x7fef88111f90 0x7fef88137290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fef87fff700 1 -- 172.21.15.8:0/2386707479 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef88112780 con 0x7fef880a6550 2023-10-14T16:55:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7fe8cf7fe700 1 --2- 172.21.15.8:0/117992521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d00a50a0 0x7fe8d0133d20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009940 tx=0x7fe8c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fedf3269e35b117 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:01.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.088+0000 7f69a2ffd700 1 --2- 172.21.15.8:0/268473151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69a406d0f0 0x7f69a4130f30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69980098e0 tx=0x7f69980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d39a8aed3feabfe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7fef8cbf7700 1 --2- 172.21.15.8:0/2386707479 >> v2:172.21.15.8:3300/0 conn(0x7fef88111f90 0x7fef88137290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:55:01.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7fe8ce7fc700 1 -- 172.21.15.8:0/117992521 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000b820 con 0x7fe8d00a50a0 2023-10-14T16:55:01.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7f53e4c88700 1 -- 172.21.15.8:0/637658849 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0009e80 con 0x7f53e01355c0 2023-10-14T16:55:01.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7fe8ce7fc700 1 -- 172.21.15.8:0/117992521 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c000b980 con 0x7fe8d00a50a0 2023-10-14T16:55:01.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7fe8ce7fc700 1 -- 172.21.15.8:0/117992521 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000bd20 con 0x7fe8d00a50a0 2023-10-14T16:55:01.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7fef87fff700 1 --2- 172.21.15.8:0/2386707479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef880a6550 0x7fef88133e70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fef780099b0 tx=0x7fef78009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1dae8378e1edde1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:01.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7f69a27fc700 1 -- 172.21.15.8:0/268473151 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998009e80 con 0x7f69a406d0f0 2023-10-14T16:55:01.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7f69a27fc700 1 -- 172.21.15.8:0/268473151 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699800b860 con 0x7f69a406d0f0 2023-10-14T16:55:01.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7f69a27fc700 1 -- 172.21.15.8:0/268473151 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699800bbe0 con 0x7f69a406d0f0 2023-10-14T16:55:01.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7f53e4c88700 1 -- 172.21.15.8:0/637658849 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d000b860 con 0x7f53e01355c0 2023-10-14T16:55:01.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7f53e4c88700 1 -- 172.21.15.8:0/637658849 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d000bbe0 con 0x7f53e01355c0 2023-10-14T16:55:01.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7fef86ffd700 1 -- 172.21.15.8:0/2386707479 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78009ea0 con 0x7fef880a6550 2023-10-14T16:55:01.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7fef86ffd700 1 -- 172.21.15.8:0/2386707479 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7800b820 con 0x7fef880a6550 2023-10-14T16:55:01.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7fef86ffd700 1 -- 172.21.15.8:0/2386707479 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7800bbe0 con 0x7fef880a6550 2023-10-14T16:55:01.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7fe8d610b700 1 -- 172.21.15.8:0/117992521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d00a50a0 msgr2=0x7fe8d0133d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7fe8d610b700 1 --2- 172.21.15.8:0/117992521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d00a50a0 0x7fe8d0133d20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009940 tx=0x7fe8c00091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7f53e6c8c700 1 -- 172.21.15.8:0/637658849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53e01355c0 msgr2=0x7f53e0139ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7f53e6c8c700 1 --2- 172.21.15.8:0/637658849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53e01355c0 0x7f53e0139ce0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53d00098e0 tx=0x7f53d00091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7f69a9e14700 1 -- 172.21.15.8:0/268473151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69a406d0f0 msgr2=0x7f69a4130f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7f69a9e14700 1 --2- 172.21.15.8:0/268473151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69a406d0f0 0x7f69a4130f30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69980098e0 tx=0x7f69980091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fe8d610b700 1 -- 172.21.15.8:0/117992521 shutdown_connections 2023-10-14T16:55:01.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.089+0000 7f69a9e14700 1 -- 172.21.15.8:0/268473151 shutdown_connections 2023-10-14T16:55:01.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7f69a9e14700 1 --2- 172.21.15.8:0/268473151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69a406d0f0 0x7f69a4130f30 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69980098e0 tx=0x7f69980091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7f69a9e14700 1 -- 172.21.15.8:0/268473151 >> 172.21.15.8:0/268473151 conn(0x7f69a406b860 msgr2=0x7f69a40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:01.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fe8d610b700 1 --2- 172.21.15.8:0/117992521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d00a50a0 0x7fe8d0133d20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fe8d610b700 1 -- 172.21.15.8:0/117992521 >> 172.21.15.8:0/117992521 conn(0x7fe8d0069c70 msgr2=0x7fe8d00701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:01.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7f53e6c8c700 1 -- 172.21.15.8:0/637658849 shutdown_connections 2023-10-14T16:55:01.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7f53e6c8c700 1 --2- 172.21.15.8:0/637658849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53e01355c0 0x7f53e0139ce0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7f53e6c8c700 1 -- 172.21.15.8:0/637658849 >> 172.21.15.8:0/637658849 conn(0x7f53e0070380 msgr2=0x7f53e0070780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:01.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fe8d610b700 1 -- 172.21.15.8:0/117992521 shutdown_connections 2023-10-14T16:55:01.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fef8e65a700 1 -- 172.21.15.8:0/2386707479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef880a6550 msgr2=0x7fef88133e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fef8e65a700 1 --2- 172.21.15.8:0/2386707479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef880a6550 0x7fef88133e70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fef780099b0 tx=0x7fef78009250 comp rx=0 tx=0).stop 2023-10-14T16:55:01.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fe8d610b700 1 -- 172.21.15.8:0/117992521 wait complete. 2023-10-14T16:55:01.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7f69a9e14700 1 -- 172.21.15.8:0/268473151 shutdown_connections 2023-10-14T16:55:01.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7f69a9e14700 1 -- 172.21.15.8:0/268473151 wait complete. 2023-10-14T16:55:01.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fef8e65a700 1 -- 172.21.15.8:0/2386707479 shutdown_connections 2023-10-14T16:55:01.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fef8e65a700 1 --2- 172.21.15.8:0/2386707479 >> v2:172.21.15.8:3300/0 conn(0x7fef88111f90 0x7fef88137290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fef8e65a700 1 --2- 172.21.15.8:0/2386707479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef880a6550 0x7fef88133e70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fef8e65a700 1 --2- 172.21.15.8:0/2386707479 >> v2:172.21.15.155:3300/0 conn(0x7fef880a6920 0x7fef88136d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fef8e65a700 1 -- 172.21.15.8:0/2386707479 >> 172.21.15.8:0/2386707479 conn(0x7fef8806ac40 msgr2=0x7fef880701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:01.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fef8e65a700 1 -- 172.21.15.8:0/2386707479 shutdown_connections 2023-10-14T16:55:01.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7fef8e65a700 1 -- 172.21.15.8:0/2386707479 wait complete. 2023-10-14T16:55:01.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.090+0000 7f53e6c8c700 1 -- 172.21.15.8:0/637658849 shutdown_connections 2023-10-14T16:55:01.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7fef8e65a700 1 Processor -- start 2023-10-14T16:55:01.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7fe8d610b700 1 Processor -- start 2023-10-14T16:55:01.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7f69a9e14700 1 Processor -- start 2023-10-14T16:55:01.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7f53e6c8c700 1 -- 172.21.15.8:0/637658849 wait complete. 2023-10-14T16:55:01.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7fe8d610b700 1 -- start start 2023-10-14T16:55:01.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7f69a9e14700 1 -- start start 2023-10-14T16:55:01.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7fef8e65a700 1 -- start start 2023-10-14T16:55:01.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7fef8e65a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef880a6550 0x7fef88134920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7fef8e65a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef880a6920 0x7fef88134e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7fef8e65a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef88111f90 0x7fef881353a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7fef8e65a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef88136990 con 0x7fef880a6920 2023-10-14T16:55:01.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7fef8e65a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8812c340 con 0x7fef88111f90 2023-10-14T16:55:01.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7fef8e65a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef88114ae0 con 0x7fef880a6550 2023-10-14T16:55:01.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7fef877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef880a6920 0x7fef88134e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fef877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef880a6920 0x7fef88134e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53338/0 (socket says 172.21.15.8:53338) 2023-10-14T16:55:01.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fef877fe700 1 -- 172.21.15.8:0/308979651 learned_addr learned my addr 172.21.15.8:0/308979651 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:01.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a9e14700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69a406ec80 0x7f69a4133580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a9e14700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69a4139cf0 0x7f69a4133ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a9e14700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69a413ea20 0x7f69a4134000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a9e14700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41356a0 con 0x7f69a413ea20 2023-10-14T16:55:01.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a9e14700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a4136840 con 0x7f69a4139cf0 2023-10-14T16:55:01.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a9e14700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a4136b00 con 0x7f69a406ec80 2023-10-14T16:55:01.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.091+0000 7fe8d610b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00a6500 0x7fe8d013b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8d610b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d0134260 0x7fe8d013b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8d610b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8d013db60 0x7fe8d013bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8d610b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d013c160 con 0x7fe8d00a6500 2023-10-14T16:55:01.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8d610b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d0096f00 con 0x7fe8d013db60 2023-10-14T16:55:01.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8d610b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d0095d80 con 0x7fe8d0134260 2023-10-14T16:55:01.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8cf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00a6500 0x7fe8d013b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8cf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00a6500 0x7fe8d013b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53344/0 (socket says 172.21.15.8:53344) 2023-10-14T16:55:01.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8cf7fe700 1 -- 172.21.15.8:0/2198894485 learned_addr learned my addr 172.21.15.8:0/2198894485 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:01.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8cffff700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8d013db60 0x7fe8d013bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f53e6c8c700 1 Processor -- start 2023-10-14T16:55:01.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69a413ea20 0x7f69a4134000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a37fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69a406ec80 0x7f69a4133580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69a413ea20 0x7f69a4134000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53346/0 (socket says 172.21.15.8:53346) 2023-10-14T16:55:01.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a3fff700 1 -- 172.21.15.8:0/4212553131 learned_addr learned my addr 172.21.15.8:0/4212553131 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:01.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a2ffd700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69a4139cf0 0x7f69a4133ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8ceffd700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d0134260 0x7fe8d013b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f53e6c8c700 1 -- start start 2023-10-14T16:55:01.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fef87fff700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef880a6550 0x7fef88134920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fef8cbf7700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef88111f90 0x7fef881353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fef877fe700 1 -- 172.21.15.8:0/308979651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef880a6550 msgr2=0x7fef88134920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fef877fe700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef880a6550 0x7fef88134920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fef877fe700 1 -- 172.21.15.8:0/308979651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef88111f90 msgr2=0x7fef881353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fef877fe700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef88111f90 0x7fef881353a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fef877fe700 1 -- 172.21.15.8:0/308979651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef780094f0 con 0x7fef880a6920 2023-10-14T16:55:01.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8cf7fe700 1 -- 172.21.15.8:0/2198894485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d0134260 msgr2=0x7fe8d013b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8cf7fe700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d0134260 0x7fe8d013b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8cf7fe700 1 -- 172.21.15.8:0/2198894485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8d013db60 msgr2=0x7fe8d013bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8cf7fe700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8d013db60 0x7fe8d013bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fe8cf7fe700 1 -- 172.21.15.8:0/2198894485 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c0009420 con 0x7fe8d00a6500 2023-10-14T16:55:01.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a37fe700 1 -- 172.21.15.8:0/4212553131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69a4139cf0 msgr2=0x7f69a4133ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a37fe700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69a4139cf0 0x7f69a4133ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a37fe700 1 -- 172.21.15.8:0/4212553131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69a413ea20 msgr2=0x7f69a4134000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a37fe700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69a413ea20 0x7f69a4134000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a37fe700 1 -- 172.21.15.8:0/4212553131 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6998009420 con 0x7f69a406ec80 2023-10-14T16:55:01.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7f69a2ffd700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69a4139cf0 0x7f69a4133ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:01.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fef877fe700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef880a6920 0x7fef88134e60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00ec80 tx=0x7fef7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:01.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.092+0000 7fef6ffff700 1 -- 172.21.15.8:0/308979651 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00c850 con 0x7fef880a6920 2023-10-14T16:55:01.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7fef6ffff700 1 -- 172.21.15.8:0/308979651 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c00c9b0 con 0x7fef880a6920 2023-10-14T16:55:01.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7fe8cf7fe700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00a6500 0x7fe8d013b0b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0063e40 tx=0x7fe8c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:01.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7fef8e65a700 1 -- 172.21.15.8:0/308979651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8812c570 con 0x7fef880a6920 2023-10-14T16:55:01.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f69a37fe700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69a406ec80 0x7f69a4133580 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f699400c7c0 tx=0x7f6994007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:01.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7fef6ffff700 1 -- 172.21.15.8:0/308979651 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00cd50 con 0x7fef880a6920 2023-10-14T16:55:01.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7fef8e65a700 1 -- 172.21.15.8:0/308979651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef88113c20 con 0x7fef880a6920 2023-10-14T16:55:01.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e6c8c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e006dce0 0x7f53e009d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e6c8c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53e01355c0 0x7f53e009d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e6c8c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e009dcf0 0x7f53e00a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e6c8c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00a0b20 con 0x7f53e01355c0 2023-10-14T16:55:01.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e6c8c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00a21a0 con 0x7f53e006dce0 2023-10-14T16:55:01.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e6c8c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00a0d50 con 0x7f53e009dcf0 2023-10-14T16:55:01.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7fe8b77fe700 1 -- 172.21.15.8:0/2198894485 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c001f070 con 0x7fe8d00a6500 2023-10-14T16:55:01.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7fe8b77fe700 1 -- 172.21.15.8:0/2198894485 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c000bed0 con 0x7fe8d00a6500 2023-10-14T16:55:01.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7fe8b77fe700 1 -- 172.21.15.8:0/2198894485 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0002f70 con 0x7fe8d00a6500 2023-10-14T16:55:01.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e5489700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53e01355c0 0x7f53e009d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e5c8a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e006dce0 0x7f53e009d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e5489700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53e01355c0 0x7f53e009d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53362/0 (socket says 172.21.15.8:53362) 2023-10-14T16:55:01.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e5489700 1 -- 172.21.15.8:0/630401813 learned_addr learned my addr 172.21.15.8:0/630401813 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:01.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e648b700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e009dcf0 0x7f53e00a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e5489700 1 -- 172.21.15.8:0/630401813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e009dcf0 msgr2=0x7f53e00a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e5489700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e009dcf0 0x7f53e00a23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e5489700 1 -- 172.21.15.8:0/630401813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e006dce0 msgr2=0x7f53e009d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e5489700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e006dce0 0x7f53e009d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e5489700 1 -- 172.21.15.8:0/630401813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d0009420 con 0x7f53e01355c0 2023-10-14T16:55:01.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e5c8a700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e006dce0 0x7f53e009d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:01.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f53e5489700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53e01355c0 0x7f53e009d7b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53d0013000 tx=0x7f53d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:01.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.094+0000 7f53d5ffb700 1 -- 172.21.15.8:0/630401813 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d000bbe0 con 0x7f53e01355c0 2023-10-14T16:55:01.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.094+0000 7f53d5ffb700 1 -- 172.21.15.8:0/630401813 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0011420 con 0x7f53e01355c0 2023-10-14T16:55:01.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.094+0000 7f53e6c8c700 1 -- 172.21.15.8:0/630401813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e00a01a0 con 0x7f53e01355c0 2023-10-14T16:55:01.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.094+0000 7f53d5ffb700 1 -- 172.21.15.8:0/630401813 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d00117c0 con 0x7f53e01355c0 2023-10-14T16:55:01.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f698b7fe700 1 -- 172.21.15.8:0/4212553131 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994005b30 con 0x7f69a406ec80 2023-10-14T16:55:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f698b7fe700 1 -- 172.21.15.8:0/4212553131 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6994005c90 con 0x7f69a406ec80 2023-10-14T16:55:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.093+0000 7f698b7fe700 1 -- 172.21.15.8:0/4212553131 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994004a80 con 0x7f69a406ec80 2023-10-14T16:55:01.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.094+0000 7fe8d610b700 1 -- 172.21.15.8:0/2198894485 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d0096040 con 0x7fe8d00a6500 2023-10-14T16:55:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.094+0000 7fef8e65a700 1 -- 172.21.15.8:0/308979651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef880708d0 con 0x7fef880a6920 2023-10-14T16:55:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.094+0000 7fe8d610b700 1 -- 172.21.15.8:0/2198894485 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d0095af0 con 0x7fe8d00a6500 2023-10-14T16:55:01.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.094+0000 7f53e6c8c700 1 -- 172.21.15.8:0/630401813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e009fbb0 con 0x7f53e01355c0 2023-10-14T16:55:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.094+0000 7f69a9e14700 1 -- 172.21.15.8:0/4212553131 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a4137270 con 0x7f69a406ec80 2023-10-14T16:55:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.094+0000 7f69a9e14700 1 -- 172.21.15.8:0/4212553131 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a41379c0 con 0x7f69a406ec80 2023-10-14T16:55:01.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.095+0000 7fe8d610b700 1 -- 172.21.15.8:0/2198894485 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d013e870 con 0x7fe8d00a6500 2023-10-14T16:55:01.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.095+0000 7f53cb7fe700 1 -- 172.21.15.8:0/630401813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b80050b0 con 0x7f53e01355c0 2023-10-14T16:55:01.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.096+0000 7f69a9e14700 1 -- 172.21.15.8:0/4212553131 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a40708d0 con 0x7f69a406ec80 2023-10-14T16:55:01.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.096+0000 7fef6ffff700 1 -- 172.21.15.8:0/308979651 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef7c013680 con 0x7fef880a6920 2023-10-14T16:55:01.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.096+0000 7fe8b77fe700 1 -- 172.21.15.8:0/2198894485 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8c0023070 con 0x7fe8d00a6500 2023-10-14T16:55:01.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.096+0000 7f53d5ffb700 1 -- 172.21.15.8:0/630401813 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53d0011b70 con 0x7f53e01355c0 2023-10-14T16:55:01.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.096+0000 7f698b7fe700 1 -- 172.21.15.8:0/4212553131 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69940070d0 con 0x7f69a406ec80 2023-10-14T16:55:01.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.096+0000 7fef6ffff700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fef74066f30 0x7fef740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.096+0000 7fe8b77fe700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe8bc066f30 0x7fe8bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.096+0000 7fef6ffff700 1 -- 172.21.15.8:0/308979651 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fef7c0842e0 con 0x7fef880a6920 2023-10-14T16:55:01.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.097+0000 7f698b7fe700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6990067000 0x7f69900694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.097+0000 7f53d5ffb700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f53c4066f30 0x7f53c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:01.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.096+0000 7fe8b77fe700 1 -- 172.21.15.8:0/2198894485 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fe8c0085440 con 0x7fe8d00a6500 2023-10-14T16:55:01.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.097+0000 7fe8ceffd700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe8bc066f30 0x7fe8bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.097+0000 7f69a2ffd700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6990067000 0x7f69900694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.097+0000 7f698b7fe700 1 -- 172.21.15.8:0/4212553131 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f6994083250 con 0x7f69a406ec80 2023-10-14T16:55:01.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.097+0000 7f53d5ffb700 1 -- 172.21.15.8:0/630401813 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f53d0085920 con 0x7f53e01355c0 2023-10-14T16:55:01.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.097+0000 7f53e5c8a700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f53c4066f30 0x7f53c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.097+0000 7fe8ceffd700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe8bc066f30 0x7fe8bc0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00a3600 tx=0x7fe8c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.097+0000 7f69a2ffd700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6990067000 0x7f69900694b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f69a406e740 tx=0x7f6998017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.097+0000 7f53e5c8a700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f53c4066f30 0x7f53c40693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0017e0 tx=0x7f53dc007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:01.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.098+0000 7fef87fff700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fef74066f30 0x7fef740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:01.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.098+0000 7fef87fff700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fef74066f30 0x7fef740693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef780099b0 tx=0x7fef78017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:01.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.101+0000 7f53d5ffb700 1 -- 172.21.15.8:0/630401813 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53d0053170 con 0x7f53e01355c0 2023-10-14T16:55:01.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.102+0000 7f698b7fe700 1 -- 172.21.15.8:0/4212553131 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f699404b5a0 con 0x7f69a406ec80 2023-10-14T16:55:01.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.105+0000 7fef6ffff700 1 -- 172.21.15.8:0/308979651 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef7c051ab0 con 0x7fef880a6920 2023-10-14T16:55:01.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.110+0000 7fe8b77fe700 1 -- 172.21.15.8:0/2198894485 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8c0052c10 con 0x7fe8d00a6500 2023-10-14T16:55:01.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.298+0000 7f69a9e14700 1 -- 172.21.15.8:0/4212553131 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f69a406e810 con 0x7f69a406ec80 2023-10-14T16:55:01.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.299+0000 7f698b7fe700 1 -- 172.21.15.8:0/4212553131 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6994050aa0 con 0x7f69a406ec80 2023-10-14T16:55:01.301 INFO:teuthology.orchestra.run.smithi008.stdout:38654705669 2023-10-14T16:55:01.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.301+0000 7f69a9e14700 1 -- 172.21.15.8:0/4212553131 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6990067000 msgr2=0x7f69900694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.301+0000 7f69a9e14700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6990067000 0x7f69900694b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f69a406e740 tx=0x7f6998017000 comp rx=0 tx=0).stop 2023-10-14T16:55:01.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.301+0000 7f69a9e14700 1 -- 172.21.15.8:0/4212553131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69a406ec80 msgr2=0x7f69a4133580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.301+0000 7f69a9e14700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69a406ec80 0x7f69a4133580 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f699400c7c0 tx=0x7f6994007eb0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.301+0000 7f69a9e14700 1 -- 172.21.15.8:0/4212553131 shutdown_connections 2023-10-14T16:55:01.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.301+0000 7f69a9e14700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6990067000 0x7f69900694b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.301+0000 7f69a9e14700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69a413ea20 0x7f69a4134000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.301+0000 7f69a9e14700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69a406ec80 0x7f69a4133580 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.301+0000 7f69a9e14700 1 --2- 172.21.15.8:0/4212553131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69a4139cf0 0x7f69a4133ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.301+0000 7f69a9e14700 1 -- 172.21.15.8:0/4212553131 >> 172.21.15.8:0/4212553131 conn(0x7f69a406b860 msgr2=0x7f69a4130a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:01.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.301+0000 7f69a9e14700 1 -- 172.21.15.8:0/4212553131 shutdown_connections 2023-10-14T16:55:01.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.301+0000 7f69a9e14700 1 -- 172.21.15.8:0/4212553131 wait complete. 2023-10-14T16:55:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.306+0000 7f53cb7fe700 1 -- 172.21.15.8:0/630401813 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f53b8005630 con 0x7f53e01355c0 2023-10-14T16:55:01.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.306+0000 7f53d5ffb700 1 -- 172.21.15.8:0/630401813 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f53d0015020 con 0x7f53e01355c0 2023-10-14T16:55:01.310 INFO:teuthology.orchestra.run.smithi008.stdout:38654705668 2023-10-14T16:55:01.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.307+0000 7fe8d610b700 1 -- 172.21.15.8:0/2198894485 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe8d013ce50 con 0x7fe8d00a6500 2023-10-14T16:55:01.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.307+0000 7fe8b77fe700 1 -- 172.21.15.8:0/2198894485 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8c002a090 con 0x7fe8d00a6500 2023-10-14T16:55:01.312 INFO:teuthology.orchestra.run.smithi008.stdout:38654705667 2023-10-14T16:55:01.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.308+0000 7f53cb7fe700 1 -- 172.21.15.8:0/630401813 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f53c4066f30 msgr2=0x7f53c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.308+0000 7f53cb7fe700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f53c4066f30 0x7f53c40693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0017e0 tx=0x7f53dc007eb0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.308+0000 7f53cb7fe700 1 -- 172.21.15.8:0/630401813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53e01355c0 msgr2=0x7f53e009d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.308+0000 7f53cb7fe700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53e01355c0 0x7f53e009d7b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53d0013000 tx=0x7f53d0017000 comp rx=0 tx=0).stop 2023-10-14T16:55:01.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.309+0000 7f53cb7fe700 1 -- 172.21.15.8:0/630401813 shutdown_connections 2023-10-14T16:55:01.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.309+0000 7f53cb7fe700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f53c4066f30 0x7f53c40693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.309+0000 7f53cb7fe700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e009dcf0 0x7f53e00a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.309+0000 7f53cb7fe700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e006dce0 0x7f53e009d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.309+0000 7f53cb7fe700 1 --2- 172.21.15.8:0/630401813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53e01355c0 0x7f53e009d7b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.309+0000 7f53cb7fe700 1 -- 172.21.15.8:0/630401813 >> 172.21.15.8:0/630401813 conn(0x7f53e0070380 msgr2=0x7f53e01322f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:01.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.309+0000 7f53cb7fe700 1 -- 172.21.15.8:0/630401813 shutdown_connections 2023-10-14T16:55:01.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.309+0000 7f53cb7fe700 1 -- 172.21.15.8:0/630401813 wait complete. 2023-10-14T16:55:01.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.310+0000 7fe8d610b700 1 -- 172.21.15.8:0/2198894485 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe8bc066f30 msgr2=0x7fe8bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.310+0000 7fe8d610b700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe8bc066f30 0x7fe8bc0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00a3600 tx=0x7fe8c4009040 comp rx=0 tx=0).stop 2023-10-14T16:55:01.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.310+0000 7fe8d610b700 1 -- 172.21.15.8:0/2198894485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00a6500 msgr2=0x7fe8d013b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.310+0000 7fe8d610b700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00a6500 0x7fe8d013b0b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0063e40 tx=0x7fe8c0017000 comp rx=0 tx=0).stop 2023-10-14T16:55:01.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.310+0000 7fe8d610b700 1 -- 172.21.15.8:0/2198894485 shutdown_connections 2023-10-14T16:55:01.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.310+0000 7fe8d610b700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe8bc066f30 0x7fe8bc0693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.310+0000 7fe8d610b700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8d013db60 0x7fe8d013bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.310+0000 7fe8d610b700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8d00a6500 0x7fe8d013b0b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.310+0000 7fe8d610b700 1 --2- 172.21.15.8:0/2198894485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8d0134260 0x7fe8d013b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.310+0000 7fe8d610b700 1 -- 172.21.15.8:0/2198894485 >> 172.21.15.8:0/2198894485 conn(0x7fe8d0069c70 msgr2=0x7fe8d006dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:01.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.310+0000 7fe8d610b700 1 -- 172.21.15.8:0/2198894485 shutdown_connections 2023-10-14T16:55:01.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.310+0000 7fe8d610b700 1 -- 172.21.15.8:0/2198894485 wait complete. 2023-10-14T16:55:01.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.314+0000 7fef8e65a700 1 -- 172.21.15.8:0/308979651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef880a5a60 con 0x7fef880a6920 2023-10-14T16:55:01.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.315+0000 7fef6ffff700 1 -- 172.21.15.8:0/308979651 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef7c0550d0 con 0x7fef880a6920 2023-10-14T16:55:01.320 INFO:teuthology.orchestra.run.smithi008.stdout:38654705669 2023-10-14T16:55:01.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.2 2023-10-14T16:55:01.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.317+0000 7fef8e65a700 1 -- 172.21.15.8:0/308979651 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fef74066f30 msgr2=0x7fef740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.317+0000 7fef8e65a700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fef74066f30 0x7fef740693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef780099b0 tx=0x7fef78017000 comp rx=0 tx=0).stop 2023-10-14T16:55:01.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.317+0000 7fef8e65a700 1 -- 172.21.15.8:0/308979651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef880a6920 msgr2=0x7fef88134e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:01.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.317+0000 7fef8e65a700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef880a6920 0x7fef88134e60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00ec80 tx=0x7fef7c0091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.317+0000 7fef8e65a700 1 -- 172.21.15.8:0/308979651 shutdown_connections 2023-10-14T16:55:01.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.317+0000 7fef8e65a700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fef74066f30 0x7fef740693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.317+0000 7fef8e65a700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef88111f90 0x7fef881353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.317+0000 7fef8e65a700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef880a6550 0x7fef88134920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.317+0000 7fef8e65a700 1 --2- 172.21.15.8:0/308979651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef880a6920 0x7fef88134e60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:01.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.317+0000 7fef8e65a700 1 -- 172.21.15.8:0/308979651 >> 172.21.15.8:0/308979651 conn(0x7fef8806ac40 msgr2=0x7fef8813a150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:01.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.317+0000 7fef8e65a700 1 -- 172.21.15.8:0/308979651 shutdown_connections 2023-10-14T16:55:01.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:01.317+0000 7fef8e65a700 1 -- 172.21.15.8:0/308979651 wait complete. 2023-10-14T16:55:01.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2023-10-14T16:55:01.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2023-10-14T16:55:01.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.3 2023-10-14T16:55:02.322 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T16:55:02.326 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T16:55:02.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T16:55:02.332 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T16:55:02.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.462+0000 7f4db0255700 1 Processor -- start 2023-10-14T16:55:02.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.462+0000 7f4db0255700 1 -- start start 2023-10-14T16:55:02.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.463+0000 7f4db0255700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4da80a6920 0x7f4da813c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.463+0000 7f4db0255700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da8133940 con 0x7f4da80a6550 2023-10-14T16:55:02.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.463+0000 7f4db0255700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da8133be0 con 0x7f4da8111f90 2023-10-14T16:55:02.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.463+0000 7f4db0255700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da8133750 con 0x7f4da80a6920 2023-10-14T16:55:02.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.463+0000 7f4dad7f0700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4da80a6920 0x7f4da813c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.463+0000 7f4dadff1700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4da80a6550 0x7f4da8133e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42420/0 (socket says 172.21.15.8:42420) 2023-10-14T16:55:02.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.463+0000 7f4dad7f0700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4da80a6920 0x7f4da813c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53370/0 (socket says 172.21.15.8:53370) 2023-10-14T16:55:02.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.463+0000 7f4dadff1700 1 -- 172.21.15.8:0/2884865095 learned_addr learned my addr 172.21.15.8:0/2884865095 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:02.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.463+0000 7f4dad7f0700 1 -- 172.21.15.8:0/2884865095 >> v1:172.21.15.155:6789/0 conn(0x7f4da8111f90 legacy=0x7f4da813e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.463+0000 7f4dad7f0700 1 -- 172.21.15.8:0/2884865095 >> v1:172.21.15.8:6789/0 conn(0x7f4da80a6550 legacy=0x7f4da8133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.463+0000 7f4dad7f0700 1 -- 172.21.15.8:0/2884865095 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8112780 con 0x7f4da80a6920 2023-10-14T16:55:02.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.463+0000 7f4dad7f0700 1 --2- 172.21.15.8:0/2884865095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da80a6920 0x7f4da813c0e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d980098e0 tx=0x7f4d980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e17d9eaa78c23d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.464+0000 7f4dacfef700 1 -- 172.21.15.8:0/2884865095 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98009e80 con 0x7f4da80a6920 2023-10-14T16:55:02.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.464+0000 7f4dacfef700 1 -- 172.21.15.8:0/2884865095 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9800b860 con 0x7f4da80a6920 2023-10-14T16:55:02.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.464+0000 7f4dacfef700 1 -- 172.21.15.8:0/2884865095 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9800bbe0 con 0x7f4da80a6920 2023-10-14T16:55:02.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.464+0000 7f4db0255700 1 -- 172.21.15.8:0/2884865095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da80a6920 msgr2=0x7f4da813c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.464+0000 7f4db0255700 1 --2- 172.21.15.8:0/2884865095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da80a6920 0x7f4da813c0e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d980098e0 tx=0x7f4d980091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.465+0000 7f4db0255700 1 -- 172.21.15.8:0/2884865095 shutdown_connections 2023-10-14T16:55:02.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.465+0000 7f4db0255700 1 --2- 172.21.15.8:0/2884865095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da80a6920 0x7f4da813c0e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.465+0000 7f4db0255700 1 -- 172.21.15.8:0/2884865095 >> 172.21.15.8:0/2884865095 conn(0x7f4da806ac40 msgr2=0x7f4da80701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:02.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.465+0000 7f4db0255700 1 -- 172.21.15.8:0/2884865095 shutdown_connections 2023-10-14T16:55:02.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.465+0000 7f4db0255700 1 -- 172.21.15.8:0/2884865095 wait complete. 2023-10-14T16:55:02.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.466+0000 7f4db0255700 1 Processor -- start 2023-10-14T16:55:02.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.466+0000 7f4db0255700 1 -- start start 2023-10-14T16:55:02.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.466+0000 7f4db0255700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da80a6550 0x7f4da8114540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.466+0000 7f4db0255700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4da80a6920 0x7f4da8114a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.466+0000 7f4db0255700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4da8111f90 0x7f4da8114fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.466+0000 7f4db0255700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8118640 con 0x7f4da80a6550 2023-10-14T16:55:02.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.466+0000 7f4db0255700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8117990 con 0x7f4da80a6920 2023-10-14T16:55:02.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.466+0000 7f4db0255700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8116270 con 0x7f4da8111f90 2023-10-14T16:55:02.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.466+0000 7f4dadff1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da80a6550 0x7f4da8114540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.466+0000 7f4dadff1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da80a6550 0x7f4da8114540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53376/0 (socket says 172.21.15.8:53376) 2023-10-14T16:55:02.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.466+0000 7f4dadff1700 1 -- 172.21.15.8:0/2382644926 learned_addr learned my addr 172.21.15.8:0/2382644926 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:02.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4dad7f0700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4da80a6920 0x7f4da8114a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4dae7f2700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4da8111f90 0x7f4da8114fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4dadff1700 1 -- 172.21.15.8:0/2382644926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4da8111f90 msgr2=0x7f4da8114fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4dadff1700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4da8111f90 0x7f4da8114fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4dadff1700 1 -- 172.21.15.8:0/2382644926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4da80a6920 msgr2=0x7f4da8114a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4dadff1700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4da80a6920 0x7f4da8114a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4dadff1700 1 -- 172.21.15.8:0/2382644926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98009420 con 0x7f4da80a6550 2023-10-14T16:55:02.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4dad7f0700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4da80a6920 0x7f4da8114a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:55:02.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4dae7f2700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4da8111f90 0x7f4da8114fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:02.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4dadff1700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da80a6550 0x7f4da8114540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4da400c560 tx=0x7f4da4001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4d9dffb700 1 -- 172.21.15.8:0/2382644926 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4005b30 con 0x7f4da80a6550 2023-10-14T16:55:02.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4d9dffb700 1 -- 172.21.15.8:0/2382644926 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da4005cb0 con 0x7f4da80a6550 2023-10-14T16:55:02.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4d9dffb700 1 -- 172.21.15.8:0/2382644926 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4007320 con 0x7f4da80a6550 2023-10-14T16:55:02.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.467+0000 7f4db0255700 1 -- 172.21.15.8:0/2382644926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da8119500 con 0x7f4da80a6550 2023-10-14T16:55:02.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.468+0000 7f4db0255700 1 -- 172.21.15.8:0/2382644926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da8131390 con 0x7f4da80a6550 2023-10-14T16:55:02.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.469+0000 7f4db0255700 1 -- 172.21.15.8:0/2382644926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da80708d0 con 0x7f4da80a6550 2023-10-14T16:55:02.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.469+0000 7f4d9dffb700 1 -- 172.21.15.8:0/2382644926 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4da401b3b0 con 0x7f4da80a6550 2023-10-14T16:55:02.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.471+0000 7f4d9dffb700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4d8c067000 0x7f4d8c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.471+0000 7f4d9dffb700 1 -- 172.21.15.8:0/2382644926 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f4da40834a0 con 0x7f4da80a6550 2023-10-14T16:55:02.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.471+0000 7f4dad7f0700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4d8c067000 0x7f4d8c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.471+0000 7f4dad7f0700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4d8c067000 0x7f4d8c0694b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4da8115d50 tx=0x7f4d98017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.479+0000 7f4d9dffb700 1 -- 172.21.15.8:0/2382644926 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4da4050cf0 con 0x7f4da80a6550 2023-10-14T16:55:02.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.502+0000 7f09df2dc700 1 Processor -- start 2023-10-14T16:55:02.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.502+0000 7f09df2dc700 1 -- start start 2023-10-14T16:55:02.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.503+0000 7f09df2dc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09d80a6940 0x7f09d80a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.503+0000 7f09df2dc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f09d813c1a0 0x7f09d813e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.503+0000 7f09df2dc700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d80a2df0 con 0x7f09d80a25c0 2023-10-14T16:55:02.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.503+0000 7f09df2dc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d81338f0 con 0x7f09d813c1a0 2023-10-14T16:55:02.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.503+0000 7f09df2dc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d8133ae0 con 0x7f09d80a6940 2023-10-14T16:55:02.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.503+0000 7f09dc877700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f09d80a25c0 0x7f09d8133f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42432/0 (socket says 172.21.15.8:42432) 2023-10-14T16:55:02.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.503+0000 7f09dc877700 1 -- 172.21.15.8:0/286391720 learned_addr learned my addr 172.21.15.8:0/286391720 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:02.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.503+0000 7f09dd078700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09d80a6940 0x7f09d80a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.503+0000 7f09dd879700 1 --2- 172.21.15.8:0/286391720 >> v2:172.21.15.155:3300/0 conn(0x7f09d813c1a0 0x7f09d813e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.503+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108346252 0 0) 0x7f09d80a2df0 con 0x7f09d80a25c0 2023-10-14T16:55:02.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.503+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09c4003570 con 0x7f09d80a25c0 2023-10-14T16:55:02.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1028009698 0 0) 0x7f09c4003570 con 0x7f09d80a25c0 2023-10-14T16:55:02.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09d80a6940 msgr2=0x7f09d80a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:02.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09d80a6940 0x7f09d80a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 >> v2:172.21.15.155:3300/0 conn(0x7f09d813c1a0 msgr2=0x7f09d813e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:02.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 --2- 172.21.15.8:0/286391720 >> v2:172.21.15.155:3300/0 conn(0x7f09d813c1a0 0x7f09d813e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d80a1b90 con 0x7f09d80a25c0 2023-10-14T16:55:02.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f09c8001470 con 0x7f09d80a25c0 2023-10-14T16:55:02.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 >> v1:172.21.15.8:6789/0 conn(0x7f09d80a25c0 legacy=0x7f09d8133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c4003a60 0x7f09c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c4004810 0x7f09c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09c40051c0 0x7f09c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d8133ae0 con 0x7f09c4003a60 2023-10-14T16:55:02.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40055f0 con 0x7f09c4004810 2023-10-14T16:55:02.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c400bfa0 con 0x7f09c40051c0 2023-10-14T16:55:02.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09dd879700 1 --2- 172.21.15.8:0/286391720 >> v2:172.21.15.155:3300/0 conn(0x7f09d813c1a0 0x7f09d813e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:02.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09dc877700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c4004810 0x7f09c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09dd078700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c4003a60 0x7f09c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09dd879700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09c40051c0 0x7f09c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09dd078700 1 -- 172.21.15.8:0/286391720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09c40051c0 msgr2=0x7f09c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:02.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09dd078700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09c40051c0 0x7f09c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09dd078700 1 -- 172.21.15.8:0/286391720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c4004810 msgr2=0x7f09c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:02.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09dd078700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c4004810 0x7f09c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09dd078700 1 -- 172.21.15.8:0/286391720 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4003570 con 0x7f09c4003a60 2023-10-14T16:55:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.504+0000 7f09dc877700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c4004810 0x7f09c4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.505+0000 7f09dd078700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c4003a60 0x7f09c4003e70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009c00 tx=0x7f09d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd1b17d40725222 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.505+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400e710 con 0x7f09c4003a60 2023-10-14T16:55:02.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.505+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400e870 con 0x7f09c4003a60 2023-10-14T16:55:02.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.505+0000 7f09cffff700 1 -- 172.21.15.8:0/286391720 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400ec30 con 0x7f09c4003a60 2023-10-14T16:55:02.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.505+0000 7f09df2dc700 1 -- 172.21.15.8:0/286391720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c4003a60 msgr2=0x7f09c4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.506+0000 7f09df2dc700 1 --2- 172.21.15.8:0/286391720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09c4003a60 0x7f09c4003e70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009c00 tx=0x7f09d40091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.506+0000 7f09dd879700 1 -- 172.21.15.8:0/286391720 reap_dead start 2023-10-14T16:55:02.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.506+0000 7f09df2dc700 1 -- 172.21.15.8:0/286391720 shutdown_connections 2023-10-14T16:55:02.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.506+0000 7f09df2dc700 1 -- 172.21.15.8:0/286391720 >> 172.21.15.8:0/286391720 conn(0x7f09d806acd0 msgr2=0x7f09d80701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:02.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.506+0000 7f09df2dc700 1 -- 172.21.15.8:0/286391720 shutdown_connections 2023-10-14T16:55:02.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.506+0000 7f09df2dc700 1 -- 172.21.15.8:0/286391720 wait complete. 2023-10-14T16:55:02.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.506+0000 7f938e874700 1 Processor -- start 2023-10-14T16:55:02.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.506+0000 7f938e874700 1 -- start start 2023-10-14T16:55:02.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f938e874700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93880a3740 0x7f9388133fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f938e874700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f938806d1d0 0x7f93881344f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f938e874700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93880a2e10 con 0x7f9388130460 2023-10-14T16:55:02.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f938e874700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938806d6f0 con 0x7f938806d1d0 2023-10-14T16:55:02.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f938e874700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938806c7a0 con 0x7f93880a3740 2023-10-14T16:55:02.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f09df2dc700 1 Processor -- start 2023-10-14T16:55:02.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f938ce11700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9388130460 0x7f93881308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42438/0 (socket says 172.21.15.8:42438) 2023-10-14T16:55:02.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f938ce11700 1 -- 172.21.15.8:0/4106497497 learned_addr learned my addr 172.21.15.8:0/4106497497 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:02.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f09df2dc700 1 -- start start 2023-10-14T16:55:02.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f9387fff700 1 --2- 172.21.15.8:0/4106497497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93880a3740 0x7f9388133fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f93877fe700 1 --2- 172.21.15.8:0/4106497497 >> v2:172.21.15.155:3300/0 conn(0x7f938806d1d0 0x7f93881344f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f9386ffd700 1 -- 172.21.15.8:0/4106497497 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15088829 0 0) 0x7f93880a2e10 con 0x7f9388130460 2023-10-14T16:55:02.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f9386ffd700 1 -- 172.21.15.8:0/4106497497 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9370003570 con 0x7f9388130460 2023-10-14T16:55:02.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f9387fff700 1 -- 172.21.15.8:0/4106497497 >> v2:172.21.15.155:3300/0 conn(0x7f938806d1d0 msgr2=0x7f93881344f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:02.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f9387fff700 1 --2- 172.21.15.8:0/4106497497 >> v2:172.21.15.155:3300/0 conn(0x7f938806d1d0 0x7f93881344f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f9387fff700 1 -- 172.21.15.8:0/4106497497 >> v1:172.21.15.8:6789/0 conn(0x7f9388130460 legacy=0x7f93881308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.507+0000 7f9387fff700 1 -- 172.21.15.8:0/4106497497 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938806cd40 con 0x7f93880a3740 2023-10-14T16:55:02.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f9387fff700 1 --2- 172.21.15.8:0/4106497497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93880a3740 0x7f9388133fb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f93780098e0 tx=0x7f93780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e5434c01b568461 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f9386ffd700 1 -- 172.21.15.8:0/4106497497 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378011630 con 0x7f93880a3740 2023-10-14T16:55:02.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09df2dc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c4003a60 0x7f09d813a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09df2dc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09d8097740 0x7f09d813a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f9386ffd700 1 -- 172.21.15.8:0/4106497497 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9378011790 con 0x7f93880a3740 2023-10-14T16:55:02.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09df2dc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09d80988b0 0x7f09d813abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f9386ffd700 1 -- 172.21.15.8:0/4106497497 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378011b30 con 0x7f93880a3740 2023-10-14T16:55:02.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09df2dc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80a0a60 con 0x7f09d80988b0 2023-10-14T16:55:02.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09df2dc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80981f0 con 0x7f09c4003a60 2023-10-14T16:55:02.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09df2dc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d8095cd0 con 0x7f09d8097740 2023-10-14T16:55:02.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09dd078700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c4003a60 0x7f09d813a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09dd078700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c4003a60 0x7f09d813a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.8:34828/0 (socket says 172.21.15.8:34828) 2023-10-14T16:55:02.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09dd078700 1 -- 172.21.15.8:0/2237077863 learned_addr learned my addr 172.21.15.8:0/2237077863 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:02.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09dd879700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09d80988b0 0x7f09d813abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09dc877700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09d8097740 0x7f09d813a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09dd078700 1 -- 172.21.15.8:0/2237077863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09d8097740 msgr2=0x7f09d813a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09dd078700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09d8097740 0x7f09d813a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09dd078700 1 -- 172.21.15.8:0/2237077863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09d80988b0 msgr2=0x7f09d813abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.508+0000 7f09dd078700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09d80988b0 0x7f09d813abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f09dd078700 1 -- 172.21.15.8:0/2237077863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d80a0660 con 0x7f09c4003a60 2023-10-14T16:55:02.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f09dd879700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09d80988b0 0x7f09d813abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:02.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f09dd078700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c4003a60 0x7f09d813a160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f09d400e4b0 tx=0x7f09d401a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f938e874700 1 -- 172.21.15.8:0/4106497497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93880a3740 msgr2=0x7f9388133fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f938e874700 1 --2- 172.21.15.8:0/4106497497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93880a3740 0x7f9388133fb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f93780098e0 tx=0x7f93780091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f938e874700 1 -- 172.21.15.8:0/4106497497 shutdown_connections 2023-10-14T16:55:02.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f938e874700 1 --2- 172.21.15.8:0/4106497497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93880a3740 0x7f9388133fb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f938e874700 1 --2- 172.21.15.8:0/4106497497 >> v2:172.21.15.155:3300/0 conn(0x7f938806d1d0 0x7f93881344f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f938e874700 1 -- 172.21.15.8:0/4106497497 >> 172.21.15.8:0/4106497497 conn(0x7f93880701c0 msgr2=0x7f9388070590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:02.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f938e874700 1 -- 172.21.15.8:0/4106497497 shutdown_connections 2023-10-14T16:55:02.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f938e874700 1 -- 172.21.15.8:0/4106497497 wait complete. 2023-10-14T16:55:02.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f09cd7fa700 1 -- 172.21.15.8:0/2237077863 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4022070 con 0x7f09c4003a60 2023-10-14T16:55:02.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f09cd7fa700 1 -- 172.21.15.8:0/2237077863 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400e9e0 con 0x7f09c4003a60 2023-10-14T16:55:02.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f09df2dc700 1 -- 172.21.15.8:0/2237077863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d8097c50 con 0x7f09c4003a60 2023-10-14T16:55:02.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f09cd7fa700 1 -- 172.21.15.8:0/2237077863 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4027470 con 0x7f09c4003a60 2023-10-14T16:55:02.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.509+0000 7f09df2dc700 1 -- 172.21.15.8:0/2237077863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d8098e40 con 0x7f09c4003a60 2023-10-14T16:55:02.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.510+0000 7f938e874700 1 Processor -- start 2023-10-14T16:55:02.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.510+0000 7f09df2dc700 1 -- 172.21.15.8:0/2237077863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d80708d0 con 0x7f09c4003a60 2023-10-14T16:55:02.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f938e874700 1 -- start start 2023-10-14T16:55:02.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f09cd7fa700 1 -- 172.21.15.8:0/2237077863 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09d401c450 con 0x7f09c4003a60 2023-10-14T16:55:02.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f09cd7fa700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f09bc066f30 0x7f09bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f09dc877700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f09bc066f30 0x7f09bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f09cd7fa700 1 -- 172.21.15.8:0/2237077863 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f09d4085a70 con 0x7f09c4003a60 2023-10-14T16:55:02.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f938e874700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f938806d1d0 0x7f938809b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f938e874700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93880a3740 0x7f938809ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f938e874700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9388130460 0x7f93881436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f938e874700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938809d410 con 0x7f938806d1d0 2023-10-14T16:55:02.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f938e874700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9388099d20 con 0x7f93880a3740 2023-10-14T16:55:02.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f938e874700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938809d620 con 0x7f9388130460 2023-10-14T16:55:02.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f9387fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f938806d1d0 0x7f938809b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f9387fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f938806d1d0 0x7f938809b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53414/0 (socket says 172.21.15.8:53414) 2023-10-14T16:55:02.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.511+0000 7f9387fff700 1 -- 172.21.15.8:0/2248343498 learned_addr learned my addr 172.21.15.8:0/2248343498 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:02.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f93877fe700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93880a3740 0x7f938809ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f938ce11700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9388130460 0x7f93881436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f09dc877700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f09bc066f30 0x7f09bc0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f09d80a6f30 tx=0x7f09c8001e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f9387fff700 1 -- 172.21.15.8:0/2248343498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9388130460 msgr2=0x7f93881436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f9387fff700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9388130460 0x7f93881436e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f9387fff700 1 -- 172.21.15.8:0/2248343498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93880a3740 msgr2=0x7f938809ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f9387fff700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93880a3740 0x7f938809ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f9387fff700 1 -- 172.21.15.8:0/2248343498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9378009420 con 0x7f938806d1d0 2023-10-14T16:55:02.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f938ce11700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9388130460 0x7f93881436e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:02.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f93877fe700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93880a3740 0x7f938809ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:02.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f9387fff700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f938806d1d0 0x7f938809b480 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9378009ed0 tx=0x7f9378017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f936ffff700 1 -- 172.21.15.8:0/2248343498 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378020070 con 0x7f938806d1d0 2023-10-14T16:55:02.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f936ffff700 1 -- 172.21.15.8:0/2248343498 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9378011b10 con 0x7f938806d1d0 2023-10-14T16:55:02.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f938e874700 1 -- 172.21.15.8:0/2248343498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9388143460 con 0x7f938806d1d0 2023-10-14T16:55:02.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f936ffff700 1 -- 172.21.15.8:0/2248343498 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378024640 con 0x7f938806d1d0 2023-10-14T16:55:02.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.512+0000 7f938e874700 1 -- 172.21.15.8:0/2248343498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938809c7e0 con 0x7f938806d1d0 2023-10-14T16:55:02.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.514+0000 7f938e874700 1 -- 172.21.15.8:0/2248343498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938809b020 con 0x7f938806d1d0 2023-10-14T16:55:02.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.514+0000 7f936ffff700 1 -- 172.21.15.8:0/2248343498 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f937802d3b0 con 0x7f938806d1d0 2023-10-14T16:55:02.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.514+0000 7f936ffff700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9374066f30 0x7f93740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.514+0000 7f93877fe700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9374066f30 0x7f93740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.514+0000 7f936ffff700 1 -- 172.21.15.8:0/2248343498 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f93780870a0 con 0x7f938806d1d0 2023-10-14T16:55:02.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.515+0000 7f93877fe700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9374066f30 0x7f93740693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f938809bb90 tx=0x7f937c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.515+0000 7f80b2931700 1 Processor -- start 2023-10-14T16:55:02.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.515+0000 7f80b2931700 1 -- start start 2023-10-14T16:55:02.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.516+0000 7f80b2931700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f80ac0a3460 0x7f80ac0a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.516+0000 7f80b2931700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80ac09f810 0x7f80ac13aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.516+0000 7f80b2931700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ac09e6b0 con 0x7f80ac09cdf0 2023-10-14T16:55:02.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.516+0000 7f80b2931700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ac0a0700 con 0x7f80ac0a3460 2023-10-14T16:55:02.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.516+0000 7f80b2931700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac09f0c0 con 0x7f80ac09f810 2023-10-14T16:55:02.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.516+0000 7f80abfff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f80ac0a3460 0x7f80ac0a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.516+0000 7f80abfff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f80ac0a3460 0x7f80ac0a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53418/0 (socket says 172.21.15.8:53418) 2023-10-14T16:55:02.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.516+0000 7f80abfff700 1 -- 172.21.15.8:0/4223455439 learned_addr learned my addr 172.21.15.8:0/4223455439 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:02.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.516+0000 7f09cd7fa700 1 -- 172.21.15.8:0/2237077863 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09d4053240 con 0x7f09c4003a60 2023-10-14T16:55:02.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.516+0000 7f80b0ece700 1 --2- 172.21.15.8:0/4223455439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80ac09f810 0x7f80ac13aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.517+0000 7f80abfff700 1 -- 172.21.15.8:0/4223455439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80ac09f810 msgr2=0x7f80ac13aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:02.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.517+0000 7f80abfff700 1 --2- 172.21.15.8:0/4223455439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80ac09f810 0x7f80ac13aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.517+0000 7f80abfff700 1 -- 172.21.15.8:0/4223455439 >> v1:172.21.15.155:6789/0 conn(0x7f80ac09cdf0 legacy=0x7f80ac0a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.517+0000 7f80abfff700 1 -- 172.21.15.8:0/4223455439 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac09f2d0 con 0x7f80ac0a3460 2023-10-14T16:55:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.517+0000 7f80abfff700 1 --2- 172.21.15.8:0/4223455439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80ac0a3460 0x7f80ac0a0be0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f809c0099b0 tx=0x7f809c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7928b9a65cc7a227 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.519+0000 7f80aaffd700 1 -- 172.21.15.8:0/4223455439 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00b860 con 0x7f80ac0a3460 2023-10-14T16:55:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.519+0000 7f80aaffd700 1 -- 172.21.15.8:0/4223455439 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c00b9c0 con 0x7f80ac0a3460 2023-10-14T16:55:02.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.519+0000 7f80aaffd700 1 -- 172.21.15.8:0/4223455439 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00bd60 con 0x7f80ac0a3460 2023-10-14T16:55:02.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.519+0000 7f936ffff700 1 -- 172.21.15.8:0/2248343498 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9378054930 con 0x7f938806d1d0 2023-10-14T16:55:02.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.520+0000 7f80b2931700 1 -- 172.21.15.8:0/4223455439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80ac0a3460 msgr2=0x7f80ac0a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.520+0000 7f80b2931700 1 --2- 172.21.15.8:0/4223455439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80ac0a3460 0x7f80ac0a0be0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f809c0099b0 tx=0x7f809c009250 comp rx=0 tx=0).stop 2023-10-14T16:55:02.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.520+0000 7f80b2931700 1 -- 172.21.15.8:0/4223455439 shutdown_connections 2023-10-14T16:55:02.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.520+0000 7f80b2931700 1 --2- 172.21.15.8:0/4223455439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80ac0a3460 0x7f80ac0a0be0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.520+0000 7f80b2931700 1 --2- 172.21.15.8:0/4223455439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80ac09f810 0x7f80ac13aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.520+0000 7f80b2931700 1 -- 172.21.15.8:0/4223455439 >> 172.21.15.8:0/4223455439 conn(0x7f80ac067820 msgr2=0x7f80ac067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:02.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.520+0000 7f80b2931700 1 -- 172.21.15.8:0/4223455439 shutdown_connections 2023-10-14T16:55:02.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.520+0000 7f80b2931700 1 -- 172.21.15.8:0/4223455439 wait complete. 2023-10-14T16:55:02.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.521+0000 7f80b2931700 1 Processor -- start 2023-10-14T16:55:02.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.521+0000 7f80b2931700 1 -- start start 2023-10-14T16:55:02.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.521+0000 7f80b2931700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80ac09cdf0 0x7f80ac143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.521+0000 7f80b2931700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80ac09f810 0x7f80ac1439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.521+0000 7f80b2931700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80ac1363b0 0x7f80ac143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.521+0000 7f80b2931700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac09d300 con 0x7f80ac09cdf0 2023-10-14T16:55:02.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.521+0000 7f80b2931700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac132450 con 0x7f80ac1363b0 2023-10-14T16:55:02.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.521+0000 7f80b2931700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac1326f0 con 0x7f80ac09f810 2023-10-14T16:55:02.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.521+0000 7f80abfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80ac09cdf0 0x7f80ac143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.521+0000 7f80abfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80ac09cdf0 0x7f80ac143490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53424/0 (socket says 172.21.15.8:53424) 2023-10-14T16:55:02.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.521+0000 7f80abfff700 1 -- 172.21.15.8:0/3591183976 learned_addr learned my addr 172.21.15.8:0/3591183976 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:02.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f80b0ece700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80ac1363b0 0x7f80ac143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f80ab7fe700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80ac09f810 0x7f80ac1439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f80abfff700 1 -- 172.21.15.8:0/3591183976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80ac09f810 msgr2=0x7f80ac1439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f80abfff700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80ac09f810 0x7f80ac1439d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f80abfff700 1 -- 172.21.15.8:0/3591183976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80ac1363b0 msgr2=0x7f80ac143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f80abfff700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80ac1363b0 0x7f80ac143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f80abfff700 1 -- 172.21.15.8:0/3591183976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0094f0 con 0x7f80ac09cdf0 2023-10-14T16:55:02.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f80abfff700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80ac09cdf0 0x7f80ac143490 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f80ac06a4c0 tx=0x7f809c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f8093fff700 1 -- 172.21.15.8:0/3591183976 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c011e40 con 0x7f80ac09cdf0 2023-10-14T16:55:02.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f8093fff700 1 -- 172.21.15.8:0/3591183976 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c024440 con 0x7f80ac09cdf0 2023-10-14T16:55:02.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f80b2931700 1 -- 172.21.15.8:0/3591183976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ac1375d0 con 0x7f80ac09cdf0 2023-10-14T16:55:02.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f8093fff700 1 -- 172.21.15.8:0/3591183976 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c0247e0 con 0x7f80ac09cdf0 2023-10-14T16:55:02.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.522+0000 7f80b2931700 1 -- 172.21.15.8:0/3591183976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ac137940 con 0x7f80ac09cdf0 2023-10-14T16:55:02.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.523+0000 7f80b2931700 1 -- 172.21.15.8:0/3591183976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ac068330 con 0x7f80ac09cdf0 2023-10-14T16:55:02.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.524+0000 7f8093fff700 1 -- 172.21.15.8:0/3591183976 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f809c01a420 con 0x7f80ac09cdf0 2023-10-14T16:55:02.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.525+0000 7f8093fff700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f8098066f30 0x7f80980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.525+0000 7f8093fff700 1 -- 172.21.15.8:0/3591183976 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f809c085d70 con 0x7f80ac09cdf0 2023-10-14T16:55:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.525+0000 7f80ab7fe700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f8098066f30 0x7f80980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.526+0000 7f80ab7fe700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f8098066f30 0x7f80980693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80ac133cb0 tx=0x7f80a0007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.529+0000 7f8093fff700 1 -- 172.21.15.8:0/3591183976 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f809c0535c0 con 0x7f80ac09cdf0 2023-10-14T16:55:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.696+0000 7f4db0255700 1 -- 172.21.15.8:0/2382644926 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4da80639b0 con 0x7f4da80a6550 2023-10-14T16:55:02.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.696+0000 7f4d9dffb700 1 -- 172.21.15.8:0/2382644926 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4da4017090 con 0x7f4da80a6550 2023-10-14T16:55:02.697 INFO:teuthology.orchestra.run.smithi008.stdout:38654705670 2023-10-14T16:55:02.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.699+0000 7f4db0255700 1 -- 172.21.15.8:0/2382644926 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4d8c067000 msgr2=0x7f4d8c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.699+0000 7f4db0255700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4d8c067000 0x7f4d8c0694b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4da8115d50 tx=0x7f4d98017000 comp rx=0 tx=0).stop 2023-10-14T16:55:02.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.699+0000 7f4db0255700 1 -- 172.21.15.8:0/2382644926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da80a6550 msgr2=0x7f4da8114540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.699+0000 7f4db0255700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da80a6550 0x7f4da8114540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4da400c560 tx=0x7f4da4001020 comp rx=0 tx=0).stop 2023-10-14T16:55:02.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.700+0000 7f4db0255700 1 -- 172.21.15.8:0/2382644926 shutdown_connections 2023-10-14T16:55:02.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.700+0000 7f4db0255700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4d8c067000 0x7f4d8c0694b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.700+0000 7f4db0255700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4da8111f90 0x7f4da8114fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.700+0000 7f4db0255700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da80a6550 0x7f4da8114540 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.700+0000 7f4db0255700 1 --2- 172.21.15.8:0/2382644926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4da80a6920 0x7f4da8114a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.700+0000 7f4db0255700 1 -- 172.21.15.8:0/2382644926 >> 172.21.15.8:0/2382644926 conn(0x7f4da806ac40 msgr2=0x7f4da80a7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:02.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.700+0000 7f4db0255700 1 -- 172.21.15.8:0/2382644926 shutdown_connections 2023-10-14T16:55:02.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.700+0000 7f4db0255700 1 -- 172.21.15.8:0/2382644926 wait complete. 2023-10-14T16:55:02.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2023-10-14T16:55:02.712 DEBUG:teuthology.parallel:result is None 2023-10-14T16:55:02.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.716+0000 7f09df2dc700 1 -- 172.21.15.8:0/2237077863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f09d80a92c0 con 0x7f09c4003a60 2023-10-14T16:55:02.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.716+0000 7f09cd7fa700 1 -- 172.21.15.8:0/2237077863 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09d4017090 con 0x7f09c4003a60 2023-10-14T16:55:02.716 INFO:teuthology.orchestra.run.smithi008.stdout:38654705669 2023-10-14T16:55:02.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.718+0000 7f09df2dc700 1 -- 172.21.15.8:0/2237077863 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f09bc066f30 msgr2=0x7f09bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.718+0000 7f09df2dc700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f09bc066f30 0x7f09bc0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f09d80a6f30 tx=0x7f09c8001e90 comp rx=0 tx=0).stop 2023-10-14T16:55:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.718+0000 7f09df2dc700 1 -- 172.21.15.8:0/2237077863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c4003a60 msgr2=0x7f09d813a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.718+0000 7f09df2dc700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c4003a60 0x7f09d813a160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f09d400e4b0 tx=0x7f09d401a000 comp rx=0 tx=0).stop 2023-10-14T16:55:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.719+0000 7f09df2dc700 1 -- 172.21.15.8:0/2237077863 shutdown_connections 2023-10-14T16:55:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.719+0000 7f09df2dc700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f09bc066f30 0x7f09bc0693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.719+0000 7f09df2dc700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09d80988b0 0x7f09d813abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.719+0000 7f09df2dc700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09c4003a60 0x7f09d813a160 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.719+0000 7f09df2dc700 1 --2- 172.21.15.8:0/2237077863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09d8097740 0x7f09d813a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.719+0000 7f09df2dc700 1 -- 172.21.15.8:0/2237077863 >> 172.21.15.8:0/2237077863 conn(0x7f09d806acd0 msgr2=0x7f09d8134a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:02.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.719+0000 7f09df2dc700 1 -- 172.21.15.8:0/2237077863 shutdown_connections 2023-10-14T16:55:02.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.719+0000 7f09df2dc700 1 -- 172.21.15.8:0/2237077863 wait complete. 2023-10-14T16:55:02.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.720+0000 7f938e874700 1 -- 172.21.15.8:0/2248343498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f938809a380 con 0x7f938806d1d0 2023-10-14T16:55:02.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.720+0000 7f936ffff700 1 -- 172.21.15.8:0/2248343498 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f938809a380 con 0x7f938806d1d0 2023-10-14T16:55:02.722 INFO:teuthology.orchestra.run.smithi008.stdout:38654705668 2023-10-14T16:55:02.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.722+0000 7f938e874700 1 -- 172.21.15.8:0/2248343498 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9374066f30 msgr2=0x7f93740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.722+0000 7f938e874700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9374066f30 0x7f93740693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f938809bb90 tx=0x7f937c0091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.722+0000 7f938e874700 1 -- 172.21.15.8:0/2248343498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f938806d1d0 msgr2=0x7f938809b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.722+0000 7f938e874700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f938806d1d0 0x7f938809b480 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9378009ed0 tx=0x7f9378017000 comp rx=0 tx=0).stop 2023-10-14T16:55:02.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.722+0000 7f938e874700 1 -- 172.21.15.8:0/2248343498 shutdown_connections 2023-10-14T16:55:02.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.722+0000 7f938e874700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9374066f30 0x7f93740693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.722+0000 7f938e874700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9388130460 0x7f93881436e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.722+0000 7f938e874700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f938806d1d0 0x7f938809b480 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.722+0000 7f938e874700 1 --2- 172.21.15.8:0/2248343498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93880a3740 0x7f938809ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.722+0000 7f938e874700 1 -- 172.21.15.8:0/2248343498 >> 172.21.15.8:0/2248343498 conn(0x7f93880701c0 msgr2=0x7f93880a62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:02.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.722+0000 7f938e874700 1 -- 172.21.15.8:0/2248343498 shutdown_connections 2023-10-14T16:55:02.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.722+0000 7f938e874700 1 -- 172.21.15.8:0/2248343498 wait complete. 2023-10-14T16:55:02.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2023-10-14T16:55:02.732 DEBUG:teuthology.parallel:result is None 2023-10-14T16:55:02.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2023-10-14T16:55:02.735 DEBUG:teuthology.parallel:result is None 2023-10-14T16:55:02.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.738+0000 7f80b2931700 1 -- 172.21.15.8:0/3591183976 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f80ac137760 con 0x7f80ac09cdf0 2023-10-14T16:55:02.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.738+0000 7f8093fff700 1 -- 172.21.15.8:0/3591183976 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f809c015090 con 0x7f80ac09cdf0 2023-10-14T16:55:02.738 INFO:teuthology.orchestra.run.smithi008.stdout:38654705670 2023-10-14T16:55:02.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.740+0000 7f80b2931700 1 -- 172.21.15.8:0/3591183976 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f8098066f30 msgr2=0x7f80980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.740+0000 7f80b2931700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f8098066f30 0x7f80980693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80ac133cb0 tx=0x7f80a0007ec0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.740+0000 7f80b2931700 1 -- 172.21.15.8:0/3591183976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80ac09cdf0 msgr2=0x7f80ac143490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.740+0000 7f80b2931700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80ac09cdf0 0x7f80ac143490 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f80ac06a4c0 tx=0x7f809c017000 comp rx=0 tx=0).stop 2023-10-14T16:55:02.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.740+0000 7f80b2931700 1 -- 172.21.15.8:0/3591183976 shutdown_connections 2023-10-14T16:55:02.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.740+0000 7f80b2931700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f8098066f30 0x7f80980693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.740+0000 7f80b2931700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80ac1363b0 0x7f80ac143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.740+0000 7f80b2931700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80ac09cdf0 0x7f80ac143490 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.740+0000 7f80b2931700 1 --2- 172.21.15.8:0/3591183976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80ac09f810 0x7f80ac1439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.740+0000 7f80b2931700 1 -- 172.21.15.8:0/3591183976 >> 172.21.15.8:0/3591183976 conn(0x7f80ac067820 msgr2=0x7f80ac134b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:02.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.741+0000 7f80b2931700 1 -- 172.21.15.8:0/3591183976 shutdown_connections 2023-10-14T16:55:02.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.741+0000 7f80b2931700 1 -- 172.21.15.8:0/3591183976 wait complete. 2023-10-14T16:55:02.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2023-10-14T16:55:02.752 DEBUG:teuthology.parallel:result is None 2023-10-14T16:55:02.753 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T16:55:02.753 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T16:55:02.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.910+0000 7f21b759e700 1 Processor -- start 2023-10-14T16:55:02.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.910+0000 7f21b759e700 1 -- start start 2023-10-14T16:55:02.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.910+0000 7f21b759e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f21b80a5350 0x7f21b813bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.910+0000 7f21b759e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f21b813c1e0 0x7f21b813e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.910+0000 7f21b759e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b80a0d30 con 0x7f21b80a6a70 2023-10-14T16:55:02.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.910+0000 7f21b759e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b80a4850 con 0x7f21b80a5350 2023-10-14T16:55:02.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.910+0000 7f21b759e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b80a2a40 con 0x7f21b813c1e0 2023-10-14T16:55:02.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b5d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f21b80a5350 0x7f21b813bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b659c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f21b80a6a70 0x7f21b80a4c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42450/0 (socket says 172.21.15.8:42450) 2023-10-14T16:55:02.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b659c700 1 -- 172.21.15.8:0/3471932705 learned_addr learned my addr 172.21.15.8:0/3471932705 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b6d9d700 1 --2- 172.21.15.8:0/3471932705 >> v2:172.21.15.155:3300/0 conn(0x7f21b813c1e0 0x7f21b813e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b5d9b700 1 -- 172.21.15.8:0/3471932705 >> v2:172.21.15.155:3300/0 conn(0x7f21b813c1e0 msgr2=0x7f21b813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b5d9b700 1 --2- 172.21.15.8:0/3471932705 >> v2:172.21.15.155:3300/0 conn(0x7f21b813c1e0 0x7f21b813e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b5d9b700 1 -- 172.21.15.8:0/3471932705 >> v1:172.21.15.8:6789/0 conn(0x7f21b80a6a70 legacy=0x7f21b80a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b5d9b700 1 -- 172.21.15.8:0/3471932705 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b80a18c0 con 0x7f21b80a5350 2023-10-14T16:55:02.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b559a700 1 -- 172.21.15.8:0/3471932705 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019920934 0 0) 0x7f21b80a0d30 con 0x7f21b80a6a70 2023-10-14T16:55:02.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b5d9b700 1 --2- 172.21.15.8:0/3471932705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a5350 0x7f21b813bca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f21b80a7c30 tx=0x7f21ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80541cbe23332eb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b559a700 1 -- 172.21.15.8:0/3471932705 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac011630 con 0x7f21b80a5350 2023-10-14T16:55:02.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b559a700 1 -- 172.21.15.8:0/3471932705 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac011790 con 0x7f21b80a5350 2023-10-14T16:55:02.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.911+0000 7f21b559a700 1 -- 172.21.15.8:0/3471932705 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac011b30 con 0x7f21b80a5350 2023-10-14T16:55:02.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.912+0000 7f21b759e700 1 -- 172.21.15.8:0/3471932705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a5350 msgr2=0x7f21b813bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.912+0000 7f21b759e700 1 --2- 172.21.15.8:0/3471932705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a5350 0x7f21b813bca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f21b80a7c30 tx=0x7f21ac0091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.912+0000 7f21b759e700 1 -- 172.21.15.8:0/3471932705 shutdown_connections 2023-10-14T16:55:02.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.912+0000 7f21b759e700 1 --2- 172.21.15.8:0/3471932705 >> v2:172.21.15.155:3300/0 conn(0x7f21b813c1e0 0x7f21b813e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.912+0000 7f21b759e700 1 --2- 172.21.15.8:0/3471932705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a5350 0x7f21b813bca0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.912+0000 7f21b759e700 1 -- 172.21.15.8:0/3471932705 >> 172.21.15.8:0/3471932705 conn(0x7f21b806a960 msgr2=0x7f21b80701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:02.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.912+0000 7f21b759e700 1 -- 172.21.15.8:0/3471932705 shutdown_connections 2023-10-14T16:55:02.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.912+0000 7f21b759e700 1 -- 172.21.15.8:0/3471932705 wait complete. 2023-10-14T16:55:02.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.913+0000 7f21b759e700 1 Processor -- start 2023-10-14T16:55:02.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.913+0000 7f21b759e700 1 -- start start 2023-10-14T16:55:02.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.913+0000 7f21b759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a5350 0x7f21b8133650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.913+0000 7f21b759e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b813c1e0 0x7f21b8133b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.913+0000 7f21b759e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b809a710 0x7f21b81340d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.913+0000 7f21b759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b809bdc0 con 0x7f21b80a5350 2023-10-14T16:55:02.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.913+0000 7f21b759e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b809ac40 con 0x7f21b809a710 2023-10-14T16:55:02.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.913+0000 7f21b759e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b809b1e0 con 0x7f21b813c1e0 2023-10-14T16:55:02.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.913+0000 7f21b659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a5350 0x7f21b8133650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.913+0000 7f21b659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a5350 0x7f21b8133650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53442/0 (socket says 172.21.15.8:53442) 2023-10-14T16:55:02.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.913+0000 7f21b659c700 1 -- 172.21.15.8:0/2386526701 learned_addr learned my addr 172.21.15.8:0/2386526701 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:02.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21b5d9b700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b813c1e0 0x7f21b8133b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21b6d9d700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b809a710 0x7f21b81340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21b659c700 1 -- 172.21.15.8:0/2386526701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b813c1e0 msgr2=0x7f21b8133b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21b659c700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b813c1e0 0x7f21b8133b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21b659c700 1 -- 172.21.15.8:0/2386526701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b809a710 msgr2=0x7f21b81340d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:02.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21b659c700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b809a710 0x7f21b81340d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:02.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21b659c700 1 -- 172.21.15.8:0/2386526701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac009420 con 0x7f21b80a5350 2023-10-14T16:55:02.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21b5d9b700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b813c1e0 0x7f21b8133b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:55:02.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21b6d9d700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b809a710 0x7f21b81340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:55:02.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21b659c700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a5350 0x7f21b8133650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c7e0 tx=0x7f21a8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21a67fc700 1 -- 172.21.15.8:0/2386526701 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8005b30 con 0x7f21b80a5350 2023-10-14T16:55:02.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21a67fc700 1 -- 172.21.15.8:0/2386526701 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8005c90 con 0x7f21b80a5350 2023-10-14T16:55:02.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21b759e700 1 -- 172.21.15.8:0/2386526701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b8098020 con 0x7f21b80a5350 2023-10-14T16:55:02.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21a67fc700 1 -- 172.21.15.8:0/2386526701 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8007300 con 0x7f21b80a5350 2023-10-14T16:55:02.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.914+0000 7f21b759e700 1 -- 172.21.15.8:0/2386526701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b809af00 con 0x7f21b80a5350 2023-10-14T16:55:02.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.915+0000 7f21b759e700 1 -- 172.21.15.8:0/2386526701 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b806ad60 con 0x7f21b80a5350 2023-10-14T16:55:02.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.915+0000 7f21a67fc700 1 -- 172.21.15.8:0/2386526701 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21a801b400 con 0x7f21b80a5350 2023-10-14T16:55:02.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.916+0000 7f21a67fc700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2198066f30 0x7f21980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:02.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.916+0000 7f21a67fc700 1 -- 172.21.15.8:0/2386526701 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f21a8083aa0 con 0x7f21b80a5350 2023-10-14T16:55:02.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.916+0000 7f21b5d9b700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2198066f30 0x7f21980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:02.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.916+0000 7f21b5d9b700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2198066f30 0x7f21980693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21b809a600 tx=0x7f21ac017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:02.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:02.920+0000 7f21a67fc700 1 -- 172.21.15.8:0/2386526701 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21a80513a0 con 0x7f21b80a5350 2023-10-14T16:55:03.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.111+0000 7f21b759e700 1 -- 172.21.15.8:0/2386526701 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21b809b350 con 0x7f2198066f30 2023-10-14T16:55:03.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.118+0000 7f21a67fc700 1 -- 172.21.15.8:0/2386526701 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271232 (secure 0 0 0) 0x7f21b809b350 con 0x7f2198066f30 2023-10-14T16:55:03.122 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:55:03.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.121+0000 7f21b759e700 1 -- 172.21.15.8:0/2386526701 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2198066f30 msgr2=0x7f21980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.121+0000 7f21b759e700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2198066f30 0x7f21980693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21b809a600 tx=0x7f21ac017000 comp rx=0 tx=0).stop 2023-10-14T16:55:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.121+0000 7f21b759e700 1 -- 172.21.15.8:0/2386526701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a5350 msgr2=0x7f21b8133650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.121+0000 7f21b759e700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a5350 0x7f21b8133650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c7e0 tx=0x7f21a8007df0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.121+0000 7f21b759e700 1 -- 172.21.15.8:0/2386526701 shutdown_connections 2023-10-14T16:55:03.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.121+0000 7f21b759e700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2198066f30 0x7f21980693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.121+0000 7f21b759e700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b809a710 0x7f21b81340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.121+0000 7f21b759e700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a5350 0x7f21b8133650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.121+0000 7f21b759e700 1 --2- 172.21.15.8:0/2386526701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b813c1e0 0x7f21b8133b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.121+0000 7f21b759e700 1 -- 172.21.15.8:0/2386526701 >> 172.21.15.8:0/2386526701 conn(0x7f21b806a960 msgr2=0x7f21b80a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:03.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.121+0000 7f21b759e700 1 -- 172.21.15.8:0/2386526701 shutdown_connections 2023-10-14T16:55:03.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.121+0000 7f21b759e700 1 -- 172.21.15.8:0/2386526701 wait complete. 2023-10-14T16:55:03.127 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T16:55:03.134 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-14T16:55:01.982668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1190968,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":1189120,"kb_avail":376296392,"statfs":{"total":386547056640,"available":385327505408,"internally_reserved":0,"allocated":1859584,"data_stored":1387004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1217658880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.905232"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099890+0000","last_change":"2023-10-14T16:54:55.097675+0000","last_active":"2023-10-14T16:54:55.099890+0000","last_peered":"2023-10-14T16:54:55.099890+0000","last_clean":"2023-10-14T16:54:55.099890+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T16:54:55.099890+0000","last_undegraded":"2023-10-14T16:54:55.099890+0000","last_fullsized":"2023-10-14T16:54:55.099890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103871+0000","last_change":"2023-10-14T16:54:55.097479+0000","last_active":"2023-10-14T16:54:55.103871+0000","last_peered":"2023-10-14T16:54:55.103871+0000","last_clean":"2023-10-14T16:54:55.103871+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T16:54:55.103871+0000","last_undegraded":"2023-10-14T16:54:55.103871+0000","last_fullsized":"2023-10-14T16:54:55.103871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108409+0000","last_change":"2023-10-14T16:54:55.104594+0000","last_active":"2023-10-14T16:54:55.108409+0000","last_peered":"2023-10-14T16:54:55.108409+0000","last_clean":"2023-10-14T16:54:55.108409+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T16:54:55.108409+0000","last_undegraded":"2023-10-14T16:54:55.108409+0000","last_fullsized":"2023-10-14T16:54:55.108409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:56.343441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.104504+0000","last_change":"2023-10-14T16:54:55.095745+0000","last_active":"2023-10-14T16:54:55.104504+0000","last_peered":"2023-10-14T16:54:55.104504+0000","last_clean":"2023-10-14T16:54:55.104504+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T16:54:55.104504+0000","last_undegraded":"2023-10-14T16:54:55.104504+0000","last_fullsized":"2023-10-14T16:54:55.104504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:05.483417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099652+0000","last_change":"2023-10-14T16:54:55.097176+0000","last_active":"2023-10-14T16:54:55.099652+0000","last_peered":"2023-10-14T16:54:55.099652+0000","last_clean":"2023-10-14T16:54:55.099652+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T16:54:55.099652+0000","last_undegraded":"2023-10-14T16:54:55.099652+0000","last_fullsized":"2023-10-14T16:54:55.099652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098736+0000","last_change":"2023-10-14T16:54:55.093518+0000","last_active":"2023-10-14T16:54:55.098736+0000","last_peered":"2023-10-14T16:54:55.098736+0000","last_clean":"2023-10-14T16:54:55.098736+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T16:54:55.098736+0000","last_undegraded":"2023-10-14T16:54:55.098736+0000","last_fullsized":"2023-10-14T16:54:55.098736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:59.572769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098385+0000","last_change":"2023-10-14T16:54:55.093397+0000","last_active":"2023-10-14T16:54:55.098385+0000","last_peered":"2023-10-14T16:54:55.098385+0000","last_clean":"2023-10-14T16:54:55.098385+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T16:54:55.098385+0000","last_undegraded":"2023-10-14T16:54:55.098385+0000","last_fullsized":"2023-10-14T16:54:55.098385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:15:51.621106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098357+0000","last_change":"2023-10-14T16:54:55.093119+0000","last_active":"2023-10-14T16:54:55.098357+0000","last_peered":"2023-10-14T16:54:55.098357+0000","last_clean":"2023-10-14T16:54:55.098357+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T16:54:55.098357+0000","last_undegraded":"2023-10-14T16:54:55.098357+0000","last_fullsized":"2023-10-14T16:54:55.098357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:40.295415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099918+0000","last_change":"2023-10-14T16:54:55.097926+0000","last_active":"2023-10-14T16:54:55.099918+0000","last_peered":"2023-10-14T16:54:55.099918+0000","last_clean":"2023-10-14T16:54:55.099918+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T16:54:55.099918+0000","last_undegraded":"2023-10-14T16:54:55.099918+0000","last_fullsized":"2023-10-14T16:54:55.099918+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098770+0000","last_change":"2023-10-14T16:54:55.094293+0000","last_active":"2023-10-14T16:54:55.098770+0000","last_peered":"2023-10-14T16:54:55.098770+0000","last_clean":"2023-10-14T16:54:55.098770+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T16:54:55.098770+0000","last_undegraded":"2023-10-14T16:54:55.098770+0000","last_fullsized":"2023-10-14T16:54:55.098770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:54:37.853332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103951+0000","last_change":"2023-10-14T16:54:55.097944+0000","last_active":"2023-10-14T16:54:55.103951+0000","last_peered":"2023-10-14T16:54:55.103951+0000","last_clean":"2023-10-14T16:54:55.103951+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T16:54:55.103951+0000","last_undegraded":"2023-10-14T16:54:55.103951+0000","last_fullsized":"2023-10-14T16:54:55.103951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:18:19.208533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107384+0000","last_change":"2023-10-14T16:54:55.100123+0000","last_active":"2023-10-14T16:54:55.107384+0000","last_peered":"2023-10-14T16:54:55.107384+0000","last_clean":"2023-10-14T16:54:55.107384+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T16:54:55.107384+0000","last_undegraded":"2023-10-14T16:54:55.107384+0000","last_fullsized":"2023-10-14T16:54:55.107384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098058+0000","last_change":"2023-10-14T16:54:55.092337+0000","last_active":"2023-10-14T16:54:55.098058+0000","last_peered":"2023-10-14T16:54:55.098058+0000","last_clean":"2023-10-14T16:54:55.098058+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T16:54:55.098058+0000","last_undegraded":"2023-10-14T16:54:55.098058+0000","last_fullsized":"2023-10-14T16:54:55.098058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:13.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109719+0000","last_change":"2023-10-14T16:54:55.107518+0000","last_active":"2023-10-14T16:54:55.109719+0000","last_peered":"2023-10-14T16:54:55.109719+0000","last_clean":"2023-10-14T16:54:55.109719+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T16:54:55.109719+0000","last_undegraded":"2023-10-14T16:54:55.109719+0000","last_fullsized":"2023-10-14T16:54:55.109719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103788+0000","last_change":"2023-10-14T16:54:55.097498+0000","last_active":"2023-10-14T16:54:55.103788+0000","last_peered":"2023-10-14T16:54:55.103788+0000","last_clean":"2023-10-14T16:54:55.103788+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T16:54:55.103788+0000","last_undegraded":"2023-10-14T16:54:55.103788+0000","last_fullsized":"2023-10-14T16:54:55.103788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098786+0000","last_change":"2023-10-14T16:54:55.094124+0000","last_active":"2023-10-14T16:54:55.098786+0000","last_peered":"2023-10-14T16:54:55.098786+0000","last_clean":"2023-10-14T16:54:55.098786+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T16:54:55.098786+0000","last_undegraded":"2023-10-14T16:54:55.098786+0000","last_fullsized":"2023-10-14T16:54:55.098786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:41:12.510526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098928+0000","last_change":"2023-10-14T16:54:55.096559+0000","last_active":"2023-10-14T16:54:55.098928+0000","last_peered":"2023-10-14T16:54:55.098928+0000","last_clean":"2023-10-14T16:54:55.098928+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T16:54:55.098928+0000","last_undegraded":"2023-10-14T16:54:55.098928+0000","last_fullsized":"2023-10-14T16:54:55.098928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106652+0000","last_change":"2023-10-14T16:54:55.100473+0000","last_active":"2023-10-14T16:54:55.106652+0000","last_peered":"2023-10-14T16:54:55.106652+0000","last_clean":"2023-10-14T16:54:55.106652+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T16:54:55.106652+0000","last_undegraded":"2023-10-14T16:54:55.106652+0000","last_fullsized":"2023-10-14T16:54:55.106652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.095237+0000","last_change":"2023-10-14T16:54:55.091193+0000","last_active":"2023-10-14T16:54:55.095237+0000","last_peered":"2023-10-14T16:54:55.095237+0000","last_clean":"2023-10-14T16:54:55.095237+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T16:54:55.095237+0000","last_undegraded":"2023-10-14T16:54:55.095237+0000","last_fullsized":"2023-10-14T16:54:55.095237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106722+0000","last_change":"2023-10-14T16:54:55.100781+0000","last_active":"2023-10-14T16:54:55.106722+0000","last_peered":"2023-10-14T16:54:55.106722+0000","last_clean":"2023-10-14T16:54:55.106722+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T16:54:55.106722+0000","last_undegraded":"2023-10-14T16:54:55.106722+0000","last_fullsized":"2023-10-14T16:54:55.106722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109399+0000","last_change":"2023-10-14T16:54:55.107643+0000","last_active":"2023-10-14T16:54:55.109399+0000","last_peered":"2023-10-14T16:54:55.109399+0000","last_clean":"2023-10-14T16:54:55.109399+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T16:54:55.109399+0000","last_undegraded":"2023-10-14T16:54:55.109399+0000","last_fullsized":"2023-10-14T16:54:55.109399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098984+0000","last_change":"2023-10-14T16:54:55.096743+0000","last_active":"2023-10-14T16:54:55.098984+0000","last_peered":"2023-10-14T16:54:55.098984+0000","last_clean":"2023-10-14T16:54:55.098984+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T16:54:55.098984+0000","last_undegraded":"2023-10-14T16:54:55.098984+0000","last_fullsized":"2023-10-14T16:54:55.098984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110324+0000","last_change":"2023-10-14T16:54:55.102779+0000","last_active":"2023-10-14T16:54:55.110324+0000","last_peered":"2023-10-14T16:54:55.110324+0000","last_clean":"2023-10-14T16:54:55.110324+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T16:54:55.110324+0000","last_undegraded":"2023-10-14T16:54:55.110324+0000","last_fullsized":"2023-10-14T16:54:55.110324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106674+0000","last_change":"2023-10-14T16:54:55.100535+0000","last_active":"2023-10-14T16:54:55.106674+0000","last_peered":"2023-10-14T16:54:55.106674+0000","last_clean":"2023-10-14T16:54:55.106674+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T16:54:55.106674+0000","last_undegraded":"2023-10-14T16:54:55.106674+0000","last_fullsized":"2023-10-14T16:54:55.106674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108676+0000","last_change":"2023-10-14T16:54:55.100833+0000","last_active":"2023-10-14T16:54:55.108676+0000","last_peered":"2023-10-14T16:54:55.108676+0000","last_clean":"2023-10-14T16:54:55.108676+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T16:54:55.108676+0000","last_undegraded":"2023-10-14T16:54:55.108676+0000","last_fullsized":"2023-10-14T16:54:55.108676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111018+0000","last_change":"2023-10-14T16:54:55.107516+0000","last_active":"2023-10-14T16:54:55.111018+0000","last_peered":"2023-10-14T16:54:55.111018+0000","last_clean":"2023-10-14T16:54:55.111018+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T16:54:55.111018+0000","last_undegraded":"2023-10-14T16:54:55.111018+0000","last_fullsized":"2023-10-14T16:54:55.111018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108427+0000","last_change":"2023-10-14T16:54:55.104794+0000","last_active":"2023-10-14T16:54:55.108427+0000","last_peered":"2023-10-14T16:54:55.108427+0000","last_clean":"2023-10-14T16:54:55.108427+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T16:54:55.108427+0000","last_undegraded":"2023-10-14T16:54:55.108427+0000","last_fullsized":"2023-10-14T16:54:55.108427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:46.761206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.112011+0000","last_change":"2023-10-14T16:54:54.101946+0000","last_active":"2023-10-14T16:54:55.112011+0000","last_peered":"2023-10-14T16:54:55.112011+0000","last_clean":"2023-10-14T16:54:55.112011+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T16:54:55.112011+0000","last_undegraded":"2023-10-14T16:54:55.112011+0000","last_fullsized":"2023-10-14T16:54:55.112011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103770+0000","last_change":"2023-10-14T16:54:55.097502+0000","last_active":"2023-10-14T16:54:55.103770+0000","last_peered":"2023-10-14T16:54:55.103770+0000","last_clean":"2023-10-14T16:54:55.103770+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T16:54:55.103770+0000","last_undegraded":"2023-10-14T16:54:55.103770+0000","last_fullsized":"2023-10-14T16:54:55.103770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092311+0000","last_change":"2023-10-14T16:54:54.096872+0000","last_active":"2023-10-14T16:54:55.092311+0000","last_peered":"2023-10-14T16:54:55.092311+0000","last_clean":"2023-10-14T16:54:55.092311+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T16:54:55.092311+0000","last_undegraded":"2023-10-14T16:54:55.092311+0000","last_fullsized":"2023-10-14T16:54:55.092311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096373+0000","last_change":"2023-10-14T16:54:55.090799+0000","last_active":"2023-10-14T16:54:55.096373+0000","last_peered":"2023-10-14T16:54:55.096373+0000","last_clean":"2023-10-14T16:54:55.096373+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T16:54:55.096373+0000","last_undegraded":"2023-10-14T16:54:55.096373+0000","last_fullsized":"2023-10-14T16:54:55.096373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093342+0000","last_change":"2023-10-14T16:54:54.094974+0000","last_active":"2023-10-14T16:54:55.093342+0000","last_peered":"2023-10-14T16:54:55.093342+0000","last_clean":"2023-10-14T16:54:55.093342+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T16:54:55.093342+0000","last_undegraded":"2023-10-14T16:54:55.093342+0000","last_fullsized":"2023-10-14T16:54:55.093342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107286+0000","last_change":"2023-10-14T16:54:55.100446+0000","last_active":"2023-10-14T16:54:55.107286+0000","last_peered":"2023-10-14T16:54:55.107286+0000","last_clean":"2023-10-14T16:54:55.107286+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T16:54:55.107286+0000","last_undegraded":"2023-10-14T16:54:55.107286+0000","last_fullsized":"2023-10-14T16:54:55.107286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.083539+0000","last_change":"2023-10-14T16:54:54.098193+0000","last_active":"2023-10-14T16:54:55.083539+0000","last_peered":"2023-10-14T16:54:55.083539+0000","last_clean":"2023-10-14T16:54:55.083539+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T16:54:55.083539+0000","last_undegraded":"2023-10-14T16:54:55.083539+0000","last_fullsized":"2023-10-14T16:54:55.083539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:33.333473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106735+0000","last_change":"2023-10-14T16:54:55.099120+0000","last_active":"2023-10-14T16:54:55.106735+0000","last_peered":"2023-10-14T16:54:55.106735+0000","last_clean":"2023-10-14T16:54:55.106735+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T16:54:55.106735+0000","last_undegraded":"2023-10-14T16:54:55.106735+0000","last_fullsized":"2023-10-14T16:54:55.106735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090823+0000","last_change":"2023-10-14T16:54:54.100620+0000","last_active":"2023-10-14T16:54:55.090823+0000","last_peered":"2023-10-14T16:54:55.090823+0000","last_clean":"2023-10-14T16:54:55.090823+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T16:54:55.090823+0000","last_undegraded":"2023-10-14T16:54:55.090823+0000","last_fullsized":"2023-10-14T16:54:55.090823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096977+0000","last_change":"2023-10-14T16:54:55.090564+0000","last_active":"2023-10-14T16:54:55.096977+0000","last_peered":"2023-10-14T16:54:55.096977+0000","last_clean":"2023-10-14T16:54:55.096977+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T16:54:55.096977+0000","last_undegraded":"2023-10-14T16:54:55.096977+0000","last_fullsized":"2023-10-14T16:54:55.096977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108412+0000","last_change":"2023-10-14T16:54:54.097908+0000","last_active":"2023-10-14T16:54:55.108412+0000","last_peered":"2023-10-14T16:54:55.108412+0000","last_clean":"2023-10-14T16:54:55.108412+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T16:54:55.108412+0000","last_undegraded":"2023-10-14T16:54:55.108412+0000","last_fullsized":"2023-10-14T16:54:55.108412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110759+0000","last_change":"2023-10-14T16:54:55.104734+0000","last_active":"2023-10-14T16:54:55.110759+0000","last_peered":"2023-10-14T16:54:55.110759+0000","last_clean":"2023-10-14T16:54:55.110759+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T16:54:55.110759+0000","last_undegraded":"2023-10-14T16:54:55.110759+0000","last_fullsized":"2023-10-14T16:54:55.110759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110608+0000","last_change":"2023-10-14T16:54:54.098933+0000","last_active":"2023-10-14T16:54:55.110608+0000","last_peered":"2023-10-14T16:54:55.110608+0000","last_clean":"2023-10-14T16:54:55.110608+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T16:54:55.110608+0000","last_undegraded":"2023-10-14T16:54:55.110608+0000","last_fullsized":"2023-10-14T16:54:55.110608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:47.391039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103770+0000","last_change":"2023-10-14T16:54:55.096816+0000","last_active":"2023-10-14T16:54:55.103770+0000","last_peered":"2023-10-14T16:54:55.103770+0000","last_clean":"2023-10-14T16:54:55.103770+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T16:54:55.103770+0000","last_undegraded":"2023-10-14T16:54:55.103770+0000","last_fullsized":"2023-10-14T16:54:55.103770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106918+0000","last_change":"2023-10-14T16:54:54.103486+0000","last_active":"2023-10-14T16:54:55.106918+0000","last_peered":"2023-10-14T16:54:55.106918+0000","last_clean":"2023-10-14T16:54:55.106918+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T16:54:55.106918+0000","last_undegraded":"2023-10-14T16:54:55.106918+0000","last_fullsized":"2023-10-14T16:54:55.106918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111007+0000","last_change":"2023-10-14T16:54:55.108934+0000","last_active":"2023-10-14T16:54:55.111007+0000","last_peered":"2023-10-14T16:54:55.111007+0000","last_clean":"2023-10-14T16:54:55.111007+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T16:54:55.111007+0000","last_undegraded":"2023-10-14T16:54:55.111007+0000","last_fullsized":"2023-10-14T16:54:55.111007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.081975+0000","last_change":"2023-10-14T16:54:54.098087+0000","last_active":"2023-10-14T16:54:55.081975+0000","last_peered":"2023-10-14T16:54:55.081975+0000","last_clean":"2023-10-14T16:54:55.081975+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T16:54:55.081975+0000","last_undegraded":"2023-10-14T16:54:55.081975+0000","last_fullsized":"2023-10-14T16:54:55.081975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:48.428626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108444+0000","last_change":"2023-10-14T16:54:55.104902+0000","last_active":"2023-10-14T16:54:55.108444+0000","last_peered":"2023-10-14T16:54:55.108444+0000","last_clean":"2023-10-14T16:54:55.108444+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T16:54:55.108444+0000","last_undegraded":"2023-10-14T16:54:55.108444+0000","last_fullsized":"2023-10-14T16:54:55.108444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:21:19.831648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085257+0000","last_change":"2023-10-14T16:54:54.099046+0000","last_active":"2023-10-14T16:54:55.085257+0000","last_peered":"2023-10-14T16:54:55.085257+0000","last_clean":"2023-10-14T16:54:55.085257+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T16:54:55.085257+0000","last_undegraded":"2023-10-14T16:54:55.085257+0000","last_fullsized":"2023-10-14T16:54:55.085257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:13.092692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096397+0000","last_change":"2023-10-14T16:54:55.092929+0000","last_active":"2023-10-14T16:54:55.096397+0000","last_peered":"2023-10-14T16:54:55.096397+0000","last_clean":"2023-10-14T16:54:55.096397+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T16:54:55.096397+0000","last_undegraded":"2023-10-14T16:54:55.096397+0000","last_fullsized":"2023-10-14T16:54:55.096397+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:06.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109884+0000","last_change":"2023-10-14T16:54:54.099281+0000","last_active":"2023-10-14T16:54:55.109884+0000","last_peered":"2023-10-14T16:54:55.109884+0000","last_clean":"2023-10-14T16:54:55.109884+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T16:54:55.109884+0000","last_undegraded":"2023-10-14T16:54:55.109884+0000","last_fullsized":"2023-10-14T16:54:55.109884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103882+0000","last_change":"2023-10-14T16:54:55.099743+0000","last_active":"2023-10-14T16:54:55.103882+0000","last_peered":"2023-10-14T16:54:55.103882+0000","last_clean":"2023-10-14T16:54:55.103882+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T16:54:55.103882+0000","last_undegraded":"2023-10-14T16:54:55.103882+0000","last_fullsized":"2023-10-14T16:54:55.103882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108028+0000","last_change":"2023-10-14T16:54:54.100726+0000","last_active":"2023-10-14T16:54:55.108028+0000","last_peered":"2023-10-14T16:54:55.108028+0000","last_clean":"2023-10-14T16:54:55.108028+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T16:54:55.108028+0000","last_undegraded":"2023-10-14T16:54:55.108028+0000","last_fullsized":"2023-10-14T16:54:55.108028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098409+0000","last_change":"2023-10-14T16:54:55.093470+0000","last_active":"2023-10-14T16:54:55.098409+0000","last_peered":"2023-10-14T16:54:55.098409+0000","last_clean":"2023-10-14T16:54:55.098409+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T16:54:55.098409+0000","last_undegraded":"2023-10-14T16:54:55.098409+0000","last_fullsized":"2023-10-14T16:54:55.098409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.112167+0000","last_change":"2023-10-14T16:54:54.097646+0000","last_active":"2023-10-14T16:54:55.112167+0000","last_peered":"2023-10-14T16:54:55.112167+0000","last_clean":"2023-10-14T16:54:55.112167+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T16:54:55.112167+0000","last_undegraded":"2023-10-14T16:54:55.112167+0000","last_fullsized":"2023-10-14T16:54:55.112167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103764+0000","last_change":"2023-10-14T16:54:55.097471+0000","last_active":"2023-10-14T16:54:55.103764+0000","last_peered":"2023-10-14T16:54:55.103764+0000","last_clean":"2023-10-14T16:54:55.103764+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T16:54:55.103764+0000","last_undegraded":"2023-10-14T16:54:55.103764+0000","last_fullsized":"2023-10-14T16:54:55.103764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108356+0000","last_change":"2023-10-14T16:54:54.100923+0000","last_active":"2023-10-14T16:54:55.108356+0000","last_peered":"2023-10-14T16:54:55.108356+0000","last_clean":"2023-10-14T16:54:55.108356+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T16:54:55.108356+0000","last_undegraded":"2023-10-14T16:54:55.108356+0000","last_fullsized":"2023-10-14T16:54:55.108356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.104043+0000","last_change":"2023-10-14T16:54:55.096945+0000","last_active":"2023-10-14T16:54:55.104043+0000","last_peered":"2023-10-14T16:54:55.104043+0000","last_clean":"2023-10-14T16:54:55.104043+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T16:54:55.104043+0000","last_undegraded":"2023-10-14T16:54:55.104043+0000","last_fullsized":"2023-10-14T16:54:55.104043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.084866+0000","last_change":"2023-10-14T16:54:54.099363+0000","last_active":"2023-10-14T16:54:55.084866+0000","last_peered":"2023-10-14T16:54:55.084866+0000","last_clean":"2023-10-14T16:54:55.084866+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T16:54:55.084866+0000","last_undegraded":"2023-10-14T16:54:55.084866+0000","last_fullsized":"2023-10-14T16:54:55.084866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.124832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099688+0000","last_change":"2023-10-14T16:54:55.097957+0000","last_active":"2023-10-14T16:54:55.099688+0000","last_peered":"2023-10-14T16:54:55.099688+0000","last_clean":"2023-10-14T16:54:55.099688+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T16:54:55.099688+0000","last_undegraded":"2023-10-14T16:54:55.099688+0000","last_fullsized":"2023-10-14T16:54:55.099688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110707+0000","last_change":"2023-10-14T16:54:54.093771+0000","last_active":"2023-10-14T16:54:55.110707+0000","last_peered":"2023-10-14T16:54:55.110707+0000","last_clean":"2023-10-14T16:54:55.110707+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T16:54:55.110707+0000","last_undegraded":"2023-10-14T16:54:55.110707+0000","last_fullsized":"2023-10-14T16:54:55.110707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106694+0000","last_change":"2023-10-14T16:54:55.100663+0000","last_active":"2023-10-14T16:54:55.106694+0000","last_peered":"2023-10-14T16:54:55.106694+0000","last_clean":"2023-10-14T16:54:55.106694+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T16:54:55.106694+0000","last_undegraded":"2023-10-14T16:54:55.106694+0000","last_fullsized":"2023-10-14T16:54:55.106694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085907+0000","last_change":"2023-10-14T16:54:54.103401+0000","last_active":"2023-10-14T16:54:55.085907+0000","last_peered":"2023-10-14T16:54:55.085907+0000","last_clean":"2023-10-14T16:54:55.085907+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T16:54:55.085907+0000","last_undegraded":"2023-10-14T16:54:55.085907+0000","last_fullsized":"2023-10-14T16:54:55.085907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:28.931284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099217+0000","last_change":"2023-10-14T16:54:55.096406+0000","last_active":"2023-10-14T16:54:55.099217+0000","last_peered":"2023-10-14T16:54:55.099217+0000","last_clean":"2023-10-14T16:54:55.099217+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T16:54:55.099217+0000","last_undegraded":"2023-10-14T16:54:55.099217+0000","last_fullsized":"2023-10-14T16:54:55.099217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085465+0000","last_change":"2023-10-14T16:54:54.099084+0000","last_active":"2023-10-14T16:54:55.085465+0000","last_peered":"2023-10-14T16:54:55.085465+0000","last_clean":"2023-10-14T16:54:55.085465+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T16:54:55.085465+0000","last_undegraded":"2023-10-14T16:54:55.085465+0000","last_fullsized":"2023-10-14T16:54:55.085465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:27.318420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096109+0000","last_change":"2023-10-14T16:54:55.094077+0000","last_active":"2023-10-14T16:54:55.096109+0000","last_peered":"2023-10-14T16:54:55.096109+0000","last_clean":"2023-10-14T16:54:55.096109+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T16:54:55.096109+0000","last_undegraded":"2023-10-14T16:54:55.096109+0000","last_fullsized":"2023-10-14T16:54:55.096109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:12.562614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093276+0000","last_change":"2023-10-14T16:54:54.095927+0000","last_active":"2023-10-14T16:54:55.093276+0000","last_peered":"2023-10-14T16:54:55.093276+0000","last_clean":"2023-10-14T16:54:55.093276+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T16:54:55.093276+0000","last_undegraded":"2023-10-14T16:54:55.093276+0000","last_fullsized":"2023-10-14T16:54:55.093276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110839+0000","last_change":"2023-10-14T16:54:55.106702+0000","last_active":"2023-10-14T16:54:55.110839+0000","last_peered":"2023-10-14T16:54:55.110839+0000","last_clean":"2023-10-14T16:54:55.110839+0000","last_became_active":"2023-10-14T16:54:55.105853+0000","last_became_peered":"2023-10-14T16:54:55.105853+0000","last_unstale":"2023-10-14T16:54:55.110839+0000","last_undegraded":"2023-10-14T16:54:55.110839+0000","last_fullsized":"2023-10-14T16:54:55.110839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110438+0000","last_change":"2023-10-14T16:54:54.092032+0000","last_active":"2023-10-14T16:54:55.110438+0000","last_peered":"2023-10-14T16:54:55.110438+0000","last_clean":"2023-10-14T16:54:55.110438+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T16:54:55.110438+0000","last_undegraded":"2023-10-14T16:54:55.110438+0000","last_fullsized":"2023-10-14T16:54:55.110438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090798+0000","last_change":"2023-10-14T16:54:49.689264+0000","last_active":"2023-10-14T16:54:55.090798+0000","last_peered":"2023-10-14T16:54:55.090798+0000","last_clean":"2023-10-14T16:54:55.090798+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T16:54:55.090798+0000","last_undegraded":"2023-10-14T16:54:55.090798+0000","last_fullsized":"2023-10-14T16:54:55.090798+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097892+0000","last_change":"2023-10-14T16:54:55.092208+0000","last_active":"2023-10-14T16:54:55.097892+0000","last_peered":"2023-10-14T16:54:55.097892+0000","last_clean":"2023-10-14T16:54:55.097892+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T16:54:55.097892+0000","last_undegraded":"2023-10-14T16:54:55.097892+0000","last_fullsized":"2023-10-14T16:54:55.097892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.094564+0000","last_change":"2023-10-14T16:54:49.063336+0000","last_active":"2023-10-14T16:54:55.094564+0000","last_peered":"2023-10-14T16:54:55.094564+0000","last_clean":"2023-10-14T16:54:55.094564+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T16:54:55.094564+0000","last_undegraded":"2023-10-14T16:54:55.094564+0000","last_fullsized":"2023-10-14T16:54:55.094564+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-14T16:54:58.244407+0000","last_change":"2023-10-14T16:54:54.093189+0000","last_active":"2023-10-14T16:54:58.244407+0000","last_peered":"2023-10-14T16:54:58.244407+0000","last_clean":"2023-10-14T16:54:58.244407+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T16:54:58.244407+0000","last_undegraded":"2023-10-14T16:54:58.244407+0000","last_fullsized":"2023-10-14T16:54:58.244407+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:47.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096057+0000","last_change":"2023-10-14T16:54:55.094019+0000","last_active":"2023-10-14T16:54:55.096057+0000","last_peered":"2023-10-14T16:54:55.096057+0000","last_clean":"2023-10-14T16:54:55.096057+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T16:54:55.096057+0000","last_undegraded":"2023-10-14T16:54:55.096057+0000","last_fullsized":"2023-10-14T16:54:55.096057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:48.395824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092213+0000","last_change":"2023-10-14T16:54:49.063688+0000","last_active":"2023-10-14T16:54:55.092213+0000","last_peered":"2023-10-14T16:54:55.092213+0000","last_clean":"2023-10-14T16:54:55.092213+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T16:54:55.092213+0000","last_undegraded":"2023-10-14T16:54:55.092213+0000","last_fullsized":"2023-10-14T16:54:55.092213+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:29.004325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'117","reported_seq":163,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085888+0000","last_change":"2023-10-14T16:54:49.063307+0000","last_active":"2023-10-14T16:54:55.085888+0000","last_peered":"2023-10-14T16:54:55.085888+0000","last_clean":"2023-10-14T16:54:55.085888+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T16:54:55.085888+0000","last_undegraded":"2023-10-14T16:54:55.085888+0000","last_fullsized":"2023-10-14T16:54:55.085888+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.080989+0000","last_change":"2023-10-14T16:54:54.098588+0000","last_active":"2023-10-14T16:54:55.080989+0000","last_peered":"2023-10-14T16:54:55.080989+0000","last_clean":"2023-10-14T16:54:55.080989+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T16:54:55.080989+0000","last_undegraded":"2023-10-14T16:54:55.080989+0000","last_fullsized":"2023-10-14T16:54:55.080989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:18.107600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098839+0000","last_change":"2023-10-14T16:54:55.096261+0000","last_active":"2023-10-14T16:54:55.098839+0000","last_peered":"2023-10-14T16:54:55.098839+0000","last_clean":"2023-10-14T16:54:55.098839+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T16:54:55.098839+0000","last_undegraded":"2023-10-14T16:54:55.098839+0000","last_fullsized":"2023-10-14T16:54:55.098839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090234+0000","last_change":"2023-10-14T16:54:49.689356+0000","last_active":"2023-10-14T16:54:55.090234+0000","last_peered":"2023-10-14T16:54:55.090234+0000","last_clean":"2023-10-14T16:54:55.090234+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T16:54:55.090234+0000","last_undegraded":"2023-10-14T16:54:55.090234+0000","last_fullsized":"2023-10-14T16:54:55.090234+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093393+0000","last_change":"2023-10-14T16:54:54.093196+0000","last_active":"2023-10-14T16:54:55.093393+0000","last_peered":"2023-10-14T16:54:55.093393+0000","last_clean":"2023-10-14T16:54:55.093393+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T16:54:55.093393+0000","last_undegraded":"2023-10-14T16:54:55.093393+0000","last_fullsized":"2023-10-14T16:54:55.093393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110822+0000","last_change":"2023-10-14T16:54:55.106633+0000","last_active":"2023-10-14T16:54:55.110822+0000","last_peered":"2023-10-14T16:54:55.110822+0000","last_clean":"2023-10-14T16:54:55.110822+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T16:54:55.110822+0000","last_undegraded":"2023-10-14T16:54:55.110822+0000","last_fullsized":"2023-10-14T16:54:55.110822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085827+0000","last_change":"2023-10-14T16:54:49.689595+0000","last_active":"2023-10-14T16:54:55.085827+0000","last_peered":"2023-10-14T16:54:55.085827+0000","last_clean":"2023-10-14T16:54:55.085827+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T16:54:55.085827+0000","last_undegraded":"2023-10-14T16:54:55.085827+0000","last_fullsized":"2023-10-14T16:54:55.085827+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:46:44.177180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.091900+0000","last_change":"2023-10-14T16:54:54.099381+0000","last_active":"2023-10-14T16:54:55.091900+0000","last_peered":"2023-10-14T16:54:55.091900+0000","last_clean":"2023-10-14T16:54:55.091900+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T16:54:55.091900+0000","last_undegraded":"2023-10-14T16:54:55.091900+0000","last_fullsized":"2023-10-14T16:54:55.091900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099236+0000","last_change":"2023-10-14T16:54:55.096667+0000","last_active":"2023-10-14T16:54:55.099236+0000","last_peered":"2023-10-14T16:54:55.099236+0000","last_clean":"2023-10-14T16:54:55.099236+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T16:54:55.099236+0000","last_undegraded":"2023-10-14T16:54:55.099236+0000","last_fullsized":"2023-10-14T16:54:55.099236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085362+0000","last_change":"2023-10-14T16:54:49.689614+0000","last_active":"2023-10-14T16:54:55.085362+0000","last_peered":"2023-10-14T16:54:55.085362+0000","last_clean":"2023-10-14T16:54:55.085362+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T16:54:55.085362+0000","last_undegraded":"2023-10-14T16:54:55.085362+0000","last_fullsized":"2023-10-14T16:54:55.085362+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:09.272835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090680+0000","last_change":"2023-10-14T16:54:54.100656+0000","last_active":"2023-10-14T16:54:55.090680+0000","last_peered":"2023-10-14T16:54:55.090680+0000","last_clean":"2023-10-14T16:54:55.090680+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T16:54:55.090680+0000","last_undegraded":"2023-10-14T16:54:55.090680+0000","last_fullsized":"2023-10-14T16:54:55.090680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111077+0000","last_change":"2023-10-14T16:54:55.109319+0000","last_active":"2023-10-14T16:54:55.111077+0000","last_peered":"2023-10-14T16:54:55.111077+0000","last_clean":"2023-10-14T16:54:55.111077+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T16:54:55.111077+0000","last_undegraded":"2023-10-14T16:54:55.111077+0000","last_fullsized":"2023-10-14T16:54:55.111077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.087246+0000","last_change":"2023-10-14T16:54:49.689836+0000","last_active":"2023-10-14T16:54:55.087246+0000","last_peered":"2023-10-14T16:54:55.087246+0000","last_clean":"2023-10-14T16:54:55.087246+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T16:54:55.087246+0000","last_undegraded":"2023-10-14T16:54:55.087246+0000","last_fullsized":"2023-10-14T16:54:55.087246+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:24.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.094686+0000","last_change":"2023-10-14T16:54:54.096618+0000","last_active":"2023-10-14T16:54:55.094686+0000","last_peered":"2023-10-14T16:54:55.094686+0000","last_clean":"2023-10-14T16:54:55.094686+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T16:54:55.094686+0000","last_undegraded":"2023-10-14T16:54:55.094686+0000","last_fullsized":"2023-10-14T16:54:55.094686+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093329+0000","last_change":"2023-10-14T16:54:55.090211+0000","last_active":"2023-10-14T16:54:55.093329+0000","last_peered":"2023-10-14T16:54:55.093329+0000","last_clean":"2023-10-14T16:54:55.093329+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T16:54:55.093329+0000","last_undegraded":"2023-10-14T16:54:55.093329+0000","last_fullsized":"2023-10-14T16:54:55.093329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085714+0000","last_change":"2023-10-14T16:54:49.064767+0000","last_active":"2023-10-14T16:54:55.085714+0000","last_peered":"2023-10-14T16:54:55.085714+0000","last_clean":"2023-10-14T16:54:55.085714+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T16:54:55.085714+0000","last_undegraded":"2023-10-14T16:54:55.085714+0000","last_fullsized":"2023-10-14T16:54:55.085714+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:34:26.616500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090367+0000","last_change":"2023-10-14T16:54:54.106280+0000","last_active":"2023-10-14T16:54:55.090367+0000","last_peered":"2023-10-14T16:54:55.090367+0000","last_clean":"2023-10-14T16:54:55.090367+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T16:54:55.090367+0000","last_undegraded":"2023-10-14T16:54:55.090367+0000","last_fullsized":"2023-10-14T16:54:55.090367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107145+0000","last_change":"2023-10-14T16:54:55.100415+0000","last_active":"2023-10-14T16:54:55.107145+0000","last_peered":"2023-10-14T16:54:55.107145+0000","last_clean":"2023-10-14T16:54:55.107145+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T16:54:55.107145+0000","last_undegraded":"2023-10-14T16:54:55.107145+0000","last_fullsized":"2023-10-14T16:54:55.107145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107282+0000","last_change":"2023-10-14T16:54:54.102987+0000","last_active":"2023-10-14T16:54:55.107282+0000","last_peered":"2023-10-14T16:54:55.107282+0000","last_clean":"2023-10-14T16:54:55.107282+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T16:54:55.107282+0000","last_undegraded":"2023-10-14T16:54:55.107282+0000","last_fullsized":"2023-10-14T16:54:55.107282+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111066+0000","last_change":"2023-10-14T16:54:55.109338+0000","last_active":"2023-10-14T16:54:55.111066+0000","last_peered":"2023-10-14T16:54:55.111066+0000","last_clean":"2023-10-14T16:54:55.111066+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T16:54:55.111066+0000","last_undegraded":"2023-10-14T16:54:55.111066+0000","last_fullsized":"2023-10-14T16:54:55.111066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108122+0000","last_change":"2023-10-14T16:54:54.095975+0000","last_active":"2023-10-14T16:54:55.108122+0000","last_peered":"2023-10-14T16:54:55.108122+0000","last_clean":"2023-10-14T16:54:55.108122+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T16:54:55.108122+0000","last_undegraded":"2023-10-14T16:54:55.108122+0000","last_fullsized":"2023-10-14T16:54:55.108122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.105361+0000","last_change":"2023-10-14T16:54:55.098957+0000","last_active":"2023-10-14T16:54:55.105361+0000","last_peered":"2023-10-14T16:54:55.105361+0000","last_clean":"2023-10-14T16:54:55.105361+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T16:54:55.105361+0000","last_undegraded":"2023-10-14T16:54:55.105361+0000","last_fullsized":"2023-10-14T16:54:55.105361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107000+0000","last_change":"2023-10-14T16:54:54.103049+0000","last_active":"2023-10-14T16:54:55.107000+0000","last_peered":"2023-10-14T16:54:55.107000+0000","last_clean":"2023-10-14T16:54:55.107000+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T16:54:55.107000+0000","last_undegraded":"2023-10-14T16:54:55.107000+0000","last_fullsized":"2023-10-14T16:54:55.107000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:17:46.369733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.104062+0000","last_change":"2023-10-14T16:54:55.097880+0000","last_active":"2023-10-14T16:54:55.104062+0000","last_peered":"2023-10-14T16:54:55.104062+0000","last_clean":"2023-10-14T16:54:55.104062+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T16:54:55.104062+0000","last_undegraded":"2023-10-14T16:54:55.104062+0000","last_fullsized":"2023-10-14T16:54:55.104062+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106336+0000","last_change":"2023-10-14T16:54:54.095418+0000","last_active":"2023-10-14T16:54:55.106336+0000","last_peered":"2023-10-14T16:54:55.106336+0000","last_clean":"2023-10-14T16:54:55.106336+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T16:54:55.106336+0000","last_undegraded":"2023-10-14T16:54:55.106336+0000","last_fullsized":"2023-10-14T16:54:55.106336+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:42.952466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099715+0000","last_change":"2023-10-14T16:54:55.097431+0000","last_active":"2023-10-14T16:54:55.099715+0000","last_peered":"2023-10-14T16:54:55.099715+0000","last_clean":"2023-10-14T16:54:55.099715+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T16:54:55.099715+0000","last_undegraded":"2023-10-14T16:54:55.099715+0000","last_fullsized":"2023-10-14T16:54:55.099715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109535+0000","last_change":"2023-10-14T16:54:54.098491+0000","last_active":"2023-10-14T16:54:55.109535+0000","last_peered":"2023-10-14T16:54:55.109535+0000","last_clean":"2023-10-14T16:54:55.109535+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T16:54:55.109535+0000","last_undegraded":"2023-10-14T16:54:55.109535+0000","last_fullsized":"2023-10-14T16:54:55.109535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108426+0000","last_change":"2023-10-14T16:54:55.107411+0000","last_active":"2023-10-14T16:54:55.108426+0000","last_peered":"2023-10-14T16:54:55.108426+0000","last_clean":"2023-10-14T16:54:55.108426+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T16:54:55.108426+0000","last_undegraded":"2023-10-14T16:54:55.108426+0000","last_fullsized":"2023-10-14T16:54:55.108426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109637+0000","last_change":"2023-10-14T16:54:55.107839+0000","last_active":"2023-10-14T16:54:55.109637+0000","last_peered":"2023-10-14T16:54:55.109637+0000","last_clean":"2023-10-14T16:54:55.109637+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T16:54:55.109637+0000","last_undegraded":"2023-10-14T16:54:55.109637+0000","last_fullsized":"2023-10-14T16:54:55.109637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103549+0000","last_change":"2023-10-14T16:54:55.094659+0000","last_active":"2023-10-14T16:54:55.103549+0000","last_peered":"2023-10-14T16:54:55.103549+0000","last_clean":"2023-10-14T16:54:55.103549+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T16:54:55.103549+0000","last_undegraded":"2023-10-14T16:54:55.103549+0000","last_fullsized":"2023-10-14T16:54:55.103549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108453+0000","last_change":"2023-10-14T16:54:55.105319+0000","last_active":"2023-10-14T16:54:55.108453+0000","last_peered":"2023-10-14T16:54:55.108453+0000","last_clean":"2023-10-14T16:54:55.108453+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T16:54:55.108453+0000","last_undegraded":"2023-10-14T16:54:55.108453+0000","last_fullsized":"2023-10-14T16:54:55.108453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099672+0000","last_change":"2023-10-14T16:54:55.097385+0000","last_active":"2023-10-14T16:54:55.099672+0000","last_peered":"2023-10-14T16:54:55.099672+0000","last_clean":"2023-10-14T16:54:55.099672+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T16:54:55.099672+0000","last_undegraded":"2023-10-14T16:54:55.099672+0000","last_fullsized":"2023-10-14T16:54:55.099672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111056+0000","last_change":"2023-10-14T16:54:55.109138+0000","last_active":"2023-10-14T16:54:55.111056+0000","last_peered":"2023-10-14T16:54:55.111056+0000","last_clean":"2023-10-14T16:54:55.111056+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T16:54:55.111056+0000","last_undegraded":"2023-10-14T16:54:55.111056+0000","last_fullsized":"2023-10-14T16:54:55.111056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298044,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073796,"statfs":{"total":96636764160,"available":96331567104,"internally_reserved":0,"allocated":774144,"data_stored":642998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":176128,"data_stored":52096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":163840,"data_stored":51128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298016,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073824,"statfs":{"total":96636764160,"available":96331595776,"internally_reserved":0,"allocated":745472,"data_stored":640782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T16:55:03.139 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T16:55:03.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.292+0000 7fc2b4013700 1 Processor -- start 2023-10-14T16:55:03.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b4013700 1 -- start start 2023-10-14T16:55:03.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b4013700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc2ac0a41c0 0x7fc2ac06e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:03.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b4013700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc2ac131890 0x7fc2ac131d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:03.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b4013700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ac132250 con 0x7fc2ac0a2690 2023-10-14T16:55:03.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b4013700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ac06e7d0 con 0x7fc2ac0a41c0 2023-10-14T16:55:03.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b4013700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ac0a4640 con 0x7fc2ac131890 2023-10-14T16:55:03.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b1daf700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc2ac0a41c0 0x7fc2ac06e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:03.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b25b0700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc2ac0a2690 0x7fc2ac0a2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42456/0 (socket says 172.21.15.8:42456) 2023-10-14T16:55:03.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b25b0700 1 -- 172.21.15.8:0/2913725043 learned_addr learned my addr 172.21.15.8:0/2913725043 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:03.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b15ae700 1 --2- 172.21.15.8:0/2913725043 >> v2:172.21.15.155:3300/0 conn(0x7fc2ac131890 0x7fc2ac131d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:03.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b1daf700 1 -- 172.21.15.8:0/2913725043 >> v2:172.21.15.155:3300/0 conn(0x7fc2ac131890 msgr2=0x7fc2ac131d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:03.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b1daf700 1 --2- 172.21.15.8:0/2913725043 >> v2:172.21.15.155:3300/0 conn(0x7fc2ac131890 0x7fc2ac131d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b1daf700 1 -- 172.21.15.8:0/2913725043 >> v1:172.21.15.8:6789/0 conn(0x7fc2ac0a2690 legacy=0x7fc2ac0a2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.293+0000 7fc2b1daf700 1 -- 172.21.15.8:0/2913725043 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac0a4900 con 0x7fc2ac0a41c0 2023-10-14T16:55:03.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.294+0000 7fc2b1daf700 1 --2- 172.21.15.8:0/2913725043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0a41c0 0x7fc2ac06e290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac06c410 tx=0x7fc2a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333cabdd5b7cbe62 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:03.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.294+0000 7fc2b0dad700 1 -- 172.21.15.8:0/2913725043 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a800b6b0 con 0x7fc2ac0a41c0 2023-10-14T16:55:03.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.294+0000 7fc2b0dad700 1 -- 172.21.15.8:0/2913725043 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a800b810 con 0x7fc2ac0a41c0 2023-10-14T16:55:03.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.294+0000 7fc2b0dad700 1 -- 172.21.15.8:0/2913725043 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a800bbb0 con 0x7fc2ac0a41c0 2023-10-14T16:55:03.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.294+0000 7fc2b4013700 1 -- 172.21.15.8:0/2913725043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0a41c0 msgr2=0x7fc2ac06e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.294+0000 7fc2b4013700 1 --2- 172.21.15.8:0/2913725043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0a41c0 0x7fc2ac06e290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac06c410 tx=0x7fc2a80091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.294+0000 7fc2b4013700 1 -- 172.21.15.8:0/2913725043 shutdown_connections 2023-10-14T16:55:03.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.294+0000 7fc2b4013700 1 --2- 172.21.15.8:0/2913725043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0a41c0 0x7fc2ac06e290 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.294+0000 7fc2b4013700 1 --2- 172.21.15.8:0/2913725043 >> v2:172.21.15.155:3300/0 conn(0x7fc2ac131890 0x7fc2ac131d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.294+0000 7fc2b4013700 1 -- 172.21.15.8:0/2913725043 >> 172.21.15.8:0/2913725043 conn(0x7fc2ac06f840 msgr2=0x7fc2ac0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:03.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.294+0000 7fc2b4013700 1 -- 172.21.15.8:0/2913725043 shutdown_connections 2023-10-14T16:55:03.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.294+0000 7fc2b4013700 1 -- 172.21.15.8:0/2913725043 wait complete. 2023-10-14T16:55:03.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.295+0000 7fc2b4013700 1 Processor -- start 2023-10-14T16:55:03.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.295+0000 7fc2b4013700 1 -- start start 2023-10-14T16:55:03.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b4013700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0a2690 0x7fc2ac09bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:03.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b4013700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2ac131890 0x7fc2ac09da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:03.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b4013700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2ac06a2c0 0x7fc2ac145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:03.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b4013700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac09dfb0 con 0x7fc2ac0a2690 2023-10-14T16:55:03.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b4013700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac06aef0 con 0x7fc2ac06a2c0 2023-10-14T16:55:03.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b4013700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac09d040 con 0x7fc2ac131890 2023-10-14T16:55:03.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b1daf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0a2690 0x7fc2ac09bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:03.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b1daf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0a2690 0x7fc2ac09bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53462/0 (socket says 172.21.15.8:53462) 2023-10-14T16:55:03.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b1daf700 1 -- 172.21.15.8:0/794826892 learned_addr learned my addr 172.21.15.8:0/794826892 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:03.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b15ae700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2ac131890 0x7fc2ac09da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:03.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b25b0700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2ac06a2c0 0x7fc2ac145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:03.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b1daf700 1 -- 172.21.15.8:0/794826892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2ac131890 msgr2=0x7fc2ac09da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b1daf700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2ac131890 0x7fc2ac09da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b1daf700 1 -- 172.21.15.8:0/794826892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2ac06a2c0 msgr2=0x7fc2ac145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b1daf700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2ac06a2c0 0x7fc2ac145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b1daf700 1 -- 172.21.15.8:0/794826892 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8009420 con 0x7fc2ac0a2690 2023-10-14T16:55:03.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b25b0700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2ac06a2c0 0x7fc2ac145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:55:03.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2b1daf700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0a2690 0x7fc2ac09bdf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0a4f00 tx=0x7fc2a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:03.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.296+0000 7fc2a1ffb700 1 -- 172.21.15.8:0/794826892 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8011420 con 0x7fc2ac0a2690 2023-10-14T16:55:03.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.297+0000 7fc2a1ffb700 1 -- 172.21.15.8:0/794826892 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a8011580 con 0x7fc2ac0a2690 2023-10-14T16:55:03.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.297+0000 7fc2b4013700 1 -- 172.21.15.8:0/794826892 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ac09d5e0 con 0x7fc2ac0a2690 2023-10-14T16:55:03.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.297+0000 7fc2a1ffb700 1 -- 172.21.15.8:0/794826892 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8011940 con 0x7fc2ac0a2690 2023-10-14T16:55:03.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.297+0000 7fc2b4013700 1 -- 172.21.15.8:0/794826892 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ac09d380 con 0x7fc2ac0a2690 2023-10-14T16:55:03.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.298+0000 7fc2b4013700 1 -- 172.21.15.8:0/794826892 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ac0708d0 con 0x7fc2ac0a2690 2023-10-14T16:55:03.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.298+0000 7fc2a1ffb700 1 -- 172.21.15.8:0/794826892 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2a8011d30 con 0x7fc2ac0a2690 2023-10-14T16:55:03.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.299+0000 7fc2a1ffb700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fc290066f60 0x7fc290069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:03.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.299+0000 7fc2b15ae700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fc290066f60 0x7fc290069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:03.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.299+0000 7fc2a1ffb700 1 -- 172.21.15.8:0/794826892 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fc2a8085430 con 0x7fc2ac0a2690 2023-10-14T16:55:03.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.299+0000 7fc2b15ae700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fc290066f60 0x7fc290069410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0a0ad0 tx=0x7fc29c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:03.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.303+0000 7fc2a1ffb700 1 -- 172.21.15.8:0/794826892 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2a8052c00 con 0x7fc2ac0a2690 2023-10-14T16:55:03.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.492+0000 7fc2b4013700 1 -- 172.21.15.8:0/794826892 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2ac0965c0 con 0x7fc290066f60 2023-10-14T16:55:03.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.499+0000 7fc2a1ffb700 1 -- 172.21.15.8:0/794826892 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271232 (secure 0 0 0) 0x7fc2ac0965c0 con 0x7fc290066f60 2023-10-14T16:55:03.503 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:55:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.502+0000 7fc2b4013700 1 -- 172.21.15.8:0/794826892 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fc290066f60 msgr2=0x7fc290069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.502+0000 7fc2b4013700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fc290066f60 0x7fc290069410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0a0ad0 tx=0x7fc29c008040 comp rx=0 tx=0).stop 2023-10-14T16:55:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.502+0000 7fc2b4013700 1 -- 172.21.15.8:0/794826892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0a2690 msgr2=0x7fc2ac09bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.502+0000 7fc2b4013700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0a2690 0x7fc2ac09bdf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0a4f00 tx=0x7fc2a8017000 comp rx=0 tx=0).stop 2023-10-14T16:55:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.502+0000 7fc2b4013700 1 -- 172.21.15.8:0/794826892 shutdown_connections 2023-10-14T16:55:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.502+0000 7fc2b4013700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fc290066f60 0x7fc290069410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.502+0000 7fc2b4013700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2ac06a2c0 0x7fc2ac145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.502+0000 7fc2b4013700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2ac0a2690 0x7fc2ac09bdf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.502+0000 7fc2b4013700 1 --2- 172.21.15.8:0/794826892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2ac131890 0x7fc2ac09da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.502+0000 7fc2b4013700 1 -- 172.21.15.8:0/794826892 >> 172.21.15.8:0/794826892 conn(0x7fc2ac06f840 msgr2=0x7fc2ac0a69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.503+0000 7fc2b4013700 1 -- 172.21.15.8:0/794826892 shutdown_connections 2023-10-14T16:55:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.503+0000 7fc2b4013700 1 -- 172.21.15.8:0/794826892 wait complete. 2023-10-14T16:55:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T16:55:03.515 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-14T16:55:01.982668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1190968,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":1189120,"kb_avail":376296392,"statfs":{"total":386547056640,"available":385327505408,"internally_reserved":0,"allocated":1859584,"data_stored":1387004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1217658880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.905232"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099890+0000","last_change":"2023-10-14T16:54:55.097675+0000","last_active":"2023-10-14T16:54:55.099890+0000","last_peered":"2023-10-14T16:54:55.099890+0000","last_clean":"2023-10-14T16:54:55.099890+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T16:54:55.099890+0000","last_undegraded":"2023-10-14T16:54:55.099890+0000","last_fullsized":"2023-10-14T16:54:55.099890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103871+0000","last_change":"2023-10-14T16:54:55.097479+0000","last_active":"2023-10-14T16:54:55.103871+0000","last_peered":"2023-10-14T16:54:55.103871+0000","last_clean":"2023-10-14T16:54:55.103871+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T16:54:55.103871+0000","last_undegraded":"2023-10-14T16:54:55.103871+0000","last_fullsized":"2023-10-14T16:54:55.103871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108409+0000","last_change":"2023-10-14T16:54:55.104594+0000","last_active":"2023-10-14T16:54:55.108409+0000","last_peered":"2023-10-14T16:54:55.108409+0000","last_clean":"2023-10-14T16:54:55.108409+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T16:54:55.108409+0000","last_undegraded":"2023-10-14T16:54:55.108409+0000","last_fullsized":"2023-10-14T16:54:55.108409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:56.343441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.104504+0000","last_change":"2023-10-14T16:54:55.095745+0000","last_active":"2023-10-14T16:54:55.104504+0000","last_peered":"2023-10-14T16:54:55.104504+0000","last_clean":"2023-10-14T16:54:55.104504+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T16:54:55.104504+0000","last_undegraded":"2023-10-14T16:54:55.104504+0000","last_fullsized":"2023-10-14T16:54:55.104504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:05.483417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099652+0000","last_change":"2023-10-14T16:54:55.097176+0000","last_active":"2023-10-14T16:54:55.099652+0000","last_peered":"2023-10-14T16:54:55.099652+0000","last_clean":"2023-10-14T16:54:55.099652+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T16:54:55.099652+0000","last_undegraded":"2023-10-14T16:54:55.099652+0000","last_fullsized":"2023-10-14T16:54:55.099652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098736+0000","last_change":"2023-10-14T16:54:55.093518+0000","last_active":"2023-10-14T16:54:55.098736+0000","last_peered":"2023-10-14T16:54:55.098736+0000","last_clean":"2023-10-14T16:54:55.098736+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T16:54:55.098736+0000","last_undegraded":"2023-10-14T16:54:55.098736+0000","last_fullsized":"2023-10-14T16:54:55.098736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:59.572769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098385+0000","last_change":"2023-10-14T16:54:55.093397+0000","last_active":"2023-10-14T16:54:55.098385+0000","last_peered":"2023-10-14T16:54:55.098385+0000","last_clean":"2023-10-14T16:54:55.098385+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T16:54:55.098385+0000","last_undegraded":"2023-10-14T16:54:55.098385+0000","last_fullsized":"2023-10-14T16:54:55.098385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:15:51.621106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098357+0000","last_change":"2023-10-14T16:54:55.093119+0000","last_active":"2023-10-14T16:54:55.098357+0000","last_peered":"2023-10-14T16:54:55.098357+0000","last_clean":"2023-10-14T16:54:55.098357+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T16:54:55.098357+0000","last_undegraded":"2023-10-14T16:54:55.098357+0000","last_fullsized":"2023-10-14T16:54:55.098357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:40.295415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099918+0000","last_change":"2023-10-14T16:54:55.097926+0000","last_active":"2023-10-14T16:54:55.099918+0000","last_peered":"2023-10-14T16:54:55.099918+0000","last_clean":"2023-10-14T16:54:55.099918+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T16:54:55.099918+0000","last_undegraded":"2023-10-14T16:54:55.099918+0000","last_fullsized":"2023-10-14T16:54:55.099918+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098770+0000","last_change":"2023-10-14T16:54:55.094293+0000","last_active":"2023-10-14T16:54:55.098770+0000","last_peered":"2023-10-14T16:54:55.098770+0000","last_clean":"2023-10-14T16:54:55.098770+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T16:54:55.098770+0000","last_undegraded":"2023-10-14T16:54:55.098770+0000","last_fullsized":"2023-10-14T16:54:55.098770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:54:37.853332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103951+0000","last_change":"2023-10-14T16:54:55.097944+0000","last_active":"2023-10-14T16:54:55.103951+0000","last_peered":"2023-10-14T16:54:55.103951+0000","last_clean":"2023-10-14T16:54:55.103951+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T16:54:55.103951+0000","last_undegraded":"2023-10-14T16:54:55.103951+0000","last_fullsized":"2023-10-14T16:54:55.103951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:18:19.208533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107384+0000","last_change":"2023-10-14T16:54:55.100123+0000","last_active":"2023-10-14T16:54:55.107384+0000","last_peered":"2023-10-14T16:54:55.107384+0000","last_clean":"2023-10-14T16:54:55.107384+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T16:54:55.107384+0000","last_undegraded":"2023-10-14T16:54:55.107384+0000","last_fullsized":"2023-10-14T16:54:55.107384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098058+0000","last_change":"2023-10-14T16:54:55.092337+0000","last_active":"2023-10-14T16:54:55.098058+0000","last_peered":"2023-10-14T16:54:55.098058+0000","last_clean":"2023-10-14T16:54:55.098058+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T16:54:55.098058+0000","last_undegraded":"2023-10-14T16:54:55.098058+0000","last_fullsized":"2023-10-14T16:54:55.098058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:13.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109719+0000","last_change":"2023-10-14T16:54:55.107518+0000","last_active":"2023-10-14T16:54:55.109719+0000","last_peered":"2023-10-14T16:54:55.109719+0000","last_clean":"2023-10-14T16:54:55.109719+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T16:54:55.109719+0000","last_undegraded":"2023-10-14T16:54:55.109719+0000","last_fullsized":"2023-10-14T16:54:55.109719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103788+0000","last_change":"2023-10-14T16:54:55.097498+0000","last_active":"2023-10-14T16:54:55.103788+0000","last_peered":"2023-10-14T16:54:55.103788+0000","last_clean":"2023-10-14T16:54:55.103788+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T16:54:55.103788+0000","last_undegraded":"2023-10-14T16:54:55.103788+0000","last_fullsized":"2023-10-14T16:54:55.103788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098786+0000","last_change":"2023-10-14T16:54:55.094124+0000","last_active":"2023-10-14T16:54:55.098786+0000","last_peered":"2023-10-14T16:54:55.098786+0000","last_clean":"2023-10-14T16:54:55.098786+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T16:54:55.098786+0000","last_undegraded":"2023-10-14T16:54:55.098786+0000","last_fullsized":"2023-10-14T16:54:55.098786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:41:12.510526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098928+0000","last_change":"2023-10-14T16:54:55.096559+0000","last_active":"2023-10-14T16:54:55.098928+0000","last_peered":"2023-10-14T16:54:55.098928+0000","last_clean":"2023-10-14T16:54:55.098928+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T16:54:55.098928+0000","last_undegraded":"2023-10-14T16:54:55.098928+0000","last_fullsized":"2023-10-14T16:54:55.098928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106652+0000","last_change":"2023-10-14T16:54:55.100473+0000","last_active":"2023-10-14T16:54:55.106652+0000","last_peered":"2023-10-14T16:54:55.106652+0000","last_clean":"2023-10-14T16:54:55.106652+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T16:54:55.106652+0000","last_undegraded":"2023-10-14T16:54:55.106652+0000","last_fullsized":"2023-10-14T16:54:55.106652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.095237+0000","last_change":"2023-10-14T16:54:55.091193+0000","last_active":"2023-10-14T16:54:55.095237+0000","last_peered":"2023-10-14T16:54:55.095237+0000","last_clean":"2023-10-14T16:54:55.095237+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T16:54:55.095237+0000","last_undegraded":"2023-10-14T16:54:55.095237+0000","last_fullsized":"2023-10-14T16:54:55.095237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106722+0000","last_change":"2023-10-14T16:54:55.100781+0000","last_active":"2023-10-14T16:54:55.106722+0000","last_peered":"2023-10-14T16:54:55.106722+0000","last_clean":"2023-10-14T16:54:55.106722+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T16:54:55.106722+0000","last_undegraded":"2023-10-14T16:54:55.106722+0000","last_fullsized":"2023-10-14T16:54:55.106722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109399+0000","last_change":"2023-10-14T16:54:55.107643+0000","last_active":"2023-10-14T16:54:55.109399+0000","last_peered":"2023-10-14T16:54:55.109399+0000","last_clean":"2023-10-14T16:54:55.109399+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T16:54:55.109399+0000","last_undegraded":"2023-10-14T16:54:55.109399+0000","last_fullsized":"2023-10-14T16:54:55.109399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098984+0000","last_change":"2023-10-14T16:54:55.096743+0000","last_active":"2023-10-14T16:54:55.098984+0000","last_peered":"2023-10-14T16:54:55.098984+0000","last_clean":"2023-10-14T16:54:55.098984+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T16:54:55.098984+0000","last_undegraded":"2023-10-14T16:54:55.098984+0000","last_fullsized":"2023-10-14T16:54:55.098984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110324+0000","last_change":"2023-10-14T16:54:55.102779+0000","last_active":"2023-10-14T16:54:55.110324+0000","last_peered":"2023-10-14T16:54:55.110324+0000","last_clean":"2023-10-14T16:54:55.110324+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T16:54:55.110324+0000","last_undegraded":"2023-10-14T16:54:55.110324+0000","last_fullsized":"2023-10-14T16:54:55.110324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106674+0000","last_change":"2023-10-14T16:54:55.100535+0000","last_active":"2023-10-14T16:54:55.106674+0000","last_peered":"2023-10-14T16:54:55.106674+0000","last_clean":"2023-10-14T16:54:55.106674+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T16:54:55.106674+0000","last_undegraded":"2023-10-14T16:54:55.106674+0000","last_fullsized":"2023-10-14T16:54:55.106674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108676+0000","last_change":"2023-10-14T16:54:55.100833+0000","last_active":"2023-10-14T16:54:55.108676+0000","last_peered":"2023-10-14T16:54:55.108676+0000","last_clean":"2023-10-14T16:54:55.108676+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T16:54:55.108676+0000","last_undegraded":"2023-10-14T16:54:55.108676+0000","last_fullsized":"2023-10-14T16:54:55.108676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111018+0000","last_change":"2023-10-14T16:54:55.107516+0000","last_active":"2023-10-14T16:54:55.111018+0000","last_peered":"2023-10-14T16:54:55.111018+0000","last_clean":"2023-10-14T16:54:55.111018+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T16:54:55.111018+0000","last_undegraded":"2023-10-14T16:54:55.111018+0000","last_fullsized":"2023-10-14T16:54:55.111018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108427+0000","last_change":"2023-10-14T16:54:55.104794+0000","last_active":"2023-10-14T16:54:55.108427+0000","last_peered":"2023-10-14T16:54:55.108427+0000","last_clean":"2023-10-14T16:54:55.108427+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T16:54:55.108427+0000","last_undegraded":"2023-10-14T16:54:55.108427+0000","last_fullsized":"2023-10-14T16:54:55.108427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:46.761206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.112011+0000","last_change":"2023-10-14T16:54:54.101946+0000","last_active":"2023-10-14T16:54:55.112011+0000","last_peered":"2023-10-14T16:54:55.112011+0000","last_clean":"2023-10-14T16:54:55.112011+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T16:54:55.112011+0000","last_undegraded":"2023-10-14T16:54:55.112011+0000","last_fullsized":"2023-10-14T16:54:55.112011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103770+0000","last_change":"2023-10-14T16:54:55.097502+0000","last_active":"2023-10-14T16:54:55.103770+0000","last_peered":"2023-10-14T16:54:55.103770+0000","last_clean":"2023-10-14T16:54:55.103770+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T16:54:55.103770+0000","last_undegraded":"2023-10-14T16:54:55.103770+0000","last_fullsized":"2023-10-14T16:54:55.103770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092311+0000","last_change":"2023-10-14T16:54:54.096872+0000","last_active":"2023-10-14T16:54:55.092311+0000","last_peered":"2023-10-14T16:54:55.092311+0000","last_clean":"2023-10-14T16:54:55.092311+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T16:54:55.092311+0000","last_undegraded":"2023-10-14T16:54:55.092311+0000","last_fullsized":"2023-10-14T16:54:55.092311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096373+0000","last_change":"2023-10-14T16:54:55.090799+0000","last_active":"2023-10-14T16:54:55.096373+0000","last_peered":"2023-10-14T16:54:55.096373+0000","last_clean":"2023-10-14T16:54:55.096373+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T16:54:55.096373+0000","last_undegraded":"2023-10-14T16:54:55.096373+0000","last_fullsized":"2023-10-14T16:54:55.096373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093342+0000","last_change":"2023-10-14T16:54:54.094974+0000","last_active":"2023-10-14T16:54:55.093342+0000","last_peered":"2023-10-14T16:54:55.093342+0000","last_clean":"2023-10-14T16:54:55.093342+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T16:54:55.093342+0000","last_undegraded":"2023-10-14T16:54:55.093342+0000","last_fullsized":"2023-10-14T16:54:55.093342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107286+0000","last_change":"2023-10-14T16:54:55.100446+0000","last_active":"2023-10-14T16:54:55.107286+0000","last_peered":"2023-10-14T16:54:55.107286+0000","last_clean":"2023-10-14T16:54:55.107286+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T16:54:55.107286+0000","last_undegraded":"2023-10-14T16:54:55.107286+0000","last_fullsized":"2023-10-14T16:54:55.107286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.083539+0000","last_change":"2023-10-14T16:54:54.098193+0000","last_active":"2023-10-14T16:54:55.083539+0000","last_peered":"2023-10-14T16:54:55.083539+0000","last_clean":"2023-10-14T16:54:55.083539+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T16:54:55.083539+0000","last_undegraded":"2023-10-14T16:54:55.083539+0000","last_fullsized":"2023-10-14T16:54:55.083539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:33.333473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106735+0000","last_change":"2023-10-14T16:54:55.099120+0000","last_active":"2023-10-14T16:54:55.106735+0000","last_peered":"2023-10-14T16:54:55.106735+0000","last_clean":"2023-10-14T16:54:55.106735+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T16:54:55.106735+0000","last_undegraded":"2023-10-14T16:54:55.106735+0000","last_fullsized":"2023-10-14T16:54:55.106735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090823+0000","last_change":"2023-10-14T16:54:54.100620+0000","last_active":"2023-10-14T16:54:55.090823+0000","last_peered":"2023-10-14T16:54:55.090823+0000","last_clean":"2023-10-14T16:54:55.090823+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T16:54:55.090823+0000","last_undegraded":"2023-10-14T16:54:55.090823+0000","last_fullsized":"2023-10-14T16:54:55.090823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096977+0000","last_change":"2023-10-14T16:54:55.090564+0000","last_active":"2023-10-14T16:54:55.096977+0000","last_peered":"2023-10-14T16:54:55.096977+0000","last_clean":"2023-10-14T16:54:55.096977+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T16:54:55.096977+0000","last_undegraded":"2023-10-14T16:54:55.096977+0000","last_fullsized":"2023-10-14T16:54:55.096977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108412+0000","last_change":"2023-10-14T16:54:54.097908+0000","last_active":"2023-10-14T16:54:55.108412+0000","last_peered":"2023-10-14T16:54:55.108412+0000","last_clean":"2023-10-14T16:54:55.108412+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T16:54:55.108412+0000","last_undegraded":"2023-10-14T16:54:55.108412+0000","last_fullsized":"2023-10-14T16:54:55.108412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110759+0000","last_change":"2023-10-14T16:54:55.104734+0000","last_active":"2023-10-14T16:54:55.110759+0000","last_peered":"2023-10-14T16:54:55.110759+0000","last_clean":"2023-10-14T16:54:55.110759+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T16:54:55.110759+0000","last_undegraded":"2023-10-14T16:54:55.110759+0000","last_fullsized":"2023-10-14T16:54:55.110759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110608+0000","last_change":"2023-10-14T16:54:54.098933+0000","last_active":"2023-10-14T16:54:55.110608+0000","last_peered":"2023-10-14T16:54:55.110608+0000","last_clean":"2023-10-14T16:54:55.110608+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T16:54:55.110608+0000","last_undegraded":"2023-10-14T16:54:55.110608+0000","last_fullsized":"2023-10-14T16:54:55.110608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:47.391039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103770+0000","last_change":"2023-10-14T16:54:55.096816+0000","last_active":"2023-10-14T16:54:55.103770+0000","last_peered":"2023-10-14T16:54:55.103770+0000","last_clean":"2023-10-14T16:54:55.103770+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T16:54:55.103770+0000","last_undegraded":"2023-10-14T16:54:55.103770+0000","last_fullsized":"2023-10-14T16:54:55.103770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106918+0000","last_change":"2023-10-14T16:54:54.103486+0000","last_active":"2023-10-14T16:54:55.106918+0000","last_peered":"2023-10-14T16:54:55.106918+0000","last_clean":"2023-10-14T16:54:55.106918+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T16:54:55.106918+0000","last_undegraded":"2023-10-14T16:54:55.106918+0000","last_fullsized":"2023-10-14T16:54:55.106918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111007+0000","last_change":"2023-10-14T16:54:55.108934+0000","last_active":"2023-10-14T16:54:55.111007+0000","last_peered":"2023-10-14T16:54:55.111007+0000","last_clean":"2023-10-14T16:54:55.111007+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T16:54:55.111007+0000","last_undegraded":"2023-10-14T16:54:55.111007+0000","last_fullsized":"2023-10-14T16:54:55.111007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.081975+0000","last_change":"2023-10-14T16:54:54.098087+0000","last_active":"2023-10-14T16:54:55.081975+0000","last_peered":"2023-10-14T16:54:55.081975+0000","last_clean":"2023-10-14T16:54:55.081975+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T16:54:55.081975+0000","last_undegraded":"2023-10-14T16:54:55.081975+0000","last_fullsized":"2023-10-14T16:54:55.081975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:48.428626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108444+0000","last_change":"2023-10-14T16:54:55.104902+0000","last_active":"2023-10-14T16:54:55.108444+0000","last_peered":"2023-10-14T16:54:55.108444+0000","last_clean":"2023-10-14T16:54:55.108444+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T16:54:55.108444+0000","last_undegraded":"2023-10-14T16:54:55.108444+0000","last_fullsized":"2023-10-14T16:54:55.108444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:21:19.831648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085257+0000","last_change":"2023-10-14T16:54:54.099046+0000","last_active":"2023-10-14T16:54:55.085257+0000","last_peered":"2023-10-14T16:54:55.085257+0000","last_clean":"2023-10-14T16:54:55.085257+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T16:54:55.085257+0000","last_undegraded":"2023-10-14T16:54:55.085257+0000","last_fullsized":"2023-10-14T16:54:55.085257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:13.092692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096397+0000","last_change":"2023-10-14T16:54:55.092929+0000","last_active":"2023-10-14T16:54:55.096397+0000","last_peered":"2023-10-14T16:54:55.096397+0000","last_clean":"2023-10-14T16:54:55.096397+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T16:54:55.096397+0000","last_undegraded":"2023-10-14T16:54:55.096397+0000","last_fullsized":"2023-10-14T16:54:55.096397+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:06.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109884+0000","last_change":"2023-10-14T16:54:54.099281+0000","last_active":"2023-10-14T16:54:55.109884+0000","last_peered":"2023-10-14T16:54:55.109884+0000","last_clean":"2023-10-14T16:54:55.109884+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T16:54:55.109884+0000","last_undegraded":"2023-10-14T16:54:55.109884+0000","last_fullsized":"2023-10-14T16:54:55.109884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103882+0000","last_change":"2023-10-14T16:54:55.099743+0000","last_active":"2023-10-14T16:54:55.103882+0000","last_peered":"2023-10-14T16:54:55.103882+0000","last_clean":"2023-10-14T16:54:55.103882+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T16:54:55.103882+0000","last_undegraded":"2023-10-14T16:54:55.103882+0000","last_fullsized":"2023-10-14T16:54:55.103882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108028+0000","last_change":"2023-10-14T16:54:54.100726+0000","last_active":"2023-10-14T16:54:55.108028+0000","last_peered":"2023-10-14T16:54:55.108028+0000","last_clean":"2023-10-14T16:54:55.108028+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T16:54:55.108028+0000","last_undegraded":"2023-10-14T16:54:55.108028+0000","last_fullsized":"2023-10-14T16:54:55.108028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098409+0000","last_change":"2023-10-14T16:54:55.093470+0000","last_active":"2023-10-14T16:54:55.098409+0000","last_peered":"2023-10-14T16:54:55.098409+0000","last_clean":"2023-10-14T16:54:55.098409+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T16:54:55.098409+0000","last_undegraded":"2023-10-14T16:54:55.098409+0000","last_fullsized":"2023-10-14T16:54:55.098409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.112167+0000","last_change":"2023-10-14T16:54:54.097646+0000","last_active":"2023-10-14T16:54:55.112167+0000","last_peered":"2023-10-14T16:54:55.112167+0000","last_clean":"2023-10-14T16:54:55.112167+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T16:54:55.112167+0000","last_undegraded":"2023-10-14T16:54:55.112167+0000","last_fullsized":"2023-10-14T16:54:55.112167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103764+0000","last_change":"2023-10-14T16:54:55.097471+0000","last_active":"2023-10-14T16:54:55.103764+0000","last_peered":"2023-10-14T16:54:55.103764+0000","last_clean":"2023-10-14T16:54:55.103764+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T16:54:55.103764+0000","last_undegraded":"2023-10-14T16:54:55.103764+0000","last_fullsized":"2023-10-14T16:54:55.103764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108356+0000","last_change":"2023-10-14T16:54:54.100923+0000","last_active":"2023-10-14T16:54:55.108356+0000","last_peered":"2023-10-14T16:54:55.108356+0000","last_clean":"2023-10-14T16:54:55.108356+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T16:54:55.108356+0000","last_undegraded":"2023-10-14T16:54:55.108356+0000","last_fullsized":"2023-10-14T16:54:55.108356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.104043+0000","last_change":"2023-10-14T16:54:55.096945+0000","last_active":"2023-10-14T16:54:55.104043+0000","last_peered":"2023-10-14T16:54:55.104043+0000","last_clean":"2023-10-14T16:54:55.104043+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T16:54:55.104043+0000","last_undegraded":"2023-10-14T16:54:55.104043+0000","last_fullsized":"2023-10-14T16:54:55.104043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.084866+0000","last_change":"2023-10-14T16:54:54.099363+0000","last_active":"2023-10-14T16:54:55.084866+0000","last_peered":"2023-10-14T16:54:55.084866+0000","last_clean":"2023-10-14T16:54:55.084866+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T16:54:55.084866+0000","last_undegraded":"2023-10-14T16:54:55.084866+0000","last_fullsized":"2023-10-14T16:54:55.084866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.124832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099688+0000","last_change":"2023-10-14T16:54:55.097957+0000","last_active":"2023-10-14T16:54:55.099688+0000","last_peered":"2023-10-14T16:54:55.099688+0000","last_clean":"2023-10-14T16:54:55.099688+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T16:54:55.099688+0000","last_undegraded":"2023-10-14T16:54:55.099688+0000","last_fullsized":"2023-10-14T16:54:55.099688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110707+0000","last_change":"2023-10-14T16:54:54.093771+0000","last_active":"2023-10-14T16:54:55.110707+0000","last_peered":"2023-10-14T16:54:55.110707+0000","last_clean":"2023-10-14T16:54:55.110707+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T16:54:55.110707+0000","last_undegraded":"2023-10-14T16:54:55.110707+0000","last_fullsized":"2023-10-14T16:54:55.110707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106694+0000","last_change":"2023-10-14T16:54:55.100663+0000","last_active":"2023-10-14T16:54:55.106694+0000","last_peered":"2023-10-14T16:54:55.106694+0000","last_clean":"2023-10-14T16:54:55.106694+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T16:54:55.106694+0000","last_undegraded":"2023-10-14T16:54:55.106694+0000","last_fullsized":"2023-10-14T16:54:55.106694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085907+0000","last_change":"2023-10-14T16:54:54.103401+0000","last_active":"2023-10-14T16:54:55.085907+0000","last_peered":"2023-10-14T16:54:55.085907+0000","last_clean":"2023-10-14T16:54:55.085907+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T16:54:55.085907+0000","last_undegraded":"2023-10-14T16:54:55.085907+0000","last_fullsized":"2023-10-14T16:54:55.085907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:28.931284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099217+0000","last_change":"2023-10-14T16:54:55.096406+0000","last_active":"2023-10-14T16:54:55.099217+0000","last_peered":"2023-10-14T16:54:55.099217+0000","last_clean":"2023-10-14T16:54:55.099217+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T16:54:55.099217+0000","last_undegraded":"2023-10-14T16:54:55.099217+0000","last_fullsized":"2023-10-14T16:54:55.099217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085465+0000","last_change":"2023-10-14T16:54:54.099084+0000","last_active":"2023-10-14T16:54:55.085465+0000","last_peered":"2023-10-14T16:54:55.085465+0000","last_clean":"2023-10-14T16:54:55.085465+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T16:54:55.085465+0000","last_undegraded":"2023-10-14T16:54:55.085465+0000","last_fullsized":"2023-10-14T16:54:55.085465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:27.318420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096109+0000","last_change":"2023-10-14T16:54:55.094077+0000","last_active":"2023-10-14T16:54:55.096109+0000","last_peered":"2023-10-14T16:54:55.096109+0000","last_clean":"2023-10-14T16:54:55.096109+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T16:54:55.096109+0000","last_undegraded":"2023-10-14T16:54:55.096109+0000","last_fullsized":"2023-10-14T16:54:55.096109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:12.562614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093276+0000","last_change":"2023-10-14T16:54:54.095927+0000","last_active":"2023-10-14T16:54:55.093276+0000","last_peered":"2023-10-14T16:54:55.093276+0000","last_clean":"2023-10-14T16:54:55.093276+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T16:54:55.093276+0000","last_undegraded":"2023-10-14T16:54:55.093276+0000","last_fullsized":"2023-10-14T16:54:55.093276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110839+0000","last_change":"2023-10-14T16:54:55.106702+0000","last_active":"2023-10-14T16:54:55.110839+0000","last_peered":"2023-10-14T16:54:55.110839+0000","last_clean":"2023-10-14T16:54:55.110839+0000","last_became_active":"2023-10-14T16:54:55.105853+0000","last_became_peered":"2023-10-14T16:54:55.105853+0000","last_unstale":"2023-10-14T16:54:55.110839+0000","last_undegraded":"2023-10-14T16:54:55.110839+0000","last_fullsized":"2023-10-14T16:54:55.110839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110438+0000","last_change":"2023-10-14T16:54:54.092032+0000","last_active":"2023-10-14T16:54:55.110438+0000","last_peered":"2023-10-14T16:54:55.110438+0000","last_clean":"2023-10-14T16:54:55.110438+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T16:54:55.110438+0000","last_undegraded":"2023-10-14T16:54:55.110438+0000","last_fullsized":"2023-10-14T16:54:55.110438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090798+0000","last_change":"2023-10-14T16:54:49.689264+0000","last_active":"2023-10-14T16:54:55.090798+0000","last_peered":"2023-10-14T16:54:55.090798+0000","last_clean":"2023-10-14T16:54:55.090798+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T16:54:55.090798+0000","last_undegraded":"2023-10-14T16:54:55.090798+0000","last_fullsized":"2023-10-14T16:54:55.090798+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.097892+0000","last_change":"2023-10-14T16:54:55.092208+0000","last_active":"2023-10-14T16:54:55.097892+0000","last_peered":"2023-10-14T16:54:55.097892+0000","last_clean":"2023-10-14T16:54:55.097892+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T16:54:55.097892+0000","last_undegraded":"2023-10-14T16:54:55.097892+0000","last_fullsized":"2023-10-14T16:54:55.097892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.094564+0000","last_change":"2023-10-14T16:54:49.063336+0000","last_active":"2023-10-14T16:54:55.094564+0000","last_peered":"2023-10-14T16:54:55.094564+0000","last_clean":"2023-10-14T16:54:55.094564+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T16:54:55.094564+0000","last_undegraded":"2023-10-14T16:54:55.094564+0000","last_fullsized":"2023-10-14T16:54:55.094564+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-14T16:54:58.244407+0000","last_change":"2023-10-14T16:54:54.093189+0000","last_active":"2023-10-14T16:54:58.244407+0000","last_peered":"2023-10-14T16:54:58.244407+0000","last_clean":"2023-10-14T16:54:58.244407+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T16:54:58.244407+0000","last_undegraded":"2023-10-14T16:54:58.244407+0000","last_fullsized":"2023-10-14T16:54:58.244407+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:47.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.096057+0000","last_change":"2023-10-14T16:54:55.094019+0000","last_active":"2023-10-14T16:54:55.096057+0000","last_peered":"2023-10-14T16:54:55.096057+0000","last_clean":"2023-10-14T16:54:55.096057+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T16:54:55.096057+0000","last_undegraded":"2023-10-14T16:54:55.096057+0000","last_fullsized":"2023-10-14T16:54:55.096057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:48.395824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.092213+0000","last_change":"2023-10-14T16:54:49.063688+0000","last_active":"2023-10-14T16:54:55.092213+0000","last_peered":"2023-10-14T16:54:55.092213+0000","last_clean":"2023-10-14T16:54:55.092213+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T16:54:55.092213+0000","last_undegraded":"2023-10-14T16:54:55.092213+0000","last_fullsized":"2023-10-14T16:54:55.092213+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:29.004325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'117","reported_seq":163,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085888+0000","last_change":"2023-10-14T16:54:49.063307+0000","last_active":"2023-10-14T16:54:55.085888+0000","last_peered":"2023-10-14T16:54:55.085888+0000","last_clean":"2023-10-14T16:54:55.085888+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T16:54:55.085888+0000","last_undegraded":"2023-10-14T16:54:55.085888+0000","last_fullsized":"2023-10-14T16:54:55.085888+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.080989+0000","last_change":"2023-10-14T16:54:54.098588+0000","last_active":"2023-10-14T16:54:55.080989+0000","last_peered":"2023-10-14T16:54:55.080989+0000","last_clean":"2023-10-14T16:54:55.080989+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T16:54:55.080989+0000","last_undegraded":"2023-10-14T16:54:55.080989+0000","last_fullsized":"2023-10-14T16:54:55.080989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:18.107600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.098839+0000","last_change":"2023-10-14T16:54:55.096261+0000","last_active":"2023-10-14T16:54:55.098839+0000","last_peered":"2023-10-14T16:54:55.098839+0000","last_clean":"2023-10-14T16:54:55.098839+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T16:54:55.098839+0000","last_undegraded":"2023-10-14T16:54:55.098839+0000","last_fullsized":"2023-10-14T16:54:55.098839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090234+0000","last_change":"2023-10-14T16:54:49.689356+0000","last_active":"2023-10-14T16:54:55.090234+0000","last_peered":"2023-10-14T16:54:55.090234+0000","last_clean":"2023-10-14T16:54:55.090234+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T16:54:55.090234+0000","last_undegraded":"2023-10-14T16:54:55.090234+0000","last_fullsized":"2023-10-14T16:54:55.090234+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093393+0000","last_change":"2023-10-14T16:54:54.093196+0000","last_active":"2023-10-14T16:54:55.093393+0000","last_peered":"2023-10-14T16:54:55.093393+0000","last_clean":"2023-10-14T16:54:55.093393+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T16:54:55.093393+0000","last_undegraded":"2023-10-14T16:54:55.093393+0000","last_fullsized":"2023-10-14T16:54:55.093393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.110822+0000","last_change":"2023-10-14T16:54:55.106633+0000","last_active":"2023-10-14T16:54:55.110822+0000","last_peered":"2023-10-14T16:54:55.110822+0000","last_clean":"2023-10-14T16:54:55.110822+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T16:54:55.110822+0000","last_undegraded":"2023-10-14T16:54:55.110822+0000","last_fullsized":"2023-10-14T16:54:55.110822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085827+0000","last_change":"2023-10-14T16:54:49.689595+0000","last_active":"2023-10-14T16:54:55.085827+0000","last_peered":"2023-10-14T16:54:55.085827+0000","last_clean":"2023-10-14T16:54:55.085827+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T16:54:55.085827+0000","last_undegraded":"2023-10-14T16:54:55.085827+0000","last_fullsized":"2023-10-14T16:54:55.085827+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:46:44.177180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.091900+0000","last_change":"2023-10-14T16:54:54.099381+0000","last_active":"2023-10-14T16:54:55.091900+0000","last_peered":"2023-10-14T16:54:55.091900+0000","last_clean":"2023-10-14T16:54:55.091900+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T16:54:55.091900+0000","last_undegraded":"2023-10-14T16:54:55.091900+0000","last_fullsized":"2023-10-14T16:54:55.091900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099236+0000","last_change":"2023-10-14T16:54:55.096667+0000","last_active":"2023-10-14T16:54:55.099236+0000","last_peered":"2023-10-14T16:54:55.099236+0000","last_clean":"2023-10-14T16:54:55.099236+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T16:54:55.099236+0000","last_undegraded":"2023-10-14T16:54:55.099236+0000","last_fullsized":"2023-10-14T16:54:55.099236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085362+0000","last_change":"2023-10-14T16:54:49.689614+0000","last_active":"2023-10-14T16:54:55.085362+0000","last_peered":"2023-10-14T16:54:55.085362+0000","last_clean":"2023-10-14T16:54:55.085362+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T16:54:55.085362+0000","last_undegraded":"2023-10-14T16:54:55.085362+0000","last_fullsized":"2023-10-14T16:54:55.085362+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:09.272835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090680+0000","last_change":"2023-10-14T16:54:54.100656+0000","last_active":"2023-10-14T16:54:55.090680+0000","last_peered":"2023-10-14T16:54:55.090680+0000","last_clean":"2023-10-14T16:54:55.090680+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T16:54:55.090680+0000","last_undegraded":"2023-10-14T16:54:55.090680+0000","last_fullsized":"2023-10-14T16:54:55.090680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111077+0000","last_change":"2023-10-14T16:54:55.109319+0000","last_active":"2023-10-14T16:54:55.111077+0000","last_peered":"2023-10-14T16:54:55.111077+0000","last_clean":"2023-10-14T16:54:55.111077+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T16:54:55.111077+0000","last_undegraded":"2023-10-14T16:54:55.111077+0000","last_fullsized":"2023-10-14T16:54:55.111077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.087246+0000","last_change":"2023-10-14T16:54:49.689836+0000","last_active":"2023-10-14T16:54:55.087246+0000","last_peered":"2023-10-14T16:54:55.087246+0000","last_clean":"2023-10-14T16:54:55.087246+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T16:54:55.087246+0000","last_undegraded":"2023-10-14T16:54:55.087246+0000","last_fullsized":"2023-10-14T16:54:55.087246+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:24.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.094686+0000","last_change":"2023-10-14T16:54:54.096618+0000","last_active":"2023-10-14T16:54:55.094686+0000","last_peered":"2023-10-14T16:54:55.094686+0000","last_clean":"2023-10-14T16:54:55.094686+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T16:54:55.094686+0000","last_undegraded":"2023-10-14T16:54:55.094686+0000","last_fullsized":"2023-10-14T16:54:55.094686+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.093329+0000","last_change":"2023-10-14T16:54:55.090211+0000","last_active":"2023-10-14T16:54:55.093329+0000","last_peered":"2023-10-14T16:54:55.093329+0000","last_clean":"2023-10-14T16:54:55.093329+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T16:54:55.093329+0000","last_undegraded":"2023-10-14T16:54:55.093329+0000","last_fullsized":"2023-10-14T16:54:55.093329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.085714+0000","last_change":"2023-10-14T16:54:49.064767+0000","last_active":"2023-10-14T16:54:55.085714+0000","last_peered":"2023-10-14T16:54:55.085714+0000","last_clean":"2023-10-14T16:54:55.085714+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T16:54:55.085714+0000","last_undegraded":"2023-10-14T16:54:55.085714+0000","last_fullsized":"2023-10-14T16:54:55.085714+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:34:26.616500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.090367+0000","last_change":"2023-10-14T16:54:54.106280+0000","last_active":"2023-10-14T16:54:55.090367+0000","last_peered":"2023-10-14T16:54:55.090367+0000","last_clean":"2023-10-14T16:54:55.090367+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T16:54:55.090367+0000","last_undegraded":"2023-10-14T16:54:55.090367+0000","last_fullsized":"2023-10-14T16:54:55.090367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107145+0000","last_change":"2023-10-14T16:54:55.100415+0000","last_active":"2023-10-14T16:54:55.107145+0000","last_peered":"2023-10-14T16:54:55.107145+0000","last_clean":"2023-10-14T16:54:55.107145+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T16:54:55.107145+0000","last_undegraded":"2023-10-14T16:54:55.107145+0000","last_fullsized":"2023-10-14T16:54:55.107145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107282+0000","last_change":"2023-10-14T16:54:54.102987+0000","last_active":"2023-10-14T16:54:55.107282+0000","last_peered":"2023-10-14T16:54:55.107282+0000","last_clean":"2023-10-14T16:54:55.107282+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T16:54:55.107282+0000","last_undegraded":"2023-10-14T16:54:55.107282+0000","last_fullsized":"2023-10-14T16:54:55.107282+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111066+0000","last_change":"2023-10-14T16:54:55.109338+0000","last_active":"2023-10-14T16:54:55.111066+0000","last_peered":"2023-10-14T16:54:55.111066+0000","last_clean":"2023-10-14T16:54:55.111066+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T16:54:55.111066+0000","last_undegraded":"2023-10-14T16:54:55.111066+0000","last_fullsized":"2023-10-14T16:54:55.111066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108122+0000","last_change":"2023-10-14T16:54:54.095975+0000","last_active":"2023-10-14T16:54:55.108122+0000","last_peered":"2023-10-14T16:54:55.108122+0000","last_clean":"2023-10-14T16:54:55.108122+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T16:54:55.108122+0000","last_undegraded":"2023-10-14T16:54:55.108122+0000","last_fullsized":"2023-10-14T16:54:55.108122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.105361+0000","last_change":"2023-10-14T16:54:55.098957+0000","last_active":"2023-10-14T16:54:55.105361+0000","last_peered":"2023-10-14T16:54:55.105361+0000","last_clean":"2023-10-14T16:54:55.105361+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T16:54:55.105361+0000","last_undegraded":"2023-10-14T16:54:55.105361+0000","last_fullsized":"2023-10-14T16:54:55.105361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.107000+0000","last_change":"2023-10-14T16:54:54.103049+0000","last_active":"2023-10-14T16:54:55.107000+0000","last_peered":"2023-10-14T16:54:55.107000+0000","last_clean":"2023-10-14T16:54:55.107000+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T16:54:55.107000+0000","last_undegraded":"2023-10-14T16:54:55.107000+0000","last_fullsized":"2023-10-14T16:54:55.107000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:17:46.369733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.104062+0000","last_change":"2023-10-14T16:54:55.097880+0000","last_active":"2023-10-14T16:54:55.104062+0000","last_peered":"2023-10-14T16:54:55.104062+0000","last_clean":"2023-10-14T16:54:55.104062+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T16:54:55.104062+0000","last_undegraded":"2023-10-14T16:54:55.104062+0000","last_fullsized":"2023-10-14T16:54:55.104062+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.106336+0000","last_change":"2023-10-14T16:54:54.095418+0000","last_active":"2023-10-14T16:54:55.106336+0000","last_peered":"2023-10-14T16:54:55.106336+0000","last_clean":"2023-10-14T16:54:55.106336+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T16:54:55.106336+0000","last_undegraded":"2023-10-14T16:54:55.106336+0000","last_fullsized":"2023-10-14T16:54:55.106336+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:42.952466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099715+0000","last_change":"2023-10-14T16:54:55.097431+0000","last_active":"2023-10-14T16:54:55.099715+0000","last_peered":"2023-10-14T16:54:55.099715+0000","last_clean":"2023-10-14T16:54:55.099715+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T16:54:55.099715+0000","last_undegraded":"2023-10-14T16:54:55.099715+0000","last_fullsized":"2023-10-14T16:54:55.099715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109535+0000","last_change":"2023-10-14T16:54:54.098491+0000","last_active":"2023-10-14T16:54:55.109535+0000","last_peered":"2023-10-14T16:54:55.109535+0000","last_clean":"2023-10-14T16:54:55.109535+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T16:54:55.109535+0000","last_undegraded":"2023-10-14T16:54:55.109535+0000","last_fullsized":"2023-10-14T16:54:55.109535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108426+0000","last_change":"2023-10-14T16:54:55.107411+0000","last_active":"2023-10-14T16:54:55.108426+0000","last_peered":"2023-10-14T16:54:55.108426+0000","last_clean":"2023-10-14T16:54:55.108426+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T16:54:55.108426+0000","last_undegraded":"2023-10-14T16:54:55.108426+0000","last_fullsized":"2023-10-14T16:54:55.108426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.109637+0000","last_change":"2023-10-14T16:54:55.107839+0000","last_active":"2023-10-14T16:54:55.109637+0000","last_peered":"2023-10-14T16:54:55.109637+0000","last_clean":"2023-10-14T16:54:55.109637+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T16:54:55.109637+0000","last_undegraded":"2023-10-14T16:54:55.109637+0000","last_fullsized":"2023-10-14T16:54:55.109637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.103549+0000","last_change":"2023-10-14T16:54:55.094659+0000","last_active":"2023-10-14T16:54:55.103549+0000","last_peered":"2023-10-14T16:54:55.103549+0000","last_clean":"2023-10-14T16:54:55.103549+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T16:54:55.103549+0000","last_undegraded":"2023-10-14T16:54:55.103549+0000","last_fullsized":"2023-10-14T16:54:55.103549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.108453+0000","last_change":"2023-10-14T16:54:55.105319+0000","last_active":"2023-10-14T16:54:55.108453+0000","last_peered":"2023-10-14T16:54:55.108453+0000","last_clean":"2023-10-14T16:54:55.108453+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T16:54:55.108453+0000","last_undegraded":"2023-10-14T16:54:55.108453+0000","last_fullsized":"2023-10-14T16:54:55.108453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.099672+0000","last_change":"2023-10-14T16:54:55.097385+0000","last_active":"2023-10-14T16:54:55.099672+0000","last_peered":"2023-10-14T16:54:55.099672+0000","last_clean":"2023-10-14T16:54:55.099672+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T16:54:55.099672+0000","last_undegraded":"2023-10-14T16:54:55.099672+0000","last_fullsized":"2023-10-14T16:54:55.099672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T16:54:55.111056+0000","last_change":"2023-10-14T16:54:55.109138+0000","last_active":"2023-10-14T16:54:55.111056+0000","last_peered":"2023-10-14T16:54:55.111056+0000","last_clean":"2023-10-14T16:54:55.111056+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T16:54:55.111056+0000","last_undegraded":"2023-10-14T16:54:55.111056+0000","last_fullsized":"2023-10-14T16:54:55.111056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298044,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073796,"statfs":{"total":96636764160,"available":96331567104,"internally_reserved":0,"allocated":774144,"data_stored":642998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":176128,"data_stored":52096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":163840,"data_stored":51128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298016,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073824,"statfs":{"total":96636764160,"available":96331595776,"internally_reserved":0,"allocated":745472,"data_stored":640782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T16:55:03.520 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T16:55:03.521 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T16:55:03.521 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T16:55:03.521 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T16:55:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.672+0000 7f66456dc700 1 Processor -- start 2023-10-14T16:55:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.672+0000 7f66456dc700 1 -- start start 2023-10-14T16:55:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.672+0000 7f66456dc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f664009a0d0 0x7f664006dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.672+0000 7f66456dc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6640069bf0 0x7f664013e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.672+0000 7f66456dc700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664006aaa0 con 0x7f6640069080 2023-10-14T16:55:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.672+0000 7f66456dc700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664006f450 con 0x7f6640069bf0 2023-10-14T16:55:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.672+0000 7f66456dc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664006b090 con 0x7f664009a0d0 2023-10-14T16:55:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f6644edb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6640069bf0 0x7f664013e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f6644edb700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6640069bf0 0x7f664013e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53470/0 (socket says 172.21.15.8:53470) 2023-10-14T16:55:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f6644edb700 1 -- 172.21.15.8:0/3322729760 learned_addr learned my addr 172.21.15.8:0/3322729760 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f663f7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6640069080 0x7f66400694e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42466/0 (socket says 172.21.15.8:42466) 2023-10-14T16:55:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f663ffff700 1 --2- 172.21.15.8:0/3322729760 >> v2:172.21.15.155:3300/0 conn(0x7f664009a0d0 0x7f664006dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f6644edb700 1 -- 172.21.15.8:0/3322729760 >> v2:172.21.15.155:3300/0 conn(0x7f664009a0d0 msgr2=0x7f664006dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f6644edb700 1 --2- 172.21.15.8:0/3322729760 >> v2:172.21.15.155:3300/0 conn(0x7f664009a0d0 0x7f664006dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f6644edb700 1 -- 172.21.15.8:0/3322729760 >> v1:172.21.15.8:6789/0 conn(0x7f6640069080 legacy=0x7f66400694e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f6644edb700 1 -- 172.21.15.8:0/3322729760 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664006d320 con 0x7f6640069bf0 2023-10-14T16:55:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f663effd700 1 -- 172.21.15.8:0/3322729760 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857771954 0 0) 0x7f664006aaa0 con 0x7f6640069080 2023-10-14T16:55:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f6644edb700 1 --2- 172.21.15.8:0/3322729760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6640069bf0 0x7f664013e160 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f664009a590 tx=0x7f6638009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad477781a8fad1b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:03.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f663effd700 1 -- 172.21.15.8:0/3322729760 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800e070 con 0x7f6640069bf0 2023-10-14T16:55:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f663effd700 1 -- 172.21.15.8:0/3322729760 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663800ba20 con 0x7f6640069bf0 2023-10-14T16:55:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.673+0000 7f663effd700 1 -- 172.21.15.8:0/3322729760 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380092e0 con 0x7f6640069bf0 2023-10-14T16:55:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.674+0000 7f66456dc700 1 -- 172.21.15.8:0/3322729760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6640069bf0 msgr2=0x7f664013e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.674+0000 7f66456dc700 1 --2- 172.21.15.8:0/3322729760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6640069bf0 0x7f664013e160 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f664009a590 tx=0x7f6638009840 comp rx=0 tx=0).stop 2023-10-14T16:55:03.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.674+0000 7f66456dc700 1 -- 172.21.15.8:0/3322729760 shutdown_connections 2023-10-14T16:55:03.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.674+0000 7f66456dc700 1 --2- 172.21.15.8:0/3322729760 >> v2:172.21.15.155:3300/0 conn(0x7f664009a0d0 0x7f664006dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.674+0000 7f66456dc700 1 --2- 172.21.15.8:0/3322729760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6640069bf0 0x7f664013e160 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.674+0000 7f66456dc700 1 -- 172.21.15.8:0/3322729760 >> 172.21.15.8:0/3322729760 conn(0x7f66400703b0 msgr2=0x7f66400707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:03.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.674+0000 7f66456dc700 1 -- 172.21.15.8:0/3322729760 shutdown_connections 2023-10-14T16:55:03.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.674+0000 7f66456dc700 1 -- 172.21.15.8:0/3322729760 wait complete. 2023-10-14T16:55:03.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f66456dc700 1 Processor -- start 2023-10-14T16:55:03.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f66456dc700 1 -- start start 2023-10-14T16:55:03.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f66456dc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6640069080 0x7f66401306c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:03.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f66456dc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6640069bf0 0x7f6640130c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:03.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f66456dc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664009e360 0x7f664009bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:03.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f66456dc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66400a01e0 con 0x7f6640069bf0 2023-10-14T16:55:03.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f66456dc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664009f820 con 0x7f664009e360 2023-10-14T16:55:03.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f66456dc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66400a06b0 con 0x7f6640069080 2023-10-14T16:55:03.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f663f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6640069bf0 0x7f6640130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:03.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f663f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6640069bf0 0x7f6640130c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53478/0 (socket says 172.21.15.8:53478) 2023-10-14T16:55:03.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f663f7fe700 1 -- 172.21.15.8:0/774414352 learned_addr learned my addr 172.21.15.8:0/774414352 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:03.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f663ffff700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6640069080 0x7f66401306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:03.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.675+0000 7f6644edb700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664009e360 0x7f664009bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:03.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.676+0000 7f663f7fe700 1 -- 172.21.15.8:0/774414352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6640069080 msgr2=0x7f66401306c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.676+0000 7f663f7fe700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6640069080 0x7f66401306c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.676+0000 7f663f7fe700 1 -- 172.21.15.8:0/774414352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664009e360 msgr2=0x7f664009bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.676+0000 7f663f7fe700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664009e360 0x7f664009bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.676+0000 7f663f7fe700 1 -- 172.21.15.8:0/774414352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638009ae0 con 0x7f6640069bf0 2023-10-14T16:55:03.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.676+0000 7f6644edb700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664009e360 0x7f664009bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:03.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.676+0000 7f663f7fe700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6640069bf0 0x7f6640130c00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f66340011e0 tx=0x7f6634007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:03.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.676+0000 7f6627fff700 1 -- 172.21.15.8:0/774414352 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634005a70 con 0x7f6640069bf0 2023-10-14T16:55:03.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.676+0000 7f6627fff700 1 -- 172.21.15.8:0/774414352 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6634005bd0 con 0x7f6640069bf0 2023-10-14T16:55:03.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.676+0000 7f66456dc700 1 -- 172.21.15.8:0/774414352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66400a03f0 con 0x7f6640069bf0 2023-10-14T16:55:03.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.676+0000 7f6627fff700 1 -- 172.21.15.8:0/774414352 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66340070d0 con 0x7f6640069bf0 2023-10-14T16:55:03.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.676+0000 7f66456dc700 1 -- 172.21.15.8:0/774414352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664009fb20 con 0x7f6640069bf0 2023-10-14T16:55:03.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.677+0000 7f66456dc700 1 -- 172.21.15.8:0/774414352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6640070ec0 con 0x7f6640069bf0 2023-10-14T16:55:03.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.677+0000 7f6627fff700 1 -- 172.21.15.8:0/774414352 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66340074c0 con 0x7f6640069bf0 2023-10-14T16:55:03.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.678+0000 7f6627fff700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f662c066f30 0x7f662c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:03.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.678+0000 7f6627fff700 1 -- 172.21.15.8:0/774414352 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f6634083370 con 0x7f6640069bf0 2023-10-14T16:55:03.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.678+0000 7f663ffff700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f662c066f30 0x7f662c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:03.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.678+0000 7f663ffff700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f662c066f30 0x7f662c0693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6630009d10 tx=0x7f66300091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:03.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.682+0000 7f6627fff700 1 -- 172.21.15.8:0/774414352 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f663404b5a0 con 0x7f6640069bf0 2023-10-14T16:55:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.914+0000 7f66456dc700 1 -- 172.21.15.8:0/774414352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f66400639b0 con 0x7f6640069bf0 2023-10-14T16:55:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.915+0000 7f6627fff700 1 -- 172.21.15.8:0/774414352 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6634017040 con 0x7f6640069bf0 2023-10-14T16:55:03.916 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:55:03.916 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T16:55:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.917+0000 7f66456dc700 1 -- 172.21.15.8:0/774414352 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f662c066f30 msgr2=0x7f662c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.917+0000 7f66456dc700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f662c066f30 0x7f662c0693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6630009d10 tx=0x7f66300091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.917+0000 7f66456dc700 1 -- 172.21.15.8:0/774414352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6640069bf0 msgr2=0x7f6640130c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:03.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.917+0000 7f66456dc700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6640069bf0 0x7f6640130c00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f66340011e0 tx=0x7f6634007e10 comp rx=0 tx=0).stop 2023-10-14T16:55:03.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.917+0000 7f66456dc700 1 -- 172.21.15.8:0/774414352 shutdown_connections 2023-10-14T16:55:03.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.917+0000 7f66456dc700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f662c066f30 0x7f662c0693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.917+0000 7f66456dc700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f664009e360 0x7f664009bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.917+0000 7f66456dc700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6640069080 0x7f66401306c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.917+0000 7f66456dc700 1 --2- 172.21.15.8:0/774414352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6640069bf0 0x7f6640130c00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:03.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.917+0000 7f66456dc700 1 -- 172.21.15.8:0/774414352 >> 172.21.15.8:0/774414352 conn(0x7f66400703b0 msgr2=0x7f6640139ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:03.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.917+0000 7f66456dc700 1 -- 172.21.15.8:0/774414352 shutdown_connections 2023-10-14T16:55:03.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:03.917+0000 7f66456dc700 1 -- 172.21.15.8:0/774414352 wait complete. 2023-10-14T16:55:03.929 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T16:55:03.930 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T16:55:04.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.047+0000 7f7a533ec700 1 Processor -- start 2023-10-14T16:55:04.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.047+0000 7f7a533ec700 1 -- start start 2023-10-14T16:55:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a533ec700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7a4c0a5350 0x7f7a4c13bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a533ec700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c0a0d30 con 0x7f7a4c13c1e0 2023-10-14T16:55:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a533ec700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c0a4850 con 0x7f7a4c0a6a70 2023-10-14T16:55:04.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a533ec700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c0a2a40 con 0x7f7a4c0a5350 2023-10-14T16:55:04.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a52beb700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7a4c13c1e0 0x7f7a4c13e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42468/0 (socket says 172.21.15.8:42468) 2023-10-14T16:55:04.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a52beb700 1 -- 172.21.15.8:0/3946612560 learned_addr learned my addr 172.21.15.8:0/3946612560 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:04.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a51be9700 1 --2- 172.21.15.8:0/3946612560 >> v2:172.21.15.155:3300/0 conn(0x7f7a4c0a5350 0x7f7a4c13bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025496295 0 0) 0x7f7a4c0a0d30 con 0x7f7a4c13c1e0 2023-10-14T16:55:04.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a34003570 con 0x7f7a4c13c1e0 2023-10-14T16:55:04.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1685711172 0 0) 0x7f7a34003570 con 0x7f7a4c13c1e0 2023-10-14T16:55:04.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 >> v2:172.21.15.155:3300/0 conn(0x7f7a4c0a5350 msgr2=0x7f7a4c13bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:04.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 --2- 172.21.15.8:0/3946612560 >> v2:172.21.15.155:3300/0 conn(0x7f7a4c0a5350 0x7f7a4c13bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 >> v1:172.21.15.155:6789/0 conn(0x7f7a4c0a6a70 legacy=0x7f7a4c0a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0a18c0 con 0x7f7a4c13c1e0 2023-10-14T16:55:04.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f7a3c001470 con 0x7f7a4c13c1e0 2023-10-14T16:55:04.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 >> v1:172.21.15.8:6789/0 conn(0x7f7a4c13c1e0 legacy=0x7f7a4c13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 --2- 172.21.15.8:0/3946612560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 0x7f7a34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 --2- 172.21.15.8:0/3946612560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a34004810 0x7f7a34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 --2- 172.21.15.8:0/3946612560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a340052e0 0x7f7a3400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0a2a40 con 0x7f7a34003a60 2023-10-14T16:55:04.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3400c2a0 con 0x7f7a34004810 2023-10-14T16:55:04.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3400c460 con 0x7f7a340052e0 2023-10-14T16:55:04.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.048+0000 7f7a523ea700 1 --2- 172.21.15.8:0/3946612560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 0x7f7a34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a51be9700 1 --2- 172.21.15.8:0/3946612560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a34004810 0x7f7a34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a52beb700 1 --2- 172.21.15.8:0/3946612560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a340052e0 0x7f7a3400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a523ea700 1 -- 172.21.15.8:0/3946612560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a340052e0 msgr2=0x7f7a3400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:04.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a523ea700 1 --2- 172.21.15.8:0/3946612560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a340052e0 0x7f7a3400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a523ea700 1 -- 172.21.15.8:0/3946612560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a34004810 msgr2=0x7f7a34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:04.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a523ea700 1 --2- 172.21.15.8:0/3946612560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a34004810 0x7f7a34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a523ea700 1 -- 172.21.15.8:0/3946612560 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34003570 con 0x7f7a34003a60 2023-10-14T16:55:04.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a52beb700 1 --2- 172.21.15.8:0/3946612560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a340052e0 0x7f7a3400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:04.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a52beb700 1 -- 172.21.15.8:0/3946612560 reap_dead start 2023-10-14T16:55:04.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a523ea700 1 --2- 172.21.15.8:0/3946612560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 0x7f7a34003e70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7a44001fc0 tx=0x7f7a44001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26911622e444b854 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:04.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44001950 con 0x7f7a34003a60 2023-10-14T16:55:04.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4400c8b0 con 0x7f7a34003a60 2023-10-14T16:55:04.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.049+0000 7f7a513e8700 1 -- 172.21.15.8:0/3946612560 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4400cc50 con 0x7f7a34003a60 2023-10-14T16:55:04.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.050+0000 7f7a533ec700 1 -- 172.21.15.8:0/3946612560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 msgr2=0x7f7a34003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.050+0000 7f7a533ec700 1 --2- 172.21.15.8:0/3946612560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 0x7f7a34003e70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7a44001fc0 tx=0x7f7a44001640 comp rx=0 tx=0).stop 2023-10-14T16:55:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.050+0000 7f7a533ec700 1 -- 172.21.15.8:0/3946612560 shutdown_connections 2023-10-14T16:55:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.050+0000 7f7a533ec700 1 --2- 172.21.15.8:0/3946612560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 0x7f7a34003e70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.050+0000 7f7a533ec700 1 -- 172.21.15.8:0/3946612560 >> 172.21.15.8:0/3946612560 conn(0x7f7a4c06a960 msgr2=0x7f7a4c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.050+0000 7f7a533ec700 1 -- 172.21.15.8:0/3946612560 shutdown_connections 2023-10-14T16:55:04.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.050+0000 7f7a533ec700 1 -- 172.21.15.8:0/3946612560 wait complete. 2023-10-14T16:55:04.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a533ec700 1 Processor -- start 2023-10-14T16:55:04.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a533ec700 1 -- start start 2023-10-14T16:55:04.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a533ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 0x7f7a4c096e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a533ec700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a4c09b830 0x7f7a4c097360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a533ec700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a4c09a5f0 0x7f7a4c0978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a533ec700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c09bd50 con 0x7f7a34003a60 2023-10-14T16:55:04.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a533ec700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c09abd0 con 0x7f7a4c09a5f0 2023-10-14T16:55:04.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a533ec700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c09b170 con 0x7f7a4c09b830 2023-10-14T16:55:04.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a523ea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 0x7f7a4c096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a523ea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 0x7f7a4c096e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53490/0 (socket says 172.21.15.8:53490) 2023-10-14T16:55:04.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a523ea700 1 -- 172.21.15.8:0/2003435443 learned_addr learned my addr 172.21.15.8:0/2003435443 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:04.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a51be9700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a4c09b830 0x7f7a4c097360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a52beb700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a4c09a5f0 0x7f7a4c0978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a523ea700 1 -- 172.21.15.8:0/2003435443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a4c09b830 msgr2=0x7f7a4c097360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.051+0000 7f7a523ea700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a4c09b830 0x7f7a4c097360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.052+0000 7f7a523ea700 1 -- 172.21.15.8:0/2003435443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a4c09a5f0 msgr2=0x7f7a4c0978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.052+0000 7f7a523ea700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a4c09a5f0 0x7f7a4c0978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.052+0000 7f7a523ea700 1 -- 172.21.15.8:0/2003435443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c097ed0 con 0x7f7a34003a60 2023-10-14T16:55:04.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.052+0000 7f7a523ea700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 0x7f7a4c096e20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400c6a0 tx=0x7f7a44015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:04.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.052+0000 7f7a4a7fc700 1 -- 172.21.15.8:0/2003435443 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44001950 con 0x7f7a34003a60 2023-10-14T16:55:04.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.052+0000 7f7a4a7fc700 1 -- 172.21.15.8:0/2003435443 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4400c6d0 con 0x7f7a34003a60 2023-10-14T16:55:04.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.052+0000 7f7a533ec700 1 -- 172.21.15.8:0/2003435443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c098170 con 0x7f7a34003a60 2023-10-14T16:55:04.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.052+0000 7f7a4a7fc700 1 -- 172.21.15.8:0/2003435443 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44026630 con 0x7f7a34003a60 2023-10-14T16:55:04.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.052+0000 7f7a533ec700 1 -- 172.21.15.8:0/2003435443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c146650 con 0x7f7a34003a60 2023-10-14T16:55:04.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.053+0000 7f7a533ec700 1 -- 172.21.15.8:0/2003435443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c06ad60 con 0x7f7a34003a60 2023-10-14T16:55:04.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.053+0000 7f7a4a7fc700 1 -- 172.21.15.8:0/2003435443 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a44019030 con 0x7f7a34003a60 2023-10-14T16:55:04.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.053+0000 7f7a4a7fc700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7a38066f60 0x7f7a38069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.054+0000 7f7a4a7fc700 1 -- 172.21.15.8:0/2003435443 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f7a44085a40 con 0x7f7a34003a60 2023-10-14T16:55:04.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.054+0000 7f7a51be9700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7a38066f60 0x7f7a38069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.054+0000 7f7a51be9700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7a38066f60 0x7f7a38069410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c098630 tx=0x7f7a400091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:04.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.058+0000 7f7a4a7fc700 1 -- 172.21.15.8:0/2003435443 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a44053230 con 0x7f7a34003a60 2023-10-14T16:55:04.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.252+0000 7f7a533ec700 1 -- 172.21.15.8:0/2003435443 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a4c134f30 con 0x7f7a34003a60 2023-10-14T16:55:04.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.253+0000 7f7a4a7fc700 1 -- 172.21.15.8:0/2003435443 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12158 (secure 0 0 0) 0x7f7a44017090 con 0x7f7a34003a60 2023-10-14T16:55:04.254 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:55:04.254 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:56.078671+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-14T16:54:52.330193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-14T16:54:53.459270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:55:04.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.255+0000 7f7a533ec700 1 -- 172.21.15.8:0/2003435443 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7a38066f60 msgr2=0x7f7a38069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.255+0000 7f7a533ec700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7a38066f60 0x7f7a38069410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c098630 tx=0x7f7a400091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.255+0000 7f7a533ec700 1 -- 172.21.15.8:0/2003435443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 msgr2=0x7f7a4c096e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.255+0000 7f7a533ec700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 0x7f7a4c096e20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400c6a0 tx=0x7f7a44015000 comp rx=0 tx=0).stop 2023-10-14T16:55:04.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.255+0000 7f7a533ec700 1 -- 172.21.15.8:0/2003435443 shutdown_connections 2023-10-14T16:55:04.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.255+0000 7f7a533ec700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7a38066f60 0x7f7a38069410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.255+0000 7f7a533ec700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a4c09a5f0 0x7f7a4c0978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.255+0000 7f7a533ec700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a34003a60 0x7f7a4c096e20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.255+0000 7f7a533ec700 1 --2- 172.21.15.8:0/2003435443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a4c09b830 0x7f7a4c097360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.255+0000 7f7a533ec700 1 -- 172.21.15.8:0/2003435443 >> 172.21.15.8:0/2003435443 conn(0x7f7a4c06a960 msgr2=0x7f7a4c0a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:04.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.255+0000 7f7a533ec700 1 -- 172.21.15.8:0/2003435443 shutdown_connections 2023-10-14T16:55:04.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.255+0000 7f7a533ec700 1 -- 172.21.15.8:0/2003435443 wait complete. 2023-10-14T16:55:04.268 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-14T16:54:47.365008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-14T16:54:48.035513+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T16:54:52.330193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T16:54:53.459270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T16:55:04.269 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-14T16:55:04.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.389+0000 7f517d626700 1 Processor -- start 2023-10-14T16:55:04.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.389+0000 7f517d626700 1 -- start start 2023-10-14T16:55:04.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f517d626700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51780a6990 0x7f51781371d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f517d626700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f51780a46b0 0x7f51780a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f517d626700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51780a5030 0x7f517813dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f517d626700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51780a5ed0 con 0x7f51780a46b0 2023-10-14T16:55:04.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f517d626700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5178097400 con 0x7f51780a6990 2023-10-14T16:55:04.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f517d626700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5178096160 con 0x7f51780a5030 2023-10-14T16:55:04.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f51767fc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f51780a46b0 0x7f51780a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f51767fc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f51780a46b0 0x7f51780a4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53500/0 (socket says 172.21.15.8:53500) 2023-10-14T16:55:04.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f51767fc700 1 -- 172.21.15.8:0/2455198774 learned_addr learned my addr 172.21.15.8:0/2455198774 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:04.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f5176ffd700 1 --2- 172.21.15.8:0/2455198774 >> v2:172.21.15.155:3300/0 conn(0x7f51780a6990 0x7f51781371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f51777fe700 1 --2- 172.21.15.8:0/2455198774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51780a5030 0x7f517813dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f51767fc700 1 -- 172.21.15.8:0/2455198774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51780a5030 msgr2=0x7f517813dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:04.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f51767fc700 1 --2- 172.21.15.8:0/2455198774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51780a5030 0x7f517813dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f51767fc700 1 -- 172.21.15.8:0/2455198774 >> v2:172.21.15.155:3300/0 conn(0x7f51780a6990 msgr2=0x7f51781371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:04.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f51767fc700 1 --2- 172.21.15.8:0/2455198774 >> v2:172.21.15.155:3300/0 conn(0x7f51780a6990 0x7f51781371d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f51767fc700 1 -- 172.21.15.8:0/2455198774 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51780a6130 con 0x7f51780a46b0 2023-10-14T16:55:04.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f51767fc700 1 --2- 172.21.15.8:0/2455198774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51780a46b0 0x7f51780a4af0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f517806b040 tx=0x7f5160009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa446ed95c85ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:04.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f5175ffb700 1 -- 172.21.15.8:0/2455198774 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516000b860 con 0x7f51780a46b0 2023-10-14T16:55:04.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f5175ffb700 1 -- 172.21.15.8:0/2455198774 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516000b9c0 con 0x7f51780a46b0 2023-10-14T16:55:04.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.390+0000 7f5175ffb700 1 -- 172.21.15.8:0/2455198774 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516000bd60 con 0x7f51780a46b0 2023-10-14T16:55:04.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.391+0000 7f517d626700 1 -- 172.21.15.8:0/2455198774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51780a46b0 msgr2=0x7f51780a4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.391+0000 7f517d626700 1 --2- 172.21.15.8:0/2455198774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51780a46b0 0x7f51780a4af0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f517806b040 tx=0x7f5160009250 comp rx=0 tx=0).stop 2023-10-14T16:55:04.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.391+0000 7f517d626700 1 -- 172.21.15.8:0/2455198774 shutdown_connections 2023-10-14T16:55:04.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.391+0000 7f517d626700 1 --2- 172.21.15.8:0/2455198774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51780a5030 0x7f517813dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.391+0000 7f517d626700 1 --2- 172.21.15.8:0/2455198774 >> v2:172.21.15.155:3300/0 conn(0x7f51780a6990 0x7f51781371d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.391+0000 7f517d626700 1 --2- 172.21.15.8:0/2455198774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51780a46b0 0x7f51780a4af0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.391+0000 7f517d626700 1 -- 172.21.15.8:0/2455198774 >> 172.21.15.8:0/2455198774 conn(0x7f517806a820 msgr2=0x7f51780701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:04.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.391+0000 7f517d626700 1 -- 172.21.15.8:0/2455198774 shutdown_connections 2023-10-14T16:55:04.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.391+0000 7f517d626700 1 -- 172.21.15.8:0/2455198774 wait complete. 2023-10-14T16:55:04.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.392+0000 7f517d626700 1 Processor -- start 2023-10-14T16:55:04.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.392+0000 7f517d626700 1 -- start start 2023-10-14T16:55:04.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.392+0000 7f517d626700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51780a46b0 0x7f517809d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f5176ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51780a46b0 0x7f517809d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f5176ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51780a46b0 0x7f517809d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53514/0 (socket says 172.21.15.8:53514) 2023-10-14T16:55:04.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f517d626700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51780a5030 0x7f517809dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f5176ffd700 1 -- 172.21.15.8:0/2892747961 learned_addr learned my addr 172.21.15.8:0/2892747961 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:04.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f517d626700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5178133d00 0x7f517809e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51780a3fe0 con 0x7f51780a46b0 2023-10-14T16:55:04.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51780a6390 con 0x7f5178133d00 2023-10-14T16:55:04.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51780a0220 con 0x7f51780a5030 2023-10-14T16:55:04.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f51777fe700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5178133d00 0x7f517809e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f51767fc700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51780a5030 0x7f517809dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f5176ffd700 1 -- 172.21.15.8:0/2892747961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51780a5030 msgr2=0x7f517809dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f5176ffd700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51780a5030 0x7f517809dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f5176ffd700 1 -- 172.21.15.8:0/2892747961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5178133d00 msgr2=0x7f517809e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f5176ffd700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5178133d00 0x7f517809e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f5176ffd700 1 -- 172.21.15.8:0/2892747961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51600094f0 con 0x7f51780a46b0 2023-10-14T16:55:04.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f51777fe700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5178133d00 0x7f517809e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:04.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f5176ffd700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51780a46b0 0x7f517809d810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f516800e0e0 tx=0x7f51680098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:04.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f516effd700 1 -- 172.21.15.8:0/2892747961 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516800ed80 con 0x7f51780a46b0 2023-10-14T16:55:04.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f516effd700 1 -- 172.21.15.8:0/2892747961 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5168014420 con 0x7f51780a46b0 2023-10-14T16:55:04.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51780a16b0 con 0x7f51780a46b0 2023-10-14T16:55:04.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f516effd700 1 -- 172.21.15.8:0/2892747961 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51680147e0 con 0x7f51780a46b0 2023-10-14T16:55:04.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.393+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517809f5b0 con 0x7f51780a46b0 2023-10-14T16:55:04.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.394+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517806abf0 con 0x7f51780a46b0 2023-10-14T16:55:04.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.395+0000 7f516effd700 1 -- 172.21.15.8:0/2892747961 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5168014b90 con 0x7f51780a46b0 2023-10-14T16:55:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.395+0000 7f516effd700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5158066f30 0x7f51580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.395+0000 7f51767fc700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5158066f30 0x7f51580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.395+0000 7f516effd700 1 -- 172.21.15.8:0/2892747961 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f5168084750 con 0x7f51780a46b0 2023-10-14T16:55:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.396+0000 7f51767fc700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5158066f30 0x7f51580693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f517806b040 tx=0x7f5160017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.400+0000 7f516effd700 1 -- 172.21.15.8:0/2892747961 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5168051f20 con 0x7f51780a46b0 2023-10-14T16:55:04.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.592+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f51780a03e0 con 0x7f51780a46b0 2023-10-14T16:55:04.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.592+0000 7f516effd700 1 -- 172.21.15.8:0/2892747961 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5168055540 con 0x7f51780a46b0 2023-10-14T16:55:04.593 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-14T16:55:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.594+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5158066f30 msgr2=0x7f51580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.594+0000 7f517d626700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5158066f30 0x7f51580693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f517806b040 tx=0x7f5160017000 comp rx=0 tx=0).stop 2023-10-14T16:55:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.594+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51780a46b0 msgr2=0x7f517809d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.594+0000 7f517d626700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51780a46b0 0x7f517809d810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f516800e0e0 tx=0x7f51680098d0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.594+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 shutdown_connections 2023-10-14T16:55:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.594+0000 7f517d626700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5158066f30 0x7f51580693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.594+0000 7f517d626700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5178133d00 0x7f517809e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.594+0000 7f517d626700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f51780a46b0 0x7f517809d810 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.594+0000 7f517d626700 1 --2- 172.21.15.8:0/2892747961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51780a5030 0x7f517809dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.594+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 >> 172.21.15.8:0/2892747961 conn(0x7f517806a820 msgr2=0x7f51780a7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:04.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.594+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 shutdown_connections 2023-10-14T16:55:04.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.594+0000 7f517d626700 1 -- 172.21.15.8:0/2892747961 wait complete. 2023-10-14T16:55:04.607 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T16:55:04.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.728+0000 7f04b1727700 1 Processor -- start 2023-10-14T16:55:04.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.728+0000 7f04b1727700 1 -- start start 2023-10-14T16:55:04.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.729+0000 7f04b1727700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac0a18b0 0x7f04ac135510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.729+0000 7f04b1727700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04ac131b80 0x7f04ac13cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.729+0000 7f04b1727700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ac0a13b0 con 0x7f04ac135140 2023-10-14T16:55:04.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.729+0000 7f04b1727700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac02a890 con 0x7f04ac131b80 2023-10-14T16:55:04.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.729+0000 7f04b1727700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0a1df0 con 0x7f04ac0a18b0 2023-10-14T16:55:04.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.729+0000 7f04abfff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f04ac135140 0x7f04ac131470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42472/0 (socket says 172.21.15.8:42472) 2023-10-14T16:55:04.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.729+0000 7f04abfff700 1 -- 172.21.15.8:0/2410182851 learned_addr learned my addr 172.21.15.8:0/2410182851 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:04.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.729+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006101165 0 0) 0x7f04ac0a13b0 con 0x7f04ac135140 2023-10-14T16:55:04.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.729+0000 7f04ab7fe700 1 --2- 172.21.15.8:0/2410182851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac0a18b0 0x7f04ac135510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.729+0000 7f04b0f26700 1 --2- 172.21.15.8:0/2410182851 >> v2:172.21.15.155:3300/0 conn(0x7f04ac131b80 0x7f04ac13cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.729+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0494003570 con 0x7f04ac135140 2023-10-14T16:55:04.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2633503880 0 0) 0x7f0494003570 con 0x7f04ac135140 2023-10-14T16:55:04.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac0a18b0 msgr2=0x7f04ac135510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 --2- 172.21.15.8:0/2410182851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac0a18b0 0x7f04ac135510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 >> v2:172.21.15.155:3300/0 conn(0x7f04ac131b80 msgr2=0x7f04ac13cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 --2- 172.21.15.8:0/2410182851 >> v2:172.21.15.155:3300/0 conn(0x7f04ac131b80 0x7f04ac13cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0a2320 con 0x7f04ac135140 2023-10-14T16:55:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f049c001470 con 0x7f04ac135140 2023-10-14T16:55:04.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 >> v1:172.21.15.8:6789/0 conn(0x7f04ac135140 legacy=0x7f04ac131470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 --2- 172.21.15.8:0/2410182851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac0a18b0 0x7f0494003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 --2- 172.21.15.8:0/2410182851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0494003fe0 0x7f0494004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 --2- 172.21.15.8:0/2410182851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0494004d50 0x7f04940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac02a890 con 0x7f0494003fe0 2023-10-14T16:55:04.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0a1df0 con 0x7f0494004d50 2023-10-14T16:55:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049400ba90 con 0x7f04ac0a18b0 2023-10-14T16:55:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04ab7fe700 1 --2- 172.21.15.8:0/2410182851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0494003fe0 0x7f0494004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04abfff700 1 --2- 172.21.15.8:0/2410182851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac0a18b0 0x7f0494003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04b0f26700 1 --2- 172.21.15.8:0/2410182851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0494004d50 0x7f04940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04ab7fe700 1 -- 172.21.15.8:0/2410182851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac0a18b0 msgr2=0x7f0494003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:04.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04ab7fe700 1 --2- 172.21.15.8:0/2410182851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac0a18b0 0x7f0494003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04ab7fe700 1 -- 172.21.15.8:0/2410182851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0494004d50 msgr2=0x7f04940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:04.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04ab7fe700 1 --2- 172.21.15.8:0/2410182851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0494004d50 0x7f04940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04ab7fe700 1 -- 172.21.15.8:0/2410182851 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494003570 con 0x7f0494003fe0 2023-10-14T16:55:04.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04ab7fe700 1 --2- 172.21.15.8:0/2410182851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0494003fe0 0x7f0494004810 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009c00 tx=0x7f04a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad843672d0545dc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:04.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000e6b0 con 0x7f0494003fe0 2023-10-14T16:55:04.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a000e810 con 0x7f0494003fe0 2023-10-14T16:55:04.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.730+0000 7f04aaffd700 1 -- 172.21.15.8:0/2410182851 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000ebd0 con 0x7f0494003fe0 2023-10-14T16:55:04.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.731+0000 7f04b1727700 1 -- 172.21.15.8:0/2410182851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0494003fe0 msgr2=0x7f0494004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.731+0000 7f04b1727700 1 --2- 172.21.15.8:0/2410182851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0494003fe0 0x7f0494004810 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009c00 tx=0x7f04a00091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.731+0000 7f04b0f26700 1 -- 172.21.15.8:0/2410182851 reap_dead start 2023-10-14T16:55:04.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.731+0000 7f04b1727700 1 -- 172.21.15.8:0/2410182851 shutdown_connections 2023-10-14T16:55:04.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.731+0000 7f04b1727700 1 -- 172.21.15.8:0/2410182851 >> 172.21.15.8:0/2410182851 conn(0x7f04ac06a760 msgr2=0x7f04ac0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:04.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.731+0000 7f04b1727700 1 -- 172.21.15.8:0/2410182851 shutdown_connections 2023-10-14T16:55:04.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.731+0000 7f04b1727700 1 -- 172.21.15.8:0/2410182851 wait complete. 2023-10-14T16:55:04.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.732+0000 7f04b1727700 1 Processor -- start 2023-10-14T16:55:04.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.732+0000 7f04b1727700 1 -- start start 2023-10-14T16:55:04.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.732+0000 7f04b1727700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0494003fe0 0x7f04ac096990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.732+0000 7f04b1727700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac09abc0 0x7f04ac096ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.732+0000 7f04b1727700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ac097410 0x7f04ac1449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.732+0000 7f04b1727700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac09b050 con 0x7f04ac097410 2023-10-14T16:55:04.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b1727700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac09a470 con 0x7f04ac09abc0 2023-10-14T16:55:04.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b1727700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac099ed0 con 0x7f0494003fe0 2023-10-14T16:55:04.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b0f26700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ac097410 0x7f04ac1449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b0f26700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ac097410 0x7f04ac1449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53536/0 (socket says 172.21.15.8:53536) 2023-10-14T16:55:04.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b0f26700 1 -- 172.21.15.8:0/2887761919 learned_addr learned my addr 172.21.15.8:0/2887761919 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:04.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04abfff700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0494003fe0 0x7f04ac096990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04ab7fe700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac09abc0 0x7f04ac096ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b0f26700 1 -- 172.21.15.8:0/2887761919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0494003fe0 msgr2=0x7f04ac096990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b0f26700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0494003fe0 0x7f04ac096990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b0f26700 1 -- 172.21.15.8:0/2887761919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac09abc0 msgr2=0x7f04ac096ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b0f26700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac09abc0 0x7f04ac096ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b0f26700 1 -- 172.21.15.8:0/2887761919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac09a190 con 0x7f04ac097410 2023-10-14T16:55:04.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b0f26700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ac097410 0x7f04ac1449f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0a4500 tx=0x7f04a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:04.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f0493fff700 1 -- 172.21.15.8:0/2887761919 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a400e040 con 0x7f04ac097410 2023-10-14T16:55:04.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f0493fff700 1 -- 172.21.15.8:0/2887761919 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a400f040 con 0x7f04ac097410 2023-10-14T16:55:04.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b1727700 1 -- 172.21.15.8:0/2887761919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac096690 con 0x7f04ac097410 2023-10-14T16:55:04.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f0493fff700 1 -- 172.21.15.8:0/2887761919 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a400fe20 con 0x7f04ac097410 2023-10-14T16:55:04.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.733+0000 7f04b1727700 1 -- 172.21.15.8:0/2887761919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac0999c0 con 0x7f04ac097410 2023-10-14T16:55:04.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.734+0000 7f04b1727700 1 -- 172.21.15.8:0/2887761919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac098c80 con 0x7f04ac097410 2023-10-14T16:55:04.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.735+0000 7f0493fff700 1 -- 172.21.15.8:0/2887761919 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04a4015640 con 0x7f04ac097410 2023-10-14T16:55:04.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.735+0000 7f0493fff700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0498066f30 0x7f04980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:04.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.735+0000 7f0493fff700 1 -- 172.21.15.8:0/2887761919 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f04a40848d0 con 0x7f04ac097410 2023-10-14T16:55:04.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.735+0000 7f04abfff700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0498066f30 0x7f04980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:04.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.735+0000 7f04abfff700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0498066f30 0x7f04980693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f049c001620 tx=0x7f049c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:04.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.739+0000 7f0493fff700 1 -- 172.21.15.8:0/2887761919 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04a40520a0 con 0x7f04ac097410 2023-10-14T16:55:04.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.928+0000 7f04b1727700 1 -- 172.21.15.8:0/2887761919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04ac0708d0 con 0x7f04ac097410 2023-10-14T16:55:04.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.929+0000 7f0493fff700 1 -- 172.21.15.8:0/2887761919 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04a40556c0 con 0x7f04ac097410 2023-10-14T16:55:04.930 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T16:55:04.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.931+0000 7f04b1727700 1 -- 172.21.15.8:0/2887761919 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0498066f30 msgr2=0x7f04980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.931+0000 7f04b1727700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0498066f30 0x7f04980693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f049c001620 tx=0x7f049c009040 comp rx=0 tx=0).stop 2023-10-14T16:55:04.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.931+0000 7f04b1727700 1 -- 172.21.15.8:0/2887761919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ac097410 msgr2=0x7f04ac1449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:04.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.931+0000 7f04b1727700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ac097410 0x7f04ac1449f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0a4500 tx=0x7f04a400b040 comp rx=0 tx=0).stop 2023-10-14T16:55:04.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.931+0000 7f04b1727700 1 -- 172.21.15.8:0/2887761919 shutdown_connections 2023-10-14T16:55:04.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.931+0000 7f04b1727700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0498066f30 0x7f04980693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.931+0000 7f04b1727700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04ac097410 0x7f04ac1449f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.931+0000 7f04b1727700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0494003fe0 0x7f04ac096990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.931+0000 7f04b1727700 1 --2- 172.21.15.8:0/2887761919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac09abc0 0x7f04ac096ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:04.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.931+0000 7f04b1727700 1 -- 172.21.15.8:0/2887761919 >> 172.21.15.8:0/2887761919 conn(0x7f04ac06a760 msgr2=0x7f04ac0a67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:04.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.931+0000 7f04b1727700 1 -- 172.21.15.8:0/2887761919 shutdown_connections 2023-10-14T16:55:04.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:04.931+0000 7f04b1727700 1 -- 172.21.15.8:0/2887761919 wait complete. 2023-10-14T16:55:04.944 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T16:55:05.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.064+0000 7f68162f1700 1 Processor -- start 2023-10-14T16:55:05.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.064+0000 7f68162f1700 1 -- start start 2023-10-14T16:55:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f68162f1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6810070410 0x7f6810132de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f68162f1700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6810133320 0x7f6810133970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f68162f1700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68100a02e0 con 0x7f6810133eb0 2023-10-14T16:55:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f68162f1700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6810133710 con 0x7f6810133320 2023-10-14T16:55:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f68162f1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681009ff90 con 0x7f6810070410 2023-10-14T16:55:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f6815af0700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6810133eb0 0x7f681013acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42482/0 (socket says 172.21.15.8:42482) 2023-10-14T16:55:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f6815af0700 1 -- 172.21.15.8:0/2354486481 learned_addr learned my addr 172.21.15.8:0/2354486481 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f68152ef700 1 --2- 172.21.15.8:0/2354486481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6810070410 0x7f6810132de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f6814aee700 1 --2- 172.21.15.8:0/2354486481 >> v2:172.21.15.155:3300/0 conn(0x7f6810133320 0x7f6810133970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f680ffff700 1 -- 172.21.15.8:0/2354486481 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595923558 0 0) 0x7f68100a02e0 con 0x7f6810133eb0 2023-10-14T16:55:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f680ffff700 1 -- 172.21.15.8:0/2354486481 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f8003570 con 0x7f6810133eb0 2023-10-14T16:55:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f68152ef700 1 -- 172.21.15.8:0/2354486481 >> v2:172.21.15.155:3300/0 conn(0x7f6810133320 msgr2=0x7f6810133970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f68152ef700 1 --2- 172.21.15.8:0/2354486481 >> v2:172.21.15.155:3300/0 conn(0x7f6810133320 0x7f6810133970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f68152ef700 1 -- 172.21.15.8:0/2354486481 >> v1:172.21.15.8:6789/0 conn(0x7f6810133eb0 legacy=0x7f681013acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f68152ef700 1 -- 172.21.15.8:0/2354486481 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681009d5d0 con 0x7f6810070410 2023-10-14T16:55:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f6814aee700 1 --2- 172.21.15.8:0/2354486481 >> v2:172.21.15.155:3300/0 conn(0x7f6810133320 0x7f6810133970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.065+0000 7f68152ef700 1 --2- 172.21.15.8:0/2354486481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6810070410 0x7f6810132de0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6808009e60 tx=0x7f6808009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40d20bd538c6b3a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.066+0000 7f680ffff700 1 -- 172.21.15.8:0/2354486481 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680800e070 con 0x7f6810070410 2023-10-14T16:55:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.066+0000 7f680ffff700 1 -- 172.21.15.8:0/2354486481 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680800bab0 con 0x7f6810070410 2023-10-14T16:55:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.066+0000 7f680ffff700 1 -- 172.21.15.8:0/2354486481 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680800be70 con 0x7f6810070410 2023-10-14T16:55:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.066+0000 7f68162f1700 1 -- 172.21.15.8:0/2354486481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6810070410 msgr2=0x7f6810132de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.066+0000 7f68162f1700 1 --2- 172.21.15.8:0/2354486481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6810070410 0x7f6810132de0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6808009e60 tx=0x7f6808009780 comp rx=0 tx=0).stop 2023-10-14T16:55:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.066+0000 7f68162f1700 1 -- 172.21.15.8:0/2354486481 shutdown_connections 2023-10-14T16:55:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.066+0000 7f68162f1700 1 --2- 172.21.15.8:0/2354486481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6810070410 0x7f6810132de0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.066+0000 7f68162f1700 1 --2- 172.21.15.8:0/2354486481 >> v2:172.21.15.155:3300/0 conn(0x7f6810133320 0x7f6810133970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.066+0000 7f68162f1700 1 -- 172.21.15.8:0/2354486481 >> 172.21.15.8:0/2354486481 conn(0x7f681002a340 msgr2=0x7f681002a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.066+0000 7f68162f1700 1 -- 172.21.15.8:0/2354486481 shutdown_connections 2023-10-14T16:55:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.066+0000 7f68162f1700 1 -- 172.21.15.8:0/2354486481 wait complete. 2023-10-14T16:55:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.067+0000 7f68162f1700 1 Processor -- start 2023-10-14T16:55:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.067+0000 7f68162f1700 1 -- start start 2023-10-14T16:55:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f68162f1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6810133320 0x7f681013b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f68162f1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6810133eb0 0x7f681012f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f68162f1700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f681012fe00 0x7f68101302a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f68162f1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6810137660 con 0x7f6810133eb0 2023-10-14T16:55:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f68162f1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6810134d30 con 0x7f6810133320 2023-10-14T16:55:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f68162f1700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6810139b70 con 0x7f681012fe00 2023-10-14T16:55:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f6814aee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6810133eb0 0x7f681012f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f6814aee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6810133eb0 0x7f681012f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53550/0 (socket says 172.21.15.8:53550) 2023-10-14T16:55:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f6814aee700 1 -- 172.21.15.8:0/4168556496 learned_addr learned my addr 172.21.15.8:0/4168556496 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f68152ef700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6810133320 0x7f681013b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f6815af0700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f681012fe00 0x7f68101302a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f6814aee700 1 -- 172.21.15.8:0/4168556496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f681012fe00 msgr2=0x7f68101302a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f6814aee700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f681012fe00 0x7f68101302a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f6814aee700 1 -- 172.21.15.8:0/4168556496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6810133320 msgr2=0x7f681013b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f6814aee700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6810133320 0x7f681013b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f6814aee700 1 -- 172.21.15.8:0/4168556496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6804009420 con 0x7f6810133eb0 2023-10-14T16:55:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f6815af0700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f681012fe00 0x7f68101302a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f6814aee700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6810133eb0 0x7f681012f8c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f680400ec80 tx=0x7f68040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f680d7fa700 1 -- 172.21.15.8:0/4168556496 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680400c8f0 con 0x7f6810133eb0 2023-10-14T16:55:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f680d7fa700 1 -- 172.21.15.8:0/4168556496 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680400ca50 con 0x7f6810133eb0 2023-10-14T16:55:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f68162f1700 1 -- 172.21.15.8:0/4168556496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6808009a20 con 0x7f6810133eb0 2023-10-14T16:55:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.068+0000 7f680d7fa700 1 -- 172.21.15.8:0/4168556496 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680400cdd0 con 0x7f6810133eb0 2023-10-14T16:55:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.069+0000 7f68162f1700 1 -- 172.21.15.8:0/4168556496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68101389f0 con 0x7f6810133eb0 2023-10-14T16:55:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.070+0000 7f68162f1700 1 -- 172.21.15.8:0/4168556496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681013b8a0 con 0x7f6810133eb0 2023-10-14T16:55:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.070+0000 7f680d7fa700 1 -- 172.21.15.8:0/4168556496 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6804013680 con 0x7f6810133eb0 2023-10-14T16:55:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.070+0000 7f680d7fa700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f67fc066f60 0x7f67fc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.070+0000 7f680d7fa700 1 -- 172.21.15.8:0/4168556496 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f68040842b0 con 0x7f6810133eb0 2023-10-14T16:55:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.070+0000 7f68152ef700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f67fc066f60 0x7f67fc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.071+0000 7f68152ef700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f67fc066f60 0x7f67fc069410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68080097c0 tx=0x7f6808019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.075+0000 7f680d7fa700 1 -- 172.21.15.8:0/4168556496 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6804051a80 con 0x7f6810133eb0 2023-10-14T16:55:05.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.269+0000 7f68162f1700 1 -- 172.21.15.8:0/4168556496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68100a60f0 con 0x7f6810133eb0 2023-10-14T16:55:05.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.269+0000 7f680d7fa700 1 -- 172.21.15.8:0/4168556496 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f68040550a0 con 0x7f6810133eb0 2023-10-14T16:55:05.271 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T16:55:05.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.272+0000 7f68162f1700 1 -- 172.21.15.8:0/4168556496 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f67fc066f60 msgr2=0x7f67fc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.272+0000 7f68162f1700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f67fc066f60 0x7f67fc069410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68080097c0 tx=0x7f6808019000 comp rx=0 tx=0).stop 2023-10-14T16:55:05.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.272+0000 7f68162f1700 1 -- 172.21.15.8:0/4168556496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6810133eb0 msgr2=0x7f681012f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.272+0000 7f68162f1700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6810133eb0 0x7f681012f8c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f680400ec80 tx=0x7f68040091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.272+0000 7f68162f1700 1 -- 172.21.15.8:0/4168556496 shutdown_connections 2023-10-14T16:55:05.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.272+0000 7f68162f1700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f67fc066f60 0x7f67fc069410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.272+0000 7f68162f1700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f681012fe00 0x7f68101302a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.272+0000 7f68162f1700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6810133320 0x7f681013b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.272+0000 7f68162f1700 1 --2- 172.21.15.8:0/4168556496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6810133eb0 0x7f681012f8c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.272+0000 7f68162f1700 1 -- 172.21.15.8:0/4168556496 >> 172.21.15.8:0/4168556496 conn(0x7f681002a340 msgr2=0x7f68100a09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:05.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.272+0000 7f68162f1700 1 -- 172.21.15.8:0/4168556496 shutdown_connections 2023-10-14T16:55:05.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.272+0000 7f68162f1700 1 -- 172.21.15.8:0/4168556496 wait complete. 2023-10-14T16:55:05.284 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T16:55:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.404+0000 7f3bd0f18700 1 Processor -- start 2023-10-14T16:55:05.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.404+0000 7f3bd0f18700 1 -- start start 2023-10-14T16:55:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bd0f18700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3bcc070410 0x7f3bcc09ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bd0f18700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bcc0a13a0 0x7f3bcc0a1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bd0f18700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3bcc136c40 0x7f3bcc1370a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bd0f18700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc09ef40 con 0x7f3bcc136c40 2023-10-14T16:55:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bd0f18700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc0a0be0 con 0x7f3bcc070410 2023-10-14T16:55:05.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bd0f18700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0a1cb0 con 0x7f3bcc0a13a0 2023-10-14T16:55:05.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bcad9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3bcc136c40 0x7f3bcc1370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bcad9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3bcc136c40 0x7f3bcc1370a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53560/0 (socket says 172.21.15.8:53560) 2023-10-14T16:55:05.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bcad9d700 1 -- 172.21.15.8:0/3071522495 learned_addr learned my addr 172.21.15.8:0/3071522495 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:05.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bc9d9b700 1 --2- 172.21.15.8:0/3071522495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bcc0a13a0 0x7f3bcc0a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bca59c700 1 --2- 172.21.15.8:0/3071522495 >> v2:172.21.15.155:3300/0 conn(0x7f3bcc070410 0x7f3bcc09ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bcad9d700 1 -- 172.21.15.8:0/3071522495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bcc0a13a0 msgr2=0x7f3bcc0a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:05.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bcad9d700 1 --2- 172.21.15.8:0/3071522495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bcc0a13a0 0x7f3bcc0a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bcad9d700 1 -- 172.21.15.8:0/3071522495 >> v2:172.21.15.155:3300/0 conn(0x7f3bcc070410 msgr2=0x7f3bcc09ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:05.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bcad9d700 1 --2- 172.21.15.8:0/3071522495 >> v2:172.21.15.155:3300/0 conn(0x7f3bcc070410 0x7f3bcc09ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.405+0000 7f3bcad9d700 1 -- 172.21.15.8:0/3071522495 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc0a0e40 con 0x7f3bcc136c40 2023-10-14T16:55:05.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bcad9d700 1 --2- 172.21.15.8:0/3071522495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bcc136c40 0x7f3bcc1370a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc06b180 tx=0x7f3bbc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01d8ad0e69689ca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:05.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bc959a700 1 -- 172.21.15.8:0/3071522495 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00e070 con 0x7f3bcc136c40 2023-10-14T16:55:05.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bc959a700 1 -- 172.21.15.8:0/3071522495 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00ba50 con 0x7f3bcc136c40 2023-10-14T16:55:05.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bc959a700 1 -- 172.21.15.8:0/3071522495 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc0092e0 con 0x7f3bcc136c40 2023-10-14T16:55:05.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3071522495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bcc136c40 msgr2=0x7f3bcc1370a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bd0f18700 1 --2- 172.21.15.8:0/3071522495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bcc136c40 0x7f3bcc1370a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc06b180 tx=0x7f3bbc009840 comp rx=0 tx=0).stop 2023-10-14T16:55:05.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3071522495 shutdown_connections 2023-10-14T16:55:05.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bd0f18700 1 --2- 172.21.15.8:0/3071522495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bcc136c40 0x7f3bcc1370a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bd0f18700 1 --2- 172.21.15.8:0/3071522495 >> v2:172.21.15.155:3300/0 conn(0x7f3bcc070410 0x7f3bcc09ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bd0f18700 1 --2- 172.21.15.8:0/3071522495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bcc0a13a0 0x7f3bcc0a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3071522495 >> 172.21.15.8:0/3071522495 conn(0x7f3bcc068130 msgr2=0x7f3bcc0a6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:05.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3071522495 shutdown_connections 2023-10-14T16:55:05.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.406+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3071522495 wait complete. 2023-10-14T16:55:05.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.407+0000 7f3bd0f18700 1 Processor -- start 2023-10-14T16:55:05.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.407+0000 7f3bd0f18700 1 -- start start 2023-10-14T16:55:05.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bd0f18700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bcc0a13a0 0x7f3bcc099e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bd0f18700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bcc136c40 0x7f3bcc09a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bd0f18700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bcc11e690 0x7f3bcc09a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bd0f18700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc11eb20 con 0x7f3bcc136c40 2023-10-14T16:55:05.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bd0f18700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc11d9a0 con 0x7f3bcc11e690 2023-10-14T16:55:05.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bd0f18700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc11df40 con 0x7f3bcc0a13a0 2023-10-14T16:55:05.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bc9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bcc136c40 0x7f3bcc09a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bc9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bcc136c40 0x7f3bcc09a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53570/0 (socket says 172.21.15.8:53570) 2023-10-14T16:55:05.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bc9d9b700 1 -- 172.21.15.8:0/3676882074 learned_addr learned my addr 172.21.15.8:0/3676882074 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:05.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bca59c700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bcc0a13a0 0x7f3bcc099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bcad9d700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bcc11e690 0x7f3bcc09a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bc9d9b700 1 -- 172.21.15.8:0/3676882074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bcc0a13a0 msgr2=0x7f3bcc099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bc9d9b700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bcc0a13a0 0x7f3bcc099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bc9d9b700 1 -- 172.21.15.8:0/3676882074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bcc11e690 msgr2=0x7f3bcc09a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bc9d9b700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bcc11e690 0x7f3bcc09a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bc9d9b700 1 -- 172.21.15.8:0/3676882074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc009ae0 con 0x7f3bcc136c40 2023-10-14T16:55:05.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bc9d9b700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bcc136c40 0x7f3bcc09a390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400d890 tx=0x7f3bb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:05.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bc27fc700 1 -- 172.21.15.8:0/3676882074 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb40125f0 con 0x7f3bcc136c40 2023-10-14T16:55:05.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bc27fc700 1 -- 172.21.15.8:0/3676882074 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb4012750 con 0x7f3bcc136c40 2023-10-14T16:55:05.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3676882074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc09c8a0 con 0x7f3bcc136c40 2023-10-14T16:55:05.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.408+0000 7f3bc27fc700 1 -- 172.21.15.8:0/3676882074 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4012af0 con 0x7f3bcc136c40 2023-10-14T16:55:05.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.409+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3676882074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc09bb30 con 0x7f3bcc136c40 2023-10-14T16:55:05.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.409+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3676882074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc09bd20 con 0x7f3bcc136c40 2023-10-14T16:55:05.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.410+0000 7f3bc27fc700 1 -- 172.21.15.8:0/3676882074 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bb401e460 con 0x7f3bcc136c40 2023-10-14T16:55:05.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.410+0000 7f3bc27fc700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3bac066f30 0x7f3bac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.410+0000 7f3bca59c700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3bac066f30 0x7f3bac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.410+0000 7f3bc27fc700 1 -- 172.21.15.8:0/3676882074 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f3bb4084540 con 0x7f3bcc136c40 2023-10-14T16:55:05.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.411+0000 7f3bca59c700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3bac066f30 0x7f3bac0693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4006fd0 tx=0x7f3bc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:05.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.415+0000 7f3bc27fc700 1 -- 172.21.15.8:0/3676882074 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bb4051d10 con 0x7f3bcc136c40 2023-10-14T16:55:05.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.607+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3676882074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3bcc06aee0 con 0x7f3bcc136c40 2023-10-14T16:55:05.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.607+0000 7f3bc27fc700 1 -- 172.21.15.8:0/3676882074 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3bb4055330 con 0x7f3bcc136c40 2023-10-14T16:55:05.609 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T16:55:05.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.609+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3676882074 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3bac066f30 msgr2=0x7f3bac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.609+0000 7f3bd0f18700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3bac066f30 0x7f3bac0693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4006fd0 tx=0x7f3bc4008040 comp rx=0 tx=0).stop 2023-10-14T16:55:05.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.609+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3676882074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bcc136c40 msgr2=0x7f3bcc09a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.609+0000 7f3bd0f18700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bcc136c40 0x7f3bcc09a390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400d890 tx=0x7f3bb4008040 comp rx=0 tx=0).stop 2023-10-14T16:55:05.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.610+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3676882074 shutdown_connections 2023-10-14T16:55:05.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.610+0000 7f3bd0f18700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3bac066f30 0x7f3bac0693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.610+0000 7f3bd0f18700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bcc11e690 0x7f3bcc09a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.610+0000 7f3bd0f18700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bcc0a13a0 0x7f3bcc099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.610+0000 7f3bd0f18700 1 --2- 172.21.15.8:0/3676882074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3bcc136c40 0x7f3bcc09a390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.610+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3676882074 >> 172.21.15.8:0/3676882074 conn(0x7f3bcc068130 msgr2=0x7f3bcc13a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:05.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.610+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3676882074 shutdown_connections 2023-10-14T16:55:05.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.610+0000 7f3bd0f18700 1 -- 172.21.15.8:0/3676882074 wait complete. 2023-10-14T16:55:05.622 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T16:55:05.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.740+0000 7f45c92e5700 1 Processor -- start 2023-10-14T16:55:05.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.740+0000 7f45c92e5700 1 -- start start 2023-10-14T16:55:05.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.741+0000 7f45c92e5700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f45c40a6940 0x7f45c40a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.741+0000 7f45c92e5700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c40a2df0 con 0x7f45c413c1a0 2023-10-14T16:55:05.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.741+0000 7f45c92e5700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c4133ae0 con 0x7f45c40a25c0 2023-10-14T16:55:05.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.741+0000 7f45c92e5700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c41338f0 con 0x7f45c40a6940 2023-10-14T16:55:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.741+0000 7f45c2ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f45c40a6940 0x7f45c40a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.741+0000 7f45c37fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f45c413c1a0 0x7f45c413e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42484/0 (socket says 172.21.15.8:42484) 2023-10-14T16:55:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.741+0000 7f45c37fe700 1 -- 172.21.15.8:0/1635676556 learned_addr learned my addr 172.21.15.8:0/1635676556 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.741+0000 7f45c2ffd700 1 -- 172.21.15.8:0/1635676556 >> v1:172.21.15.155:6789/0 conn(0x7f45c40a25c0 legacy=0x7f45c4133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.741+0000 7f45c2ffd700 1 -- 172.21.15.8:0/1635676556 >> v1:172.21.15.8:6789/0 conn(0x7f45c413c1a0 legacy=0x7f45c413e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.741+0000 7f45c1ffb700 1 -- 172.21.15.8:0/1635676556 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012541230 0 0) 0x7f45c40a2df0 con 0x7f45c413c1a0 2023-10-14T16:55:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.741+0000 7f45c2ffd700 1 -- 172.21.15.8:0/1635676556 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c40a1b90 con 0x7f45c40a6940 2023-10-14T16:55:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.741+0000 7f45c2ffd700 1 --2- 172.21.15.8:0/1635676556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c40a6940 0x7f45c40a1310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f45c40a1d80 tx=0x7f45bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d4279e6b9d0980 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.742+0000 7f45c1ffb700 1 -- 172.21.15.8:0/1635676556 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00e070 con 0x7f45c40a6940 2023-10-14T16:55:05.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.742+0000 7f45c1ffb700 1 -- 172.21.15.8:0/1635676556 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc00bc30 con 0x7f45c40a6940 2023-10-14T16:55:05.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.742+0000 7f45c1ffb700 1 -- 172.21.15.8:0/1635676556 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc012430 con 0x7f45c40a6940 2023-10-14T16:55:05.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.742+0000 7f45c92e5700 1 -- 172.21.15.8:0/1635676556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c40a6940 msgr2=0x7f45c40a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.742+0000 7f45c92e5700 1 --2- 172.21.15.8:0/1635676556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c40a6940 0x7f45c40a1310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f45c40a1d80 tx=0x7f45bc009780 comp rx=0 tx=0).stop 2023-10-14T16:55:05.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.742+0000 7f45c92e5700 1 -- 172.21.15.8:0/1635676556 shutdown_connections 2023-10-14T16:55:05.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.742+0000 7f45c92e5700 1 --2- 172.21.15.8:0/1635676556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c40a6940 0x7f45c40a1310 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.742+0000 7f45c92e5700 1 -- 172.21.15.8:0/1635676556 >> 172.21.15.8:0/1635676556 conn(0x7f45c406acd0 msgr2=0x7f45c40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.742+0000 7f45c92e5700 1 -- 172.21.15.8:0/1635676556 shutdown_connections 2023-10-14T16:55:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.742+0000 7f45c92e5700 1 -- 172.21.15.8:0/1635676556 wait complete. 2023-10-14T16:55:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.743+0000 7f45c92e5700 1 Processor -- start 2023-10-14T16:55:05.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.743+0000 7f45c92e5700 1 -- start start 2023-10-14T16:55:05.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c92e5700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c40a25c0 0x7f45c4130870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c92e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c413c1a0 0x7f45c4130db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c92e5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c41312f0 0x7f45c4136c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c92e5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c413aa40 con 0x7f45c413c1a0 2023-10-14T16:55:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c92e5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c413afe0 con 0x7f45c41312f0 2023-10-14T16:55:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c92e5700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c413b730 con 0x7f45c40a25c0 2023-10-14T16:55:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c413c1a0 0x7f45c4130db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c413c1a0 0x7f45c4130db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53582/0 (socket says 172.21.15.8:53582) 2023-10-14T16:55:05.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c27fc700 1 -- 172.21.15.8:0/1748062557 learned_addr learned my addr 172.21.15.8:0/1748062557 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c37fe700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c41312f0 0x7f45c4136c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c2ffd700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c40a25c0 0x7f45c4130870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c27fc700 1 -- 172.21.15.8:0/1748062557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c40a25c0 msgr2=0x7f45c4130870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c27fc700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c40a25c0 0x7f45c4130870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c27fc700 1 -- 172.21.15.8:0/1748062557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c41312f0 msgr2=0x7f45c4136c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c27fc700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c41312f0 0x7f45c4136c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c27fc700 1 -- 172.21.15.8:0/1748062557 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc009a20 con 0x7f45c413c1a0 2023-10-14T16:55:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c37fe700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c41312f0 0x7f45c4136c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c2ffd700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c40a25c0 0x7f45c4130870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:05.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c27fc700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c413c1a0 0x7f45c4130db0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00c5d0 tx=0x7f45ac007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:05.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45baffd700 1 -- 172.21.15.8:0/1748062557 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011590 con 0x7f45c413c1a0 2023-10-14T16:55:05.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45baffd700 1 -- 172.21.15.8:0/1748062557 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac0116f0 con 0x7f45c413c1a0 2023-10-14T16:55:05.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c92e5700 1 -- 172.21.15.8:0/1748062557 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c413b4d0 con 0x7f45c413c1a0 2023-10-14T16:55:05.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45baffd700 1 -- 172.21.15.8:0/1748062557 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011ab0 con 0x7f45c413c1a0 2023-10-14T16:55:05.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.744+0000 7f45c92e5700 1 -- 172.21.15.8:0/1748062557 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c4138a10 con 0x7f45c413c1a0 2023-10-14T16:55:05.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.745+0000 7f45c92e5700 1 -- 172.21.15.8:0/1748062557 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c4139630 con 0x7f45c413c1a0 2023-10-14T16:55:05.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.746+0000 7f45baffd700 1 -- 172.21.15.8:0/1748062557 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45ac01c460 con 0x7f45c413c1a0 2023-10-14T16:55:05.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.746+0000 7f45baffd700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f45a4066f30 0x7f45a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:05.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.746+0000 7f45baffd700 1 -- 172.21.15.8:0/1748062557 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f45ac083d40 con 0x7f45c413c1a0 2023-10-14T16:55:05.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.746+0000 7f45c2ffd700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f45a4066f30 0x7f45a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:05.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.747+0000 7f45c2ffd700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f45a4066f30 0x7f45a40693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009fd0 tx=0x7f45bc019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:05.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.750+0000 7f45baffd700 1 -- 172.21.15.8:0/1748062557 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45ac051510 con 0x7f45c413c1a0 2023-10-14T16:55:05.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.989+0000 7f45c92e5700 1 -- 172.21.15.8:0/1748062557 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45c40708d0 con 0x7f45c413c1a0 2023-10-14T16:55:05.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.990+0000 7f45baffd700 1 -- 172.21.15.8:0/1748062557 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3079 (secure 0 0 0) 0x7f45ac054b30 con 0x7f45c413c1a0 2023-10-14T16:55:05.991 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:55:05.991 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6817/3883908964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3883908964},{"type":"v1","addr":"172.21.15.155:6817","nonce":3883908964}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T16:54:54.479174+0000","modified":"2023-10-14T16:54:58.104119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.8:6819/3402040876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3402040876},{"type":"v1","addr":"172.21.15.8:6819","nonce":3402040876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T16:55:05.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.992+0000 7f45c92e5700 1 -- 172.21.15.8:0/1748062557 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f45a4066f30 msgr2=0x7f45a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.992+0000 7f45c92e5700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f45a4066f30 0x7f45a40693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009fd0 tx=0x7f45bc019000 comp rx=0 tx=0).stop 2023-10-14T16:55:05.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.992+0000 7f45c92e5700 1 -- 172.21.15.8:0/1748062557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c413c1a0 msgr2=0x7f45c4130db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:05.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.992+0000 7f45c92e5700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c413c1a0 0x7f45c4130db0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00c5d0 tx=0x7f45ac007f60 comp rx=0 tx=0).stop 2023-10-14T16:55:05.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.992+0000 7f45c92e5700 1 -- 172.21.15.8:0/1748062557 shutdown_connections 2023-10-14T16:55:05.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.992+0000 7f45c92e5700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f45a4066f30 0x7f45a40693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.992+0000 7f45c92e5700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c41312f0 0x7f45c4136c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.992+0000 7f45c92e5700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c40a25c0 0x7f45c4130870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.992+0000 7f45c92e5700 1 --2- 172.21.15.8:0/1748062557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45c413c1a0 0x7f45c4130db0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:05.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.992+0000 7f45c92e5700 1 -- 172.21.15.8:0/1748062557 >> 172.21.15.8:0/1748062557 conn(0x7f45c406acd0 msgr2=0x7f45c413e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:05.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.992+0000 7f45c92e5700 1 -- 172.21.15.8:0/1748062557 shutdown_connections 2023-10-14T16:55:05.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:05.992+0000 7f45c92e5700 1 -- 172.21.15.8:0/1748062557 wait complete. 2023-10-14T16:55:05.995 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T16:55:06.005 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T16:55:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.123+0000 7f8138249700 1 Processor -- start 2023-10-14T16:55:06.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.123+0000 7f8138249700 1 -- start start 2023-10-14T16:55:06.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.123+0000 7f8138249700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8130070410 0x7f8130136d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.123+0000 7f8138249700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f81301376a0 0x7f81300a1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.123+0000 7f8138249700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813009efb0 con 0x7f8130137290 2023-10-14T16:55:06.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.123+0000 7f8138249700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813009de30 con 0x7f81301376a0 2023-10-14T16:55:06.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.123+0000 7f8138249700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813009e860 con 0x7f8130070410 2023-10-14T16:55:06.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.123+0000 7f81357e4700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f8130137290 0x7f81300a0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42486/0 (socket says 172.21.15.8:42486) 2023-10-14T16:55:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f81357e4700 1 -- 172.21.15.8:0/283149886 learned_addr learned my addr 172.21.15.8:0/283149886 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f8135fe5700 1 --2- 172.21.15.8:0/283149886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8130070410 0x7f8130136d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f81367e6700 1 --2- 172.21.15.8:0/283149886 >> v2:172.21.15.155:3300/0 conn(0x7f81301376a0 0x7f81300a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f8134fe3700 1 -- 172.21.15.8:0/283149886 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594422032 0 0) 0x7f813009efb0 con 0x7f8130137290 2023-10-14T16:55:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f8134fe3700 1 -- 172.21.15.8:0/283149886 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8118003570 con 0x7f8130137290 2023-10-14T16:55:06.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f81367e6700 1 -- 172.21.15.8:0/283149886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8130070410 msgr2=0x7f8130136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:06.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f81367e6700 1 --2- 172.21.15.8:0/283149886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8130070410 0x7f8130136d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f81367e6700 1 -- 172.21.15.8:0/283149886 >> v1:172.21.15.8:6789/0 conn(0x7f8130137290 legacy=0x7f81300a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f81367e6700 1 -- 172.21.15.8:0/283149886 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813009db20 con 0x7f81301376a0 2023-10-14T16:55:06.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f81367e6700 1 --2- 172.21.15.8:0/283149886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81301376a0 0x7f81300a1390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81200098e0 tx=0x7f81200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eab0fe1fe937981f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:06.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f8134fe3700 1 -- 172.21.15.8:0/283149886 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120011630 con 0x7f81301376a0 2023-10-14T16:55:06.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f8134fe3700 1 -- 172.21.15.8:0/283149886 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8120011790 con 0x7f81301376a0 2023-10-14T16:55:06.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.124+0000 7f8134fe3700 1 -- 172.21.15.8:0/283149886 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120011b30 con 0x7f81301376a0 2023-10-14T16:55:06.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.125+0000 7f8138249700 1 -- 172.21.15.8:0/283149886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81301376a0 msgr2=0x7f81300a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.125+0000 7f8138249700 1 --2- 172.21.15.8:0/283149886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81301376a0 0x7f81300a1390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81200098e0 tx=0x7f81200091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.125+0000 7f8138249700 1 -- 172.21.15.8:0/283149886 shutdown_connections 2023-10-14T16:55:06.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.125+0000 7f8138249700 1 --2- 172.21.15.8:0/283149886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81301376a0 0x7f81300a1390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.125+0000 7f8138249700 1 --2- 172.21.15.8:0/283149886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8130070410 0x7f8130136d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.125+0000 7f8138249700 1 -- 172.21.15.8:0/283149886 >> 172.21.15.8:0/283149886 conn(0x7f8130067820 msgr2=0x7f8130067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:06.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.125+0000 7f8138249700 1 -- 172.21.15.8:0/283149886 shutdown_connections 2023-10-14T16:55:06.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.125+0000 7f8138249700 1 -- 172.21.15.8:0/283149886 wait complete. 2023-10-14T16:55:06.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.126+0000 7f8138249700 1 Processor -- start 2023-10-14T16:55:06.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.126+0000 7f8138249700 1 -- start start 2023-10-14T16:55:06.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.126+0000 7f8138249700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8130137290 0x7f81301464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.126+0000 7f8138249700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81301376a0 0x7f8130146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.126+0000 7f8138249700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813009b240 0x7f8130146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.126+0000 7f8138249700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81301347a0 con 0x7f8130137290 2023-10-14T16:55:06.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.126+0000 7f8138249700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813011d0a0 con 0x7f813009b240 2023-10-14T16:55:06.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.126+0000 7f8138249700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813011d300 con 0x7f81301376a0 2023-10-14T16:55:06.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f8135fe5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8130137290 0x7f81301464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f8135fe5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8130137290 0x7f81301464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53588/0 (socket says 172.21.15.8:53588) 2023-10-14T16:55:06.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f8135fe5700 1 -- 172.21.15.8:0/2233531236 learned_addr learned my addr 172.21.15.8:0/2233531236 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:06.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f81367e6700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813009b240 0x7f8130146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f81357e4700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81301376a0 0x7f8130146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f8135fe5700 1 -- 172.21.15.8:0/2233531236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81301376a0 msgr2=0x7f8130146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f8135fe5700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81301376a0 0x7f8130146a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f8135fe5700 1 -- 172.21.15.8:0/2233531236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813009b240 msgr2=0x7f8130146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f8135fe5700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813009b240 0x7f8130146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f8135fe5700 1 -- 172.21.15.8:0/2233531236 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009420 con 0x7f8130137290 2023-10-14T16:55:06.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f81357e4700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81301376a0 0x7f8130146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:06.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f8135fe5700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8130137290 0x7f81301464f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8128009f20 tx=0x7f812800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:06.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f812dffb700 1 -- 172.21.15.8:0/2233531236 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800cbd0 con 0x7f8130137290 2023-10-14T16:55:06.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f812dffb700 1 -- 172.21.15.8:0/2233531236 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812800f040 con 0x7f8130137290 2023-10-14T16:55:06.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f812dffb700 1 -- 172.21.15.8:0/2233531236 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128014480 con 0x7f8130137290 2023-10-14T16:55:06.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f8138249700 1 -- 172.21.15.8:0/2233531236 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813009c4b0 con 0x7f8130137290 2023-10-14T16:55:06.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.127+0000 7f8138249700 1 -- 172.21.15.8:0/2233531236 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813009c7f0 con 0x7f8130137290 2023-10-14T16:55:06.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.128+0000 7f8138249700 1 -- 172.21.15.8:0/2233531236 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8130068330 con 0x7f8130137290 2023-10-14T16:55:06.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.129+0000 7f812dffb700 1 -- 172.21.15.8:0/2233531236 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81280147f0 con 0x7f8130137290 2023-10-14T16:55:06.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.129+0000 7f812dffb700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f811c066f30 0x7f811c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.129+0000 7f812dffb700 1 -- 172.21.15.8:0/2233531236 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f8128084c80 con 0x7f8130137290 2023-10-14T16:55:06.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.129+0000 7f81357e4700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f811c066f30 0x7f811c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.130+0000 7f81357e4700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f811c066f30 0x7f811c0693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f813009ccb0 tx=0x7f8124009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:06.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.135+0000 7f812dffb700 1 -- 172.21.15.8:0/2233531236 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8128052450 con 0x7f8130137290 2023-10-14T16:55:06.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.327+0000 7f8138249700 1 -- 172.21.15.8:0/2233531236 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81300988b0 con 0x7f8130137290 2023-10-14T16:55:06.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.328+0000 7f812dffb700 1 -- 172.21.15.8:0/2233531236 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12158 (secure 0 0 0) 0x7f8128055a70 con 0x7f8130137290 2023-10-14T16:55:06.329 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:55:06.329 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:56.078671+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-14T16:54:52.330193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-14T16:54:53.459270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:55:06.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.330+0000 7f8138249700 1 -- 172.21.15.8:0/2233531236 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f811c066f30 msgr2=0x7f811c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.330+0000 7f8138249700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f811c066f30 0x7f811c0693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f813009ccb0 tx=0x7f8124009040 comp rx=0 tx=0).stop 2023-10-14T16:55:06.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.330+0000 7f8138249700 1 -- 172.21.15.8:0/2233531236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8130137290 msgr2=0x7f81301464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.330+0000 7f8138249700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8130137290 0x7f81301464f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8128009f20 tx=0x7f812800b040 comp rx=0 tx=0).stop 2023-10-14T16:55:06.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.330+0000 7f8138249700 1 -- 172.21.15.8:0/2233531236 shutdown_connections 2023-10-14T16:55:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.330+0000 7f8138249700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f811c066f30 0x7f811c0693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.330+0000 7f8138249700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813009b240 0x7f8130146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.330+0000 7f8138249700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8130137290 0x7f81301464f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.330+0000 7f8138249700 1 --2- 172.21.15.8:0/2233531236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81301376a0 0x7f8130146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.330+0000 7f8138249700 1 -- 172.21.15.8:0/2233531236 >> 172.21.15.8:0/2233531236 conn(0x7f8130067820 msgr2=0x7f81300a0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:06.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.330+0000 7f8138249700 1 -- 172.21.15.8:0/2233531236 shutdown_connections 2023-10-14T16:55:06.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.330+0000 7f8138249700 1 -- 172.21.15.8:0/2233531236 wait complete. 2023-10-14T16:55:06.343 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-14T16:54:47.365008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-14T16:54:48.035513+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T16:54:52.330193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T16:54:53.459270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T16:55:06.344 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-14T16:55:06.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.466+0000 7fe8a1f4e700 1 Processor -- start 2023-10-14T16:55:06.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.466+0000 7fe8a1f4e700 1 -- start start 2023-10-14T16:55:06.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.466+0000 7fe8a1f4e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c097210 0x7fe89c137280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.466+0000 7fe8a1f4e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe89c1377c0 0x7fe89c133710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.466+0000 7fe8a1f4e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c137bf0 con 0x7fe89c133c50 2023-10-14T16:55:06.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.466+0000 7fe8a1f4e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c0a63b0 con 0x7fe89c1377c0 2023-10-14T16:55:06.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.466+0000 7fe8a1f4e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c095a70 con 0x7fe89c097210 2023-10-14T16:55:06.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.466+0000 7fe89affd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe89c1377c0 0x7fe89c133710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.466+0000 7fe89bfff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe89c133c50 0x7fe89c13e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42498/0 (socket says 172.21.15.8:42498) 2023-10-14T16:55:06.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.466+0000 7fe89affd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe89c1377c0 0x7fe89c133710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53594/0 (socket says 172.21.15.8:53594) 2023-10-14T16:55:06.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.466+0000 7fe89bfff700 1 -- 172.21.15.8:0/469052325 learned_addr learned my addr 172.21.15.8:0/469052325 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:06.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.467+0000 7fe89b7fe700 1 --2- 172.21.15.8:0/469052325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c097210 0x7fe89c137280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.467+0000 7fe89affd700 1 -- 172.21.15.8:0/469052325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c097210 msgr2=0x7fe89c137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:06.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.467+0000 7fe89affd700 1 --2- 172.21.15.8:0/469052325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c097210 0x7fe89c137280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.467+0000 7fe89affd700 1 -- 172.21.15.8:0/469052325 >> v1:172.21.15.8:6789/0 conn(0x7fe89c133c50 legacy=0x7fe89c13e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.467+0000 7fe89affd700 1 -- 172.21.15.8:0/469052325 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c136d90 con 0x7fe89c1377c0 2023-10-14T16:55:06.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.467+0000 7fe89b7fe700 1 --2- 172.21.15.8:0/469052325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c097210 0x7fe89c137280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:06.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.467+0000 7fe89a7fc700 1 -- 172.21.15.8:0/469052325 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948765978 0 0) 0x7fe89c137bf0 con 0x7fe89c133c50 2023-10-14T16:55:06.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.467+0000 7fe89affd700 1 --2- 172.21.15.8:0/469052325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c1377c0 0x7fe89c133710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0098e0 tx=0x7fe88c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38806fee0e8f5ff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:06.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.467+0000 7fe89a7fc700 1 -- 172.21.15.8:0/469052325 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c009e80 con 0x7fe89c1377c0 2023-10-14T16:55:06.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.467+0000 7fe89a7fc700 1 -- 172.21.15.8:0/469052325 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c00b860 con 0x7fe89c1377c0 2023-10-14T16:55:06.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.467+0000 7fe89a7fc700 1 -- 172.21.15.8:0/469052325 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00bbe0 con 0x7fe89c1377c0 2023-10-14T16:55:06.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.468+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/469052325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c1377c0 msgr2=0x7fe89c133710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.468+0000 7fe8a1f4e700 1 --2- 172.21.15.8:0/469052325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c1377c0 0x7fe89c133710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0098e0 tx=0x7fe88c0091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.468+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/469052325 shutdown_connections 2023-10-14T16:55:06.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.468+0000 7fe8a1f4e700 1 --2- 172.21.15.8:0/469052325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c097210 0x7fe89c137280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.468+0000 7fe8a1f4e700 1 --2- 172.21.15.8:0/469052325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c1377c0 0x7fe89c133710 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.468+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/469052325 >> 172.21.15.8:0/469052325 conn(0x7fe89c06ab90 msgr2=0x7fe89c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:06.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.468+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/469052325 shutdown_connections 2023-10-14T16:55:06.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.468+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/469052325 wait complete. 2023-10-14T16:55:06.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe8a1f4e700 1 Processor -- start 2023-10-14T16:55:06.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe8a1f4e700 1 -- start start 2023-10-14T16:55:06.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe8a1f4e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c097210 0x7fe89c09de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe8a1f4e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c133c50 0x7fe89c146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe8a1f4e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe89c1377c0 0x7fe89c146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe8a1f4e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c09f0a0 con 0x7fe89c097210 2023-10-14T16:55:06.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe8a1f4e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c09f300 con 0x7fe89c1377c0 2023-10-14T16:55:06.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe8a1f4e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c146590 con 0x7fe89c133c50 2023-10-14T16:55:06.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe89b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c097210 0x7fe89c09de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe89b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c097210 0x7fe89c09de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53598/0 (socket says 172.21.15.8:53598) 2023-10-14T16:55:06.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe89b7fe700 1 -- 172.21.15.8:0/1388871731 learned_addr learned my addr 172.21.15.8:0/1388871731 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:06.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe89b7fe700 1 -- 172.21.15.8:0/1388871731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c133c50 msgr2=0x7fe89c146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe89affd700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c133c50 0x7fe89c146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe89b7fe700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c133c50 0x7fe89c146850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe89b7fe700 1 -- 172.21.15.8:0/1388871731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe89c1377c0 msgr2=0x7fe89c146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe89b7fe700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe89c1377c0 0x7fe89c146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.469+0000 7fe89b7fe700 1 -- 172.21.15.8:0/1388871731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c009420 con 0x7fe89c097210 2023-10-14T16:55:06.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.470+0000 7fe89b7fe700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c097210 0x7fe89c09de20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe88400e8d0 tx=0x7fe884008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:06.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.470+0000 7fe8937fe700 1 -- 172.21.15.8:0/1388871731 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400ee70 con 0x7fe89c097210 2023-10-14T16:55:06.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.470+0000 7fe8937fe700 1 -- 172.21.15.8:0/1388871731 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88400c5e0 con 0x7fe89c097210 2023-10-14T16:55:06.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.470+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/1388871731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c09f5c0 con 0x7fe89c097210 2023-10-14T16:55:06.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.470+0000 7fe8937fe700 1 -- 172.21.15.8:0/1388871731 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400c980 con 0x7fe89c097210 2023-10-14T16:55:06.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.470+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/1388871731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c147350 con 0x7fe89c097210 2023-10-14T16:55:06.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.471+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/1388871731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c0708d0 con 0x7fe89c097210 2023-10-14T16:55:06.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.471+0000 7fe8937fe700 1 -- 172.21.15.8:0/1388871731 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe884013410 con 0x7fe89c097210 2023-10-14T16:55:06.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.472+0000 7fe8937fe700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe87c066f30 0x7fe87c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.472+0000 7fe89affd700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe87c066f30 0x7fe87c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.472+0000 7fe8937fe700 1 -- 172.21.15.8:0/1388871731 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fe884084060 con 0x7fe89c097210 2023-10-14T16:55:06.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.472+0000 7fe89affd700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe87c066f30 0x7fe87c0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0a03b0 tx=0x7fe88c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:06.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.476+0000 7fe8937fe700 1 -- 172.21.15.8:0/1388871731 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe884051830 con 0x7fe89c097210 2023-10-14T16:55:06.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.669+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/1388871731 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe89c096520 con 0x7fe89c097210 2023-10-14T16:55:06.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.669+0000 7fe8937fe700 1 -- 172.21.15.8:0/1388871731 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe884054e50 con 0x7fe89c097210 2023-10-14T16:55:06.671 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2023-10-14T16:55:06.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.671+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/1388871731 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe87c066f30 msgr2=0x7fe87c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.671+0000 7fe8a1f4e700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe87c066f30 0x7fe87c0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0a03b0 tx=0x7fe88c017000 comp rx=0 tx=0).stop 2023-10-14T16:55:06.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.671+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/1388871731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c097210 msgr2=0x7fe89c09de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.671+0000 7fe8a1f4e700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c097210 0x7fe89c09de20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe88400e8d0 tx=0x7fe884008040 comp rx=0 tx=0).stop 2023-10-14T16:55:06.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.671+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/1388871731 shutdown_connections 2023-10-14T16:55:06.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.671+0000 7fe8a1f4e700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe87c066f30 0x7fe87c0693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.671+0000 7fe8a1f4e700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe89c1377c0 0x7fe89c146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.671+0000 7fe8a1f4e700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe89c097210 0x7fe89c09de20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.671+0000 7fe8a1f4e700 1 --2- 172.21.15.8:0/1388871731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe89c133c50 0x7fe89c146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.671+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/1388871731 >> 172.21.15.8:0/1388871731 conn(0x7fe89c06ab90 msgr2=0x7fe89c0a8960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:06.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.671+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/1388871731 shutdown_connections 2023-10-14T16:55:06.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.671+0000 7fe8a1f4e700 1 -- 172.21.15.8:0/1388871731 wait complete. 2023-10-14T16:55:06.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T16:55:06.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.806+0000 7f64598b2700 1 Processor -- start 2023-10-14T16:55:06.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.806+0000 7f64598b2700 1 -- start start 2023-10-14T16:55:06.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.806+0000 7f64598b2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645413d810 0x7f645413fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.806+0000 7f64598b2700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6454097400 con 0x7f64540a6990 2023-10-14T16:55:06.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.806+0000 7f64598b2700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6454096160 con 0x7f6454139d10 2023-10-14T16:55:06.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.806+0000 7f64598b2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64540a5ed0 con 0x7f645413d810 2023-10-14T16:55:06.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6452ffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f64540a6990 0x7f64541371d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42510/0 (socket says 172.21.15.8:42510) 2023-10-14T16:55:06.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6452ffd700 1 -- 172.21.15.8:0/533899021 learned_addr learned my addr 172.21.15.8:0/533899021 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:06.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f64537fe700 1 --2- 172.21.15.8:0/533899021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645413d810 0x7f645413fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085906517 0 0) 0x7f644c001290 con 0x7f64540a6990 2023-10-14T16:55:06.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6440003570 con 0x7f64540a6990 2023-10-14T16:55:06.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 945801221 0 0) 0x7f6440003570 con 0x7f64540a6990 2023-10-14T16:55:06.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645413d810 msgr2=0x7f645413fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:06.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 --2- 172.21.15.8:0/533899021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645413d810 0x7f645413fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 >> v1:172.21.15.155:6789/0 conn(0x7f6454139d10 legacy=0x7f645413c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540a6130 con 0x7f64540a6990 2023-10-14T16:55:06.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f644c001780 con 0x7f64540a6990 2023-10-14T16:55:06.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 >> v1:172.21.15.8:6789/0 conn(0x7f64540a6990 legacy=0x7f64541371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 --2- 172.21.15.8:0/533899021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6440003a90 0x7f6440003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 --2- 172.21.15.8:0/533899021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6440004810 0x7f6440004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 --2- 172.21.15.8:0/533899021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645413d810 0x7f64400051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64540a5ed0 con 0x7f6440003a90 2023-10-14T16:55:06.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644000bb60 con 0x7f6440004810 2023-10-14T16:55:06.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644000bd20 con 0x7f645413d810 2023-10-14T16:55:06.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f6452ffd700 1 --2- 172.21.15.8:0/533899021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6440003a90 0x7f6440003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f64527fc700 1 --2- 172.21.15.8:0/533899021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6440004810 0x7f6440004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.807+0000 7f64537fe700 1 --2- 172.21.15.8:0/533899021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645413d810 0x7f64400051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f6452ffd700 1 -- 172.21.15.8:0/533899021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645413d810 msgr2=0x7f64400051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:06.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f6452ffd700 1 --2- 172.21.15.8:0/533899021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645413d810 0x7f64400051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f6452ffd700 1 -- 172.21.15.8:0/533899021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6440004810 msgr2=0x7f6440004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:06.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f6452ffd700 1 --2- 172.21.15.8:0/533899021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6440004810 0x7f6440004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f6452ffd700 1 -- 172.21.15.8:0/533899021 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6440003570 con 0x7f6440003a90 2023-10-14T16:55:06.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f6452ffd700 1 --2- 172.21.15.8:0/533899021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6440003a90 0x7f6440003ea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f644c00c5f0 tx=0x7f64540a62c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fe32f637905213 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:06.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c00cdf0 con 0x7f6440003a90 2023-10-14T16:55:06.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c0070d0 con 0x7f6440003a90 2023-10-14T16:55:06.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f6451ffb700 1 -- 172.21.15.8:0/533899021 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c007490 con 0x7f6440003a90 2023-10-14T16:55:06.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f64598b2700 1 -- 172.21.15.8:0/533899021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6440003a90 msgr2=0x7f6440003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f64598b2700 1 --2- 172.21.15.8:0/533899021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6440003a90 0x7f6440003ea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f644c00c5f0 tx=0x7f64540a62c0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f64537fe700 1 -- 172.21.15.8:0/533899021 reap_dead start 2023-10-14T16:55:06.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f64598b2700 1 -- 172.21.15.8:0/533899021 shutdown_connections 2023-10-14T16:55:06.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f64598b2700 1 -- 172.21.15.8:0/533899021 >> 172.21.15.8:0/533899021 conn(0x7f645406a820 msgr2=0x7f64540701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:06.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f64598b2700 1 -- 172.21.15.8:0/533899021 shutdown_connections 2023-10-14T16:55:06.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.808+0000 7f64598b2700 1 -- 172.21.15.8:0/533899021 wait complete. 2023-10-14T16:55:06.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.809+0000 7f64598b2700 1 Processor -- start 2023-10-14T16:55:06.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.809+0000 7f64598b2700 1 -- start start 2023-10-14T16:55:06.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f64598b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6440003a90 0x7f6454146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f64598b2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645409c390 0x7f6454147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f64598b2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6454147760 0x7f6454132440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f64598b2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645409b160 con 0x7f6440003a90 2023-10-14T16:55:06.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f64598b2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645409bc40 con 0x7f6454147760 2023-10-14T16:55:06.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f64598b2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645409c900 con 0x7f645409c390 2023-10-14T16:55:06.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f6452ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6440003a90 0x7f6454146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f6452ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6440003a90 0x7f6454146ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53616/0 (socket says 172.21.15.8:53616) 2023-10-14T16:55:06.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f6452ffd700 1 -- 172.21.15.8:0/2729681868 learned_addr learned my addr 172.21.15.8:0/2729681868 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:06.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f64527fc700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645409c390 0x7f6454147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f64537fe700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6454147760 0x7f6454132440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f6452ffd700 1 -- 172.21.15.8:0/2729681868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645409c390 msgr2=0x7f6454147220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f6452ffd700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645409c390 0x7f6454147220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f6452ffd700 1 -- 172.21.15.8:0/2729681868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6454147760 msgr2=0x7f6454132440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:06.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f6452ffd700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6454147760 0x7f6454132440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:06.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f6452ffd700 1 -- 172.21.15.8:0/2729681868 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6454099590 con 0x7f6440003a90 2023-10-14T16:55:06.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f64537fe700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6454147760 0x7f6454132440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:06.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.810+0000 7f6452ffd700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6440003a90 0x7f6454146ce0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f644c000ef0 tx=0x7f644c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:06.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.811+0000 7f644affd700 1 -- 172.21.15.8:0/2729681868 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c005c10 con 0x7f6440003a90 2023-10-14T16:55:06.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.811+0000 7f644affd700 1 -- 172.21.15.8:0/2729681868 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c005d90 con 0x7f6440003a90 2023-10-14T16:55:06.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.811+0000 7f644affd700 1 -- 172.21.15.8:0/2729681868 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c007490 con 0x7f6440003a90 2023-10-14T16:55:06.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.811+0000 7f64598b2700 1 -- 172.21.15.8:0/2729681868 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645409b6a0 con 0x7f6440003a90 2023-10-14T16:55:06.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.811+0000 7f64598b2700 1 -- 172.21.15.8:0/2729681868 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645409b960 con 0x7f6440003a90 2023-10-14T16:55:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.812+0000 7f64598b2700 1 -- 172.21.15.8:0/2729681868 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645406abf0 con 0x7f6440003a90 2023-10-14T16:55:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.812+0000 7f644affd700 1 -- 172.21.15.8:0/2729681868 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f644c019070 con 0x7f6440003a90 2023-10-14T16:55:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.813+0000 7f644affd700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6434066f30 0x7f64340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.813+0000 7f64527fc700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6434066f30 0x7f64340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:06.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.813+0000 7f644affd700 1 -- 172.21.15.8:0/2729681868 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f644c085030 con 0x7f6440003a90 2023-10-14T16:55:06.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.813+0000 7f64527fc700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6434066f30 0x7f64340693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6454099c70 tx=0x7f643c007d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:06.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:06.817+0000 7f644affd700 1 -- 172.21.15.8:0/2729681868 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f644c052800 con 0x7f6440003a90 2023-10-14T16:55:07.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.007+0000 7f64598b2700 1 -- 172.21.15.8:0/2729681868 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6454097400 con 0x7f6440003a90 2023-10-14T16:55:07.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.007+0000 7f644affd700 1 -- 172.21.15.8:0/2729681868 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6454097400 con 0x7f6440003a90 2023-10-14T16:55:07.008 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-14T16:55:07.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.009+0000 7f64598b2700 1 -- 172.21.15.8:0/2729681868 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6434066f30 msgr2=0x7f64340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.009+0000 7f64598b2700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6434066f30 0x7f64340693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6454099c70 tx=0x7f643c007d10 comp rx=0 tx=0).stop 2023-10-14T16:55:07.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.009+0000 7f64598b2700 1 -- 172.21.15.8:0/2729681868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6440003a90 msgr2=0x7f6454146ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.009+0000 7f64598b2700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6440003a90 0x7f6454146ce0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f644c000ef0 tx=0x7f644c015000 comp rx=0 tx=0).stop 2023-10-14T16:55:07.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.009+0000 7f64598b2700 1 -- 172.21.15.8:0/2729681868 shutdown_connections 2023-10-14T16:55:07.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.009+0000 7f64598b2700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6434066f30 0x7f64340693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.009+0000 7f64598b2700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6454147760 0x7f6454132440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.009+0000 7f64598b2700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6440003a90 0x7f6454146ce0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.009+0000 7f64598b2700 1 --2- 172.21.15.8:0/2729681868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f645409c390 0x7f6454147220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.009+0000 7f64598b2700 1 -- 172.21.15.8:0/2729681868 >> 172.21.15.8:0/2729681868 conn(0x7f645406a820 msgr2=0x7f64541345c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:07.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.009+0000 7f64598b2700 1 -- 172.21.15.8:0/2729681868 shutdown_connections 2023-10-14T16:55:07.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.009+0000 7f64598b2700 1 -- 172.21.15.8:0/2729681868 wait complete. 2023-10-14T16:55:07.022 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T16:55:07.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.143+0000 7f3dd866c700 1 Processor -- start 2023-10-14T16:55:07.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.143+0000 7f3dd866c700 1 -- start start 2023-10-14T16:55:07.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.143+0000 7f3dd866c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3dd0137990 0x7f3dd013c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.143+0000 7f3dd866c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dd013c5c0 0x7f3dd013e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.143+0000 7f3dd866c700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd00a63b0 con 0x7f3dd0097210 2023-10-14T16:55:07.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.143+0000 7f3dd866c700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd0095a70 con 0x7f3dd0137990 2023-10-14T16:55:07.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.143+0000 7f3dd866c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0136d90 con 0x7f3dd013c5c0 2023-10-14T16:55:07.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.144+0000 7f3dd6c09700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dd013c5c0 0x7f3dd013e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.144+0000 7f3dd5c07700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3dd0137990 0x7f3dd013c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.144+0000 7f3dd6c09700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dd013c5c0 0x7f3dd013e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.8:56304/0 (socket says 172.21.15.8:56304) 2023-10-14T16:55:07.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.144+0000 7f3dd6c09700 1 -- 172.21.15.8:0/3509542890 learned_addr learned my addr 172.21.15.8:0/3509542890 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:07.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.144+0000 7f3dd5c07700 1 -- 172.21.15.8:0/3509542890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dd013c5c0 msgr2=0x7f3dd013e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:07.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.144+0000 7f3dd5c07700 1 --2- 172.21.15.8:0/3509542890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dd013c5c0 0x7f3dd013e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.144+0000 7f3dd5c07700 1 -- 172.21.15.8:0/3509542890 >> v1:172.21.15.155:6789/0 conn(0x7f3dd0097210 legacy=0x7f3dd0137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.144+0000 7f3dd5c07700 1 -- 172.21.15.8:0/3509542890 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd0096520 con 0x7f3dd0137990 2023-10-14T16:55:07.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.144+0000 7f3dd5c07700 1 --2- 172.21.15.8:0/3509542890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dd0137990 0x7f3dd013c080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40098e0 tx=0x7f3dc40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=776987fd8519ca9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:07.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.144+0000 7f3dd5406700 1 -- 172.21.15.8:0/3509542890 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc400b640 con 0x7f3dd0137990 2023-10-14T16:55:07.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.144+0000 7f3dd5406700 1 -- 172.21.15.8:0/3509542890 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc400b7a0 con 0x7f3dd0137990 2023-10-14T16:55:07.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.144+0000 7f3dd5406700 1 -- 172.21.15.8:0/3509542890 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc400bb40 con 0x7f3dd0137990 2023-10-14T16:55:07.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.145+0000 7f3dd866c700 1 -- 172.21.15.8:0/3509542890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dd0137990 msgr2=0x7f3dd013c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.145+0000 7f3dd866c700 1 --2- 172.21.15.8:0/3509542890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dd0137990 0x7f3dd013c080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40098e0 tx=0x7f3dc40091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.145+0000 7f3dd866c700 1 -- 172.21.15.8:0/3509542890 shutdown_connections 2023-10-14T16:55:07.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.145+0000 7f3dd866c700 1 --2- 172.21.15.8:0/3509542890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dd013c5c0 0x7f3dd013e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.145+0000 7f3dd866c700 1 --2- 172.21.15.8:0/3509542890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dd0137990 0x7f3dd013c080 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.145+0000 7f3dd866c700 1 -- 172.21.15.8:0/3509542890 >> 172.21.15.8:0/3509542890 conn(0x7f3dd006ab90 msgr2=0x7f3dd00701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:07.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.145+0000 7f3dd866c700 1 -- 172.21.15.8:0/3509542890 shutdown_connections 2023-10-14T16:55:07.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.145+0000 7f3dd866c700 1 -- 172.21.15.8:0/3509542890 wait complete. 2023-10-14T16:55:07.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd866c700 1 Processor -- start 2023-10-14T16:55:07.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd866c700 1 -- start start 2023-10-14T16:55:07.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd866c700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dd0097210 0x7f3dd009b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd866c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dd0137990 0x7f3dd0097810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd866c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd013c5c0 0x7f3dd0097d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd866c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00a2f90 con 0x7f3dd013c5c0 2023-10-14T16:55:07.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd866c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd009b850 con 0x7f3dd0137990 2023-10-14T16:55:07.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd866c700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd009a620 con 0x7f3dd0097210 2023-10-14T16:55:07.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd6c09700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd013c5c0 0x7f3dd0097d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd5c07700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dd0137990 0x7f3dd0097810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd5c07700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dd0137990 0x7f3dd0097810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.8:35046/0 (socket says 172.21.15.8:35046) 2023-10-14T16:55:07.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd6c09700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd013c5c0 0x7f3dd0097d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53632/0 (socket says 172.21.15.8:53632) 2023-10-14T16:55:07.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd5c07700 1 -- 172.21.15.8:0/189996885 learned_addr learned my addr 172.21.15.8:0/189996885 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:07.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.146+0000 7f3dd6408700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dd0097210 0x7f3dd009b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dd5c07700 1 -- 172.21.15.8:0/189996885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dd0097210 msgr2=0x7f3dd009b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dd5c07700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dd0097210 0x7f3dd009b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dd5c07700 1 -- 172.21.15.8:0/189996885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd013c5c0 msgr2=0x7f3dd0097d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dd5c07700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd013c5c0 0x7f3dd0097d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dd5c07700 1 -- 172.21.15.8:0/189996885 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4009420 con 0x7f3dd0137990 2023-10-14T16:55:07.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dd6408700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dd0097210 0x7f3dd009b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:07.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dd6c09700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd013c5c0 0x7f3dd0097d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:07.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dd5c07700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dd0137990 0x7f3dd0097810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4013000 tx=0x7f3dc4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:07.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dce7fc700 1 -- 172.21.15.8:0/189996885 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc401bb70 con 0x7f3dd0137990 2023-10-14T16:55:07.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dce7fc700 1 -- 172.21.15.8:0/189996885 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc401bcd0 con 0x7f3dd0137990 2023-10-14T16:55:07.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dd866c700 1 -- 172.21.15.8:0/189996885 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd00a3230 con 0x7f3dd0137990 2023-10-14T16:55:07.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dce7fc700 1 -- 172.21.15.8:0/189996885 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4011670 con 0x7f3dd0137990 2023-10-14T16:55:07.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.147+0000 7f3dd866c700 1 -- 172.21.15.8:0/189996885 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd013bca0 con 0x7f3dd0137990 2023-10-14T16:55:07.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.148+0000 7f3dd866c700 1 -- 172.21.15.8:0/189996885 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd0099140 con 0x7f3dd0137990 2023-10-14T16:55:07.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.148+0000 7f3dce7fc700 1 -- 172.21.15.8:0/189996885 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3dc4011a20 con 0x7f3dd0137990 2023-10-14T16:55:07.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.149+0000 7f3dce7fc700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3dbc066f30 0x7f3dbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.149+0000 7f3dce7fc700 1 -- 172.21.15.8:0/189996885 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f3dc40853f0 con 0x7f3dd0137990 2023-10-14T16:55:07.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.149+0000 7f3dd6408700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3dbc066f30 0x7f3dbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.149+0000 7f3dd6408700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3dbc066f30 0x7f3dbc0693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8001dc0 tx=0x7f3dc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:07.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.154+0000 7f3dce7fc700 1 -- 172.21.15.8:0/189996885 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3dc4052b20 con 0x7f3dd0137990 2023-10-14T16:55:07.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.346+0000 7f3dd866c700 1 -- 172.21.15.8:0/189996885 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3dd00708d0 con 0x7f3dd0137990 2023-10-14T16:55:07.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.346+0000 7f3dce7fc700 1 -- 172.21.15.8:0/189996885 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3dc4056140 con 0x7f3dd0137990 2023-10-14T16:55:07.348 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-14T16:55:07.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.349+0000 7f3dd866c700 1 -- 172.21.15.8:0/189996885 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3dbc066f30 msgr2=0x7f3dbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.349+0000 7f3dd866c700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3dbc066f30 0x7f3dbc0693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8001dc0 tx=0x7f3dc8009040 comp rx=0 tx=0).stop 2023-10-14T16:55:07.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.349+0000 7f3dd866c700 1 -- 172.21.15.8:0/189996885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dd0137990 msgr2=0x7f3dd0097810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.349+0000 7f3dd866c700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dd0137990 0x7f3dd0097810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4013000 tx=0x7f3dc4017000 comp rx=0 tx=0).stop 2023-10-14T16:55:07.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.349+0000 7f3dd866c700 1 -- 172.21.15.8:0/189996885 shutdown_connections 2023-10-14T16:55:07.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.349+0000 7f3dd866c700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3dbc066f30 0x7f3dbc0693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.349+0000 7f3dd866c700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dd013c5c0 0x7f3dd0097d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.349+0000 7f3dd866c700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dd0097210 0x7f3dd009b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.349+0000 7f3dd866c700 1 --2- 172.21.15.8:0/189996885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dd0137990 0x7f3dd0097810 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.349+0000 7f3dd866c700 1 -- 172.21.15.8:0/189996885 >> 172.21.15.8:0/189996885 conn(0x7f3dd006ab90 msgr2=0x7f3dd0133700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:07.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.349+0000 7f3dd866c700 1 -- 172.21.15.8:0/189996885 shutdown_connections 2023-10-14T16:55:07.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.349+0000 7f3dd866c700 1 -- 172.21.15.8:0/189996885 wait complete. 2023-10-14T16:55:07.362 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T16:55:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.483+0000 7f4a2c634700 1 Processor -- start 2023-10-14T16:55:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.483+0000 7f4a2c634700 1 -- start start 2023-10-14T16:55:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.483+0000 7f4a2c634700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a24097210 0x7f4a24137280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.483+0000 7f4a2c634700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4a241377c0 0x7f4a24133710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.483+0000 7f4a2c634700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4a24133c50 0x7f4a241340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.483+0000 7f4a2c634700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a24134610 con 0x7f4a24133c50 2023-10-14T16:55:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.483+0000 7f4a2c634700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a24137bf0 con 0x7f4a241377c0 2023-10-14T16:55:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.483+0000 7f4a2c634700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240a63b0 con 0x7f4a24097210 2023-10-14T16:55:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.483+0000 7f4a2abd1700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4a24133c50 0x7f4a241340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.483+0000 7f4a2abd1700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4a24133c50 0x7f4a241340d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35376/0 (socket says 172.21.15.8:35376) 2023-10-14T16:55:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.483+0000 7f4a2abd1700 1 -- 172.21.15.8:0/1585833219 learned_addr learned my addr 172.21.15.8:0/1585833219 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:07.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.484+0000 7f4a29bcf700 1 --2- 172.21.15.8:0/1585833219 >> v2:172.21.15.155:3300/0 conn(0x7f4a241377c0 0x7f4a24133710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.484+0000 7f4a2a3d0700 1 --2- 172.21.15.8:0/1585833219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a24097210 0x7f4a24137280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.484+0000 7f4a2abd1700 1 -- 172.21.15.8:0/1585833219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a24097210 msgr2=0x7f4a24137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:07.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.484+0000 7f4a2abd1700 1 --2- 172.21.15.8:0/1585833219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a24097210 0x7f4a24137280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.484+0000 7f4a2abd1700 1 -- 172.21.15.8:0/1585833219 >> v2:172.21.15.155:3300/0 conn(0x7f4a241377c0 msgr2=0x7f4a24133710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.484+0000 7f4a2abd1700 1 --2- 172.21.15.8:0/1585833219 >> v2:172.21.15.155:3300/0 conn(0x7f4a241377c0 0x7f4a24133710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.484+0000 7f4a2abd1700 1 -- 172.21.15.8:0/1585833219 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a24095a70 con 0x7f4a24133c50 2023-10-14T16:55:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.484+0000 7f4a2abd1700 1 --2- 172.21.15.8:0/1585833219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a24133c50 0x7f4a241340d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a240a9dc0 tx=0x7f4a14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1e22d7988b074b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.484+0000 7f4a293ce700 1 -- 172.21.15.8:0/1585833219 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400e070 con 0x7f4a24133c50 2023-10-14T16:55:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.484+0000 7f4a293ce700 1 -- 172.21.15.8:0/1585833219 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1400b970 con 0x7f4a24133c50 2023-10-14T16:55:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.484+0000 7f4a293ce700 1 -- 172.21.15.8:0/1585833219 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a140092e0 con 0x7f4a24133c50 2023-10-14T16:55:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.485+0000 7f4a2c634700 1 -- 172.21.15.8:0/1585833219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a24133c50 msgr2=0x7f4a241340d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.485+0000 7f4a2c634700 1 --2- 172.21.15.8:0/1585833219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a24133c50 0x7f4a241340d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a240a9dc0 tx=0x7f4a14009840 comp rx=0 tx=0).stop 2023-10-14T16:55:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.485+0000 7f4a2c634700 1 -- 172.21.15.8:0/1585833219 shutdown_connections 2023-10-14T16:55:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.485+0000 7f4a2c634700 1 --2- 172.21.15.8:0/1585833219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a24133c50 0x7f4a241340d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.485+0000 7f4a2c634700 1 --2- 172.21.15.8:0/1585833219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a24097210 0x7f4a24137280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.485+0000 7f4a2c634700 1 --2- 172.21.15.8:0/1585833219 >> v2:172.21.15.155:3300/0 conn(0x7f4a241377c0 0x7f4a24133710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.485+0000 7f4a2c634700 1 -- 172.21.15.8:0/1585833219 >> 172.21.15.8:0/1585833219 conn(0x7f4a2406ab90 msgr2=0x7f4a240701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.485+0000 7f4a2c634700 1 -- 172.21.15.8:0/1585833219 shutdown_connections 2023-10-14T16:55:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.485+0000 7f4a2c634700 1 -- 172.21.15.8:0/1585833219 wait complete. 2023-10-14T16:55:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2c634700 1 Processor -- start 2023-10-14T16:55:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2c634700 1 -- start start 2023-10-14T16:55:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2c634700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a24097210 0x7f4a241309d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2c634700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a24133c50 0x7f4a24130f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2c634700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a241377c0 0x7f4a24146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2c634700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a24098140 con 0x7f4a241377c0 2023-10-14T16:55:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2c634700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2409ba20 con 0x7f4a24097210 2023-10-14T16:55:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2c634700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2409b640 con 0x7f4a24133c50 2023-10-14T16:55:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2abd1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a241377c0 0x7f4a24146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2abd1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a241377c0 0x7f4a24146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35384/0 (socket says 172.21.15.8:35384) 2023-10-14T16:55:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2abd1700 1 -- 172.21.15.8:0/3986695499 learned_addr learned my addr 172.21.15.8:0/3986695499 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2a3d0700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a24097210 0x7f4a241309d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a29bcf700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a24133c50 0x7f4a24130f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2abd1700 1 -- 172.21.15.8:0/3986695499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a24133c50 msgr2=0x7f4a24130f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2abd1700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a24133c50 0x7f4a24130f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2abd1700 1 -- 172.21.15.8:0/3986695499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a24097210 msgr2=0x7f4a241309d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2abd1700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a24097210 0x7f4a241309d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.486+0000 7f4a2abd1700 1 -- 172.21.15.8:0/3986695499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a14009ae0 con 0x7f4a241377c0 2023-10-14T16:55:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.487+0000 7f4a2abd1700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a241377c0 0x7f4a24146660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4a240a7070 tx=0x7f4a14018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.487+0000 7f4a227fc700 1 -- 172.21.15.8:0/3986695499 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14008ad0 con 0x7f4a241377c0 2023-10-14T16:55:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.487+0000 7f4a227fc700 1 -- 172.21.15.8:0/3986695499 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a14008c50 con 0x7f4a241377c0 2023-10-14T16:55:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.487+0000 7f4a2c634700 1 -- 172.21.15.8:0/3986695499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a24131450 con 0x7f4a241377c0 2023-10-14T16:55:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.487+0000 7f4a227fc700 1 -- 172.21.15.8:0/3986695499 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14026460 con 0x7f4a241377c0 2023-10-14T16:55:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.487+0000 7f4a2c634700 1 -- 172.21.15.8:0/3986695499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a24099910 con 0x7f4a241377c0 2023-10-14T16:55:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.488+0000 7f4a2c634700 1 -- 172.21.15.8:0/3986695499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a24099b00 con 0x7f4a241377c0 2023-10-14T16:55:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.488+0000 7f4a227fc700 1 -- 172.21.15.8:0/3986695499 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a14003040 con 0x7f4a241377c0 2023-10-14T16:55:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.489+0000 7f4a227fc700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4a10066f30 0x7f4a100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.489+0000 7f4a227fc700 1 -- 172.21.15.8:0/3986695499 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f4a14085d60 con 0x7f4a241377c0 2023-10-14T16:55:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.489+0000 7f4a2a3d0700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4a10066f30 0x7f4a100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.489+0000 7f4a2a3d0700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4a10066f30 0x7f4a100693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009db0 tx=0x7f4a1c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:07.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.493+0000 7f4a227fc700 1 -- 172.21.15.8:0/3986695499 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a140535e0 con 0x7f4a241377c0 2023-10-14T16:55:07.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.685+0000 7f4a2c634700 1 -- 172.21.15.8:0/3986695499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a240a9430 con 0x7f4a241377c0 2023-10-14T16:55:07.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.685+0000 7f4a227fc700 1 -- 172.21.15.8:0/3986695499 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a140210a0 con 0x7f4a241377c0 2023-10-14T16:55:07.686 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-14T16:55:07.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.687+0000 7f4a2c634700 1 -- 172.21.15.8:0/3986695499 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4a10066f30 msgr2=0x7f4a100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.687+0000 7f4a2c634700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4a10066f30 0x7f4a100693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009db0 tx=0x7f4a1c0091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.687+0000 7f4a2c634700 1 -- 172.21.15.8:0/3986695499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a241377c0 msgr2=0x7f4a24146660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.687+0000 7f4a2c634700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a241377c0 0x7f4a24146660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4a240a7070 tx=0x7f4a14018000 comp rx=0 tx=0).stop 2023-10-14T16:55:07.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.687+0000 7f4a2c634700 1 -- 172.21.15.8:0/3986695499 shutdown_connections 2023-10-14T16:55:07.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.687+0000 7f4a2c634700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4a10066f30 0x7f4a100693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.687+0000 7f4a2c634700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4a241377c0 0x7f4a24146660 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.687+0000 7f4a2c634700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a24097210 0x7f4a241309d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.687+0000 7f4a2c634700 1 --2- 172.21.15.8:0/3986695499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a24133c50 0x7f4a24130f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.687+0000 7f4a2c634700 1 -- 172.21.15.8:0/3986695499 >> 172.21.15.8:0/3986695499 conn(0x7f4a2406ab90 msgr2=0x7f4a24139eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:07.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.687+0000 7f4a2c634700 1 -- 172.21.15.8:0/3986695499 shutdown_connections 2023-10-14T16:55:07.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.687+0000 7f4a2c634700 1 -- 172.21.15.8:0/3986695499 wait complete. 2023-10-14T16:55:07.700 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T16:55:07.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.818+0000 7f3e658d2700 1 Processor -- start 2023-10-14T16:55:07.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.818+0000 7f3e658d2700 1 -- start start 2023-10-14T16:55:07.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e658d2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e60096180 0x7f3e6013c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e658d2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3e600965a0 0x7f3e6013e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e658d2700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6006bf40 con 0x7f3e60029f60 2023-10-14T16:55:07.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e658d2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6006f900 con 0x7f3e600965a0 2023-10-14T16:55:07.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e658d2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e60099390 con 0x7f3e60096180 2023-10-14T16:55:07.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5effd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3e60029f60 0x7f3e60095a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:50720/0 (socket says 172.21.15.8:50720) 2023-10-14T16:55:07.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5effd700 1 -- 172.21.15.8:0/2571240897 learned_addr learned my addr 172.21.15.8:0/2571240897 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:07.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5e7fc700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e60096180 0x7f3e6013c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5f7fe700 1 --2- 172.21.15.8:0/2571240897 >> v2:172.21.15.155:3300/0 conn(0x7f3e600965a0 0x7f3e6013e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872949025 0 0) 0x7f3e6006bf40 con 0x7f3e60029f60 2023-10-14T16:55:07.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e4c003570 con 0x7f3e60029f60 2023-10-14T16:55:07.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1686154292 0 0) 0x7f3e4c003570 con 0x7f3e60029f60 2023-10-14T16:55:07.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e60096180 msgr2=0x7f3e6013c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:07.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e60096180 0x7f3e6013c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 >> v2:172.21.15.155:3300/0 conn(0x7f3e600965a0 msgr2=0x7f3e6013e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:07.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 --2- 172.21.15.8:0/2571240897 >> v2:172.21.15.155:3300/0 conn(0x7f3e600965a0 0x7f3e6013e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6006fc70 con 0x7f3e60029f60 2023-10-14T16:55:07.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f3e580017f0 con 0x7f3e60029f60 2023-10-14T16:55:07.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 >> v1:172.21.15.8:6789/0 conn(0x7f3e60029f60 legacy=0x7f3e60095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e4c003a60 0x7f3e4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e4c004810 0x7f3e4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e4c0051c0 0x7f3e4c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6006f900 con 0x7f3e4c0051c0 2023-10-14T16:55:07.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e60099390 con 0x7f3e4c003a60 2023-10-14T16:55:07.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c00bfa0 con 0x7f3e4c004810 2023-10-14T16:55:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5e7fc700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e60096180 0x7f3e6013c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.819+0000 7f3e5f7fe700 1 --2- 172.21.15.8:0/2571240897 >> v2:172.21.15.155:3300/0 conn(0x7f3e600965a0 0x7f3e6013e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T16:55:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.820+0000 7f3e5effd700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e4c003a60 0x7f3e4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.820+0000 7f3e5f7fe700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e4c0051c0 0x7f3e4c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.820+0000 7f3e5e7fc700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e4c004810 0x7f3e4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.820+0000 7f3e5f7fe700 1 -- 172.21.15.8:0/2571240897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e4c004810 msgr2=0x7f3e4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.820+0000 7f3e5f7fe700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e4c004810 0x7f3e4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.820+0000 7f3e5f7fe700 1 -- 172.21.15.8:0/2571240897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e4c003a60 msgr2=0x7f3e4c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:07.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.820+0000 7f3e5f7fe700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e4c003a60 0x7f3e4c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.820+0000 7f3e5f7fe700 1 -- 172.21.15.8:0/2571240897 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c003570 con 0x7f3e4c0051c0 2023-10-14T16:55:07.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.820+0000 7f3e5f7fe700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e4c0051c0 0x7f3e4c00ba60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009de0 tx=0x7f3e500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe84bdf57fc1f25 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:07.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.820+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000e8c0 con 0x7f3e4c0051c0 2023-10-14T16:55:07.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.820+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5000ea20 con 0x7f3e4c0051c0 2023-10-14T16:55:07.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.820+0000 7f3e5dffb700 1 -- 172.21.15.8:0/2571240897 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000edc0 con 0x7f3e4c0051c0 2023-10-14T16:55:07.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.821+0000 7f3e658d2700 1 -- 172.21.15.8:0/2571240897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e4c0051c0 msgr2=0x7f3e4c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.821+0000 7f3e658d2700 1 --2- 172.21.15.8:0/2571240897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e4c0051c0 0x7f3e4c00ba60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009de0 tx=0x7f3e500091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.821+0000 7f3e5f7fe700 1 -- 172.21.15.8:0/2571240897 reap_dead start 2023-10-14T16:55:07.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.821+0000 7f3e658d2700 1 -- 172.21.15.8:0/2571240897 shutdown_connections 2023-10-14T16:55:07.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.821+0000 7f3e658d2700 1 -- 172.21.15.8:0/2571240897 >> 172.21.15.8:0/2571240897 conn(0x7f3e600701c0 msgr2=0x7f3e600705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:07.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.821+0000 7f3e658d2700 1 -- 172.21.15.8:0/2571240897 shutdown_connections 2023-10-14T16:55:07.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.821+0000 7f3e658d2700 1 -- 172.21.15.8:0/2571240897 wait complete. 2023-10-14T16:55:07.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e658d2700 1 Processor -- start 2023-10-14T16:55:07.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e658d2700 1 -- start start 2023-10-14T16:55:07.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e658d2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e4c0051c0 0x7f3e601467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e658d2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e60123090 0x7f3e60146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e658d2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e60147240 0x7f3e601399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e658d2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e60147670 con 0x7f3e60123090 2023-10-14T16:55:07.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e658d2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e601220f0 con 0x7f3e60147240 2023-10-14T16:55:07.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e658d2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e60121e90 con 0x7f3e4c0051c0 2023-10-14T16:55:07.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e5e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e60123090 0x7f3e60146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e5e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e60123090 0x7f3e60146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35390/0 (socket says 172.21.15.8:35390) 2023-10-14T16:55:07.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e5e7fc700 1 -- 172.21.15.8:0/1948885654 learned_addr learned my addr 172.21.15.8:0/1948885654 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:07.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e5effd700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e4c0051c0 0x7f3e601467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e5f7fe700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e60147240 0x7f3e601399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.822+0000 7f3e5e7fc700 1 -- 172.21.15.8:0/1948885654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e4c0051c0 msgr2=0x7f3e601467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.823+0000 7f3e5e7fc700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e4c0051c0 0x7f3e601467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.823+0000 7f3e5e7fc700 1 -- 172.21.15.8:0/1948885654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e60147240 msgr2=0x7f3e601399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.823+0000 7f3e5e7fc700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e60147240 0x7f3e601399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:07.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.823+0000 7f3e5e7fc700 1 -- 172.21.15.8:0/1948885654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e601223a0 con 0x7f3e60123090 2023-10-14T16:55:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.823+0000 7f3e5f7fe700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e60147240 0x7f3e601399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:55:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.823+0000 7f3e5e7fc700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e60123090 0x7f3e60146d00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3e48011d20 tx=0x7f3e480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.823+0000 7f3e56ffd700 1 -- 172.21.15.8:0/1948885654 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800fac0 con 0x7f3e60123090 2023-10-14T16:55:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.823+0000 7f3e56ffd700 1 -- 172.21.15.8:0/1948885654 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4800fc20 con 0x7f3e60123090 2023-10-14T16:55:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.823+0000 7f3e56ffd700 1 -- 172.21.15.8:0/1948885654 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4801d480 con 0x7f3e60123090 2023-10-14T16:55:07.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.823+0000 7f3e658d2700 1 -- 172.21.15.8:0/1948885654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e60122940 con 0x7f3e60123090 2023-10-14T16:55:07.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.823+0000 7f3e658d2700 1 -- 172.21.15.8:0/1948885654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e60122660 con 0x7f3e60123090 2023-10-14T16:55:07.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.824+0000 7f3e658d2700 1 -- 172.21.15.8:0/1948885654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6006ac80 con 0x7f3e60123090 2023-10-14T16:55:07.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.824+0000 7f3e56ffd700 1 -- 172.21.15.8:0/1948885654 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e4801d830 con 0x7f3e60123090 2023-10-14T16:55:07.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.824+0000 7f3e56ffd700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3e40066f60 0x7f3e40069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:07.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.825+0000 7f3e56ffd700 1 -- 172.21.15.8:0/1948885654 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f3e48018070 con 0x7f3e60123090 2023-10-14T16:55:07.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.825+0000 7f3e5effd700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3e40066f60 0x7f3e40069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:07.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.825+0000 7f3e5effd700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3e40066f60 0x7f3e40069410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e58002020 tx=0x7f3e58006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:07.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:07.829+0000 7f3e56ffd700 1 -- 172.21.15.8:0/1948885654 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e48052690 con 0x7f3e60123090 2023-10-14T16:55:08.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.069+0000 7f3e658d2700 1 -- 172.21.15.8:0/1948885654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e601212e0 con 0x7f3e60123090 2023-10-14T16:55:08.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.069+0000 7f3e56ffd700 1 -- 172.21.15.8:0/1948885654 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3079 (secure 0 0 0) 0x7f3e48022020 con 0x7f3e60123090 2023-10-14T16:55:08.070 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:55:08.071 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6817/3883908964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3883908964},{"type":"v1","addr":"172.21.15.155:6817","nonce":3883908964}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T16:54:54.479174+0000","modified":"2023-10-14T16:54:58.104119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.8:6819/3402040876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3402040876},{"type":"v1","addr":"172.21.15.8:6819","nonce":3402040876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T16:55:08.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.071+0000 7f3e658d2700 1 -- 172.21.15.8:0/1948885654 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3e40066f60 msgr2=0x7f3e40069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:08.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.071+0000 7f3e658d2700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3e40066f60 0x7f3e40069410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e58002020 tx=0x7f3e58006040 comp rx=0 tx=0).stop 2023-10-14T16:55:08.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.071+0000 7f3e658d2700 1 -- 172.21.15.8:0/1948885654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e60123090 msgr2=0x7f3e60146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:08.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.071+0000 7f3e658d2700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e60123090 0x7f3e60146d00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3e48011d20 tx=0x7f3e480091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.071+0000 7f3e658d2700 1 -- 172.21.15.8:0/1948885654 shutdown_connections 2023-10-14T16:55:08.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.071+0000 7f3e658d2700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3e40066f60 0x7f3e40069410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.071+0000 7f3e658d2700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e60147240 0x7f3e601399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.071+0000 7f3e658d2700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e4c0051c0 0x7f3e601467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.071+0000 7f3e658d2700 1 --2- 172.21.15.8:0/1948885654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e60123090 0x7f3e60146d00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.071+0000 7f3e658d2700 1 -- 172.21.15.8:0/1948885654 >> 172.21.15.8:0/1948885654 conn(0x7f3e600701c0 msgr2=0x7f3e6006d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:08.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.071+0000 7f3e658d2700 1 -- 172.21.15.8:0/1948885654 shutdown_connections 2023-10-14T16:55:08.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.071+0000 7f3e658d2700 1 -- 172.21.15.8:0/1948885654 wait complete. 2023-10-14T16:55:08.075 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T16:55:08.084 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T16:55:08.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.202+0000 7f0ef6e2e700 1 Processor -- start 2023-10-14T16:55:08.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef6e2e700 1 -- start start 2023-10-14T16:55:08.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef6e2e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ef00a6940 0x7f0ef00a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef6e2e700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0ef00a25c0 0x7f0ef0133f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef6e2e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef0134450 0x7f0ef0136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef6e2e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef01338f0 con 0x7f0ef00a6940 2023-10-14T16:55:08.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef6e2e700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef0134860 con 0x7f0ef00a25c0 2023-10-14T16:55:08.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef6e2e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00a2df0 con 0x7f0ef0134450 2023-10-14T16:55:08.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef4bca700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ef00a6940 0x7f0ef00a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef4bca700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ef00a6940 0x7f0ef00a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35398/0 (socket says 172.21.15.8:35398) 2023-10-14T16:55:08.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef4bca700 1 -- 172.21.15.8:0/2405647511 learned_addr learned my addr 172.21.15.8:0/2405647511 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:08.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef53cb700 1 --2- 172.21.15.8:0/2405647511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef0134450 0x7f0ef0136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef4bca700 1 -- 172.21.15.8:0/2405647511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef0134450 msgr2=0x7f0ef0136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:08.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0eeffff700 1 --2- 172.21.15.8:0/2405647511 >> v2:172.21.15.155:3300/0 conn(0x7f0ef00a25c0 0x7f0ef0133f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.203+0000 7f0ef4bca700 1 --2- 172.21.15.8:0/2405647511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef0134450 0x7f0ef0136e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef4bca700 1 -- 172.21.15.8:0/2405647511 >> v2:172.21.15.155:3300/0 conn(0x7f0ef00a25c0 msgr2=0x7f0ef0133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:08.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef4bca700 1 --2- 172.21.15.8:0/2405647511 >> v2:172.21.15.155:3300/0 conn(0x7f0ef00a25c0 0x7f0ef0133f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef4bca700 1 -- 172.21.15.8:0/2405647511 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef0133ae0 con 0x7f0ef00a6940 2023-10-14T16:55:08.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef53cb700 1 --2- 172.21.15.8:0/2405647511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef0134450 0x7f0ef0136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:55:08.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0eeffff700 1 --2- 172.21.15.8:0/2405647511 >> v2:172.21.15.155:3300/0 conn(0x7f0ef00a25c0 0x7f0ef0133f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T16:55:08.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef4bca700 1 --2- 172.21.15.8:0/2405647511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef00a6940 0x7f0ef00a1310 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00a78f0 tx=0x7f0ee8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c0caa88f6f8bb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:08.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0eef7fe700 1 -- 172.21.15.8:0/2405647511 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800e070 con 0x7f0ef00a6940 2023-10-14T16:55:08.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0eef7fe700 1 -- 172.21.15.8:0/2405647511 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee800ba40 con 0x7f0ef00a6940 2023-10-14T16:55:08.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0eef7fe700 1 -- 172.21.15.8:0/2405647511 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee80092e0 con 0x7f0ef00a6940 2023-10-14T16:55:08.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/2405647511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef00a6940 msgr2=0x7f0ef00a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:08.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef6e2e700 1 --2- 172.21.15.8:0/2405647511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef00a6940 0x7f0ef00a1310 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00a78f0 tx=0x7f0ee8009840 comp rx=0 tx=0).stop 2023-10-14T16:55:08.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/2405647511 shutdown_connections 2023-10-14T16:55:08.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef6e2e700 1 --2- 172.21.15.8:0/2405647511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef0134450 0x7f0ef0136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef6e2e700 1 --2- 172.21.15.8:0/2405647511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef00a6940 0x7f0ef00a1310 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef6e2e700 1 --2- 172.21.15.8:0/2405647511 >> v2:172.21.15.155:3300/0 conn(0x7f0ef00a25c0 0x7f0ef0133f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/2405647511 >> 172.21.15.8:0/2405647511 conn(0x7f0ef006acd0 msgr2=0x7f0ef00701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:08.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.204+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/2405647511 shutdown_connections 2023-10-14T16:55:08.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.205+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/2405647511 wait complete. 2023-10-14T16:55:08.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.205+0000 7f0ef6e2e700 1 Processor -- start 2023-10-14T16:55:08.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.206+0000 7f0ef6e2e700 1 -- start start 2023-10-14T16:55:08.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.206+0000 7f0ef6e2e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef00a25c0 0x7f0ef0095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.206+0000 7f0ef6e2e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef0134450 0x7f0ef0095fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.206+0000 7f0ef6e2e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef0098670 0x7f0ef00964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.206+0000 7f0ef6e2e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0098bd0 con 0x7f0ef00a25c0 2023-10-14T16:55:08.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.206+0000 7f0ef6e2e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0099930 con 0x7f0ef0134450 2023-10-14T16:55:08.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.206+0000 7f0ef6e2e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0098e90 con 0x7f0ef0098670 2023-10-14T16:55:08.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.206+0000 7f0ef4bca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef00a25c0 0x7f0ef0095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.206+0000 7f0ef4bca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef00a25c0 0x7f0ef0095a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35404/0 (socket says 172.21.15.8:35404) 2023-10-14T16:55:08.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.206+0000 7f0ef4bca700 1 -- 172.21.15.8:0/221626344 learned_addr learned my addr 172.21.15.8:0/221626344 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:08.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.206+0000 7f0ef53cb700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef0098670 0x7f0ef00964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.206+0000 7f0eeffff700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef0134450 0x7f0ef0095fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.207+0000 7f0ef4bca700 1 -- 172.21.15.8:0/221626344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef0098670 msgr2=0x7f0ef00964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:08.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.207+0000 7f0ef4bca700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef0098670 0x7f0ef00964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.207+0000 7f0ef4bca700 1 -- 172.21.15.8:0/221626344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef0134450 msgr2=0x7f0ef0095fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:08.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.207+0000 7f0ef4bca700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef0134450 0x7f0ef0095fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.207+0000 7f0ef4bca700 1 -- 172.21.15.8:0/221626344 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee8009ae0 con 0x7f0ef00a25c0 2023-10-14T16:55:08.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.207+0000 7f0eeffff700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef0134450 0x7f0ef0095fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:08.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.207+0000 7f0ef4bca700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef00a25c0 0x7f0ef0095a70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0071120 tx=0x7f0ee8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:08.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.207+0000 7f0eecff9700 1 -- 172.21.15.8:0/221626344 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8008aa0 con 0x7f0ef00a25c0 2023-10-14T16:55:08.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.207+0000 7f0eecff9700 1 -- 172.21.15.8:0/221626344 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee8008c00 con 0x7f0ef00a25c0 2023-10-14T16:55:08.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.207+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/221626344 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef0099600 con 0x7f0ef00a25c0 2023-10-14T16:55:08.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.207+0000 7f0eecff9700 1 -- 172.21.15.8:0/221626344 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8026460 con 0x7f0ef00a25c0 2023-10-14T16:55:08.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.207+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/221626344 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef013af50 con 0x7f0ef00a25c0 2023-10-14T16:55:08.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.208+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/221626344 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef00708d0 con 0x7f0ef00a25c0 2023-10-14T16:55:08.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.208+0000 7f0eecff9700 1 -- 172.21.15.8:0/221626344 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ee8003040 con 0x7f0ef00a25c0 2023-10-14T16:55:08.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.209+0000 7f0eecff9700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0ed0066f30 0x7f0ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.209+0000 7f0eeffff700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0ed0066f30 0x7f0ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.209+0000 7f0eecff9700 1 -- 172.21.15.8:0/221626344 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f0ee8085e00 con 0x7f0ef00a25c0 2023-10-14T16:55:08.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.209+0000 7f0eeffff700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0ed0066f30 0x7f0ed00693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0098370 tx=0x7f0ed8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:08.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.213+0000 7f0eecff9700 1 -- 172.21.15.8:0/221626344 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ee80535d0 con 0x7f0ef00a25c0 2023-10-14T16:55:08.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.407+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/221626344 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ef00978a0 con 0x7f0ef00a25c0 2023-10-14T16:55:08.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.408+0000 7f0eecff9700 1 -- 172.21.15.8:0/221626344 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12158 (secure 0 0 0) 0x7f0ee8056bf0 con 0x7f0ef00a25c0 2023-10-14T16:55:08.409 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:55:08.410 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:54:56.078671+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-14T16:54:52.330193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-14T16:54:53.459270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T16:55:08.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.410+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/221626344 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0ed0066f30 msgr2=0x7f0ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.410+0000 7f0ef6e2e700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0ed0066f30 0x7f0ed00693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0098370 tx=0x7f0ed8008040 comp rx=0 tx=0).stop 2023-10-14T16:55:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.410+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/221626344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef00a25c0 msgr2=0x7f0ef0095a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.410+0000 7f0ef6e2e700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef00a25c0 0x7f0ef0095a70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0071120 tx=0x7f0ee8018000 comp rx=0 tx=0).stop 2023-10-14T16:55:08.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.410+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/221626344 shutdown_connections 2023-10-14T16:55:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.410+0000 7f0ef6e2e700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0ed0066f30 0x7f0ed00693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.410+0000 7f0ef6e2e700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef0098670 0x7f0ef00964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.410+0000 7f0ef6e2e700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef00a25c0 0x7f0ef0095a70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.410+0000 7f0ef6e2e700 1 --2- 172.21.15.8:0/221626344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef0134450 0x7f0ef0095fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.410+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/221626344 >> 172.21.15.8:0/221626344 conn(0x7f0ef006acd0 msgr2=0x7f0ef00a2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:08.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.411+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/221626344 shutdown_connections 2023-10-14T16:55:08.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.411+0000 7f0ef6e2e700 1 -- 172.21.15.8:0/221626344 wait complete. 2023-10-14T16:55:08.423 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T16:55:08.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.541+0000 7fbea91bc700 1 Processor -- start 2023-10-14T16:55:08.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.541+0000 7fbea91bc700 1 -- start start 2023-10-14T16:55:08.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.541+0000 7fbea91bc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbea40a37c0 0x7fbea4130c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.541+0000 7fbea91bc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbea40a0d30 0x7fbea40a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.541+0000 7fbea91bc700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea406c260 con 0x7fbea4131180 2023-10-14T16:55:08.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.541+0000 7fbea91bc700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea406cd10 con 0x7fbea40a37c0 2023-10-14T16:55:08.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.541+0000 7fbea91bc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea4130570 con 0x7fbea40a0d30 2023-10-14T16:55:08.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.541+0000 7fbea2d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbea40a37c0 0x7fbea4130c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.541+0000 7fbea2d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbea40a37c0 0x7fbea4130c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35406/0 (socket says 172.21.15.8:35406) 2023-10-14T16:55:08.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.541+0000 7fbea2d9d700 1 -- 172.21.15.8:0/3674548990 learned_addr learned my addr 172.21.15.8:0/3674548990 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:08.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea359e700 1 --2- 172.21.15.8:0/3674548990 >> v2:172.21.15.155:3300/0 conn(0x7fbea40a0d30 0x7fbea40a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea2d9d700 1 -- 172.21.15.8:0/3674548990 >> v2:172.21.15.155:3300/0 conn(0x7fbea40a0d30 msgr2=0x7fbea40a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:08.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea2d9d700 1 --2- 172.21.15.8:0/3674548990 >> v2:172.21.15.155:3300/0 conn(0x7fbea40a0d30 0x7fbea40a1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea2d9d700 1 -- 172.21.15.8:0/3674548990 >> v1:172.21.15.155:6789/0 conn(0x7fbea4131180 legacy=0x7fbea40a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:08.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea2d9d700 1 -- 172.21.15.8:0/3674548990 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea406c4b0 con 0x7fbea40a37c0 2023-10-14T16:55:08.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea2d9d700 1 --2- 172.21.15.8:0/3674548990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbea40a37c0 0x7fbea4130c40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbea40a4630 tx=0x7fbe9400b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4a157836685402 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:08.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea1d9b700 1 -- 172.21.15.8:0/3674548990 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94005c10 con 0x7fbea40a37c0 2023-10-14T16:55:08.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea1d9b700 1 -- 172.21.15.8:0/3674548990 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe94005d70 con 0x7fbea40a37c0 2023-10-14T16:55:08.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea1d9b700 1 -- 172.21.15.8:0/3674548990 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9400dc10 con 0x7fbea40a37c0 2023-10-14T16:55:08.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea91bc700 1 -- 172.21.15.8:0/3674548990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbea40a37c0 msgr2=0x7fbea4130c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:08.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea91bc700 1 --2- 172.21.15.8:0/3674548990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbea40a37c0 0x7fbea4130c40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbea40a4630 tx=0x7fbe9400b4c0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea91bc700 1 -- 172.21.15.8:0/3674548990 shutdown_connections 2023-10-14T16:55:08.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea91bc700 1 --2- 172.21.15.8:0/3674548990 >> v2:172.21.15.155:3300/0 conn(0x7fbea40a0d30 0x7fbea40a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea91bc700 1 --2- 172.21.15.8:0/3674548990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbea40a37c0 0x7fbea4130c40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.542+0000 7fbea91bc700 1 -- 172.21.15.8:0/3674548990 >> 172.21.15.8:0/3674548990 conn(0x7fbea40701c0 msgr2=0x7fbea40705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:08.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.543+0000 7fbea91bc700 1 -- 172.21.15.8:0/3674548990 shutdown_connections 2023-10-14T16:55:08.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.543+0000 7fbea91bc700 1 -- 172.21.15.8:0/3674548990 wait complete. 2023-10-14T16:55:08.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.543+0000 7fbea91bc700 1 Processor -- start 2023-10-14T16:55:08.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea91bc700 1 -- start start 2023-10-14T16:55:08.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea91bc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbea40a0d30 0x7fbea4097cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea91bc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbea4131180 0x7fbea40981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea91bc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbea4098730 0x7fbea4098bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea91bc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea409bac0 con 0x7fbea4131180 2023-10-14T16:55:08.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea91bc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea40a3360 con 0x7fbea40a0d30 2023-10-14T16:55:08.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea91bc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea409b3a0 con 0x7fbea4098730 2023-10-14T16:55:08.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbea4131180 0x7fbea40981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbea4131180 0x7fbea40981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35416/0 (socket says 172.21.15.8:35416) 2023-10-14T16:55:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea259c700 1 -- 172.21.15.8:0/523058215 learned_addr learned my addr 172.21.15.8:0/523058215 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea2d9d700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbea40a0d30 0x7fbea4097cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea359e700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbea4098730 0x7fbea4098bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea259c700 1 -- 172.21.15.8:0/523058215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbea4098730 msgr2=0x7fbea4098bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea259c700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbea4098730 0x7fbea4098bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea259c700 1 -- 172.21.15.8:0/523058215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbea40a0d30 msgr2=0x7fbea4097cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea259c700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbea40a0d30 0x7fbea4097cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.544+0000 7fbea259c700 1 -- 172.21.15.8:0/523058215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9400b720 con 0x7fbea4131180 2023-10-14T16:55:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.545+0000 7fbea259c700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbea4131180 0x7fbea40981f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800b5e0 tx=0x7fbe980090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.545+0000 7fbe8affd700 1 -- 172.21.15.8:0/523058215 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800f510 con 0x7fbea4131180 2023-10-14T16:55:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.545+0000 7fbe8affd700 1 -- 172.21.15.8:0/523058215 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9800f690 con 0x7fbea4131180 2023-10-14T16:55:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.545+0000 7fbe8affd700 1 -- 172.21.15.8:0/523058215 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800fa50 con 0x7fbea4131180 2023-10-14T16:55:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.545+0000 7fbea91bc700 1 -- 172.21.15.8:0/523058215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea409b800 con 0x7fbea4131180 2023-10-14T16:55:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.545+0000 7fbea91bc700 1 -- 172.21.15.8:0/523058215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea409ad80 con 0x7fbea4131180 2023-10-14T16:55:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.546+0000 7fbea91bc700 1 -- 172.21.15.8:0/523058215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea406b680 con 0x7fbea4131180 2023-10-14T16:55:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.546+0000 7fbe8affd700 1 -- 172.21.15.8:0/523058215 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe9801a400 con 0x7fbea4131180 2023-10-14T16:55:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.546+0000 7fbe8affd700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fbe90066f30 0x7fbe900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:08.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.547+0000 7fbe8affd700 1 -- 172.21.15.8:0/523058215 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fbe98083ae0 con 0x7fbea4131180 2023-10-14T16:55:08.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.547+0000 7fbea2d9d700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fbe90066f30 0x7fbe900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:08.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.547+0000 7fbea2d9d700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fbe90066f30 0x7fbe900693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbea40a4630 tx=0x7fbe94019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:08.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.551+0000 7fbe8affd700 1 -- 172.21.15.8:0/523058215 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe98051330 con 0x7fbea4131180 2023-10-14T16:55:08.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.788+0000 7fbea91bc700 1 -- 172.21.15.8:0/523058215 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbea409bce0 con 0x7fbea4131180 2023-10-14T16:55:08.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.788+0000 7fbe8affd700 1 -- 172.21.15.8:0/523058215 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3079 (secure 0 0 0) 0x7fbe98054950 con 0x7fbea4131180 2023-10-14T16:55:08.789 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T16:55:08.790 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6817/3883908964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3883908964},{"type":"v1","addr":"172.21.15.155:6817","nonce":3883908964}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T16:54:54.479174+0000","modified":"2023-10-14T16:54:58.104119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.8:6819/3402040876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3402040876},{"type":"v1","addr":"172.21.15.8:6819","nonce":3402040876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T16:55:08.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.790+0000 7fbea91bc700 1 -- 172.21.15.8:0/523058215 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fbe90066f30 msgr2=0x7fbe900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:08.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.790+0000 7fbea91bc700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fbe90066f30 0x7fbe900693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbea40a4630 tx=0x7fbe94019000 comp rx=0 tx=0).stop 2023-10-14T16:55:08.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.790+0000 7fbea91bc700 1 -- 172.21.15.8:0/523058215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbea4131180 msgr2=0x7fbea40981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:08.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.790+0000 7fbea91bc700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbea4131180 0x7fbea40981f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800b5e0 tx=0x7fbe980090f0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.790+0000 7fbea91bc700 1 -- 172.21.15.8:0/523058215 shutdown_connections 2023-10-14T16:55:08.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.790+0000 7fbea91bc700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fbe90066f30 0x7fbe900693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.790+0000 7fbea91bc700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbea4098730 0x7fbea4098bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.790+0000 7fbea91bc700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbea40a0d30 0x7fbea4097cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.790+0000 7fbea91bc700 1 --2- 172.21.15.8:0/523058215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbea4131180 0x7fbea40981f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.790+0000 7fbea91bc700 1 -- 172.21.15.8:0/523058215 >> 172.21.15.8:0/523058215 conn(0x7fbea40701c0 msgr2=0x7fbea406db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.790+0000 7fbea91bc700 1 -- 172.21.15.8:0/523058215 shutdown_connections 2023-10-14T16:55:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:08.790+0000 7fbea91bc700 1 -- 172.21.15.8:0/523058215 wait complete. 2023-10-14T16:55:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T16:55:09.004 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T16:54:54.479174+0000', 'modified': '2023-10-14T16:54:58.104119+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4239}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4239': {'gid': 4239, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.8:6819/3402040876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6818', 'nonce': 3402040876}, {'type': 'v1', 'addr': '172.21.15.8:6819', 'nonce': 3402040876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T16:55:09.005 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T16:55:09.005 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T16:55:09.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.125+0000 7f1feb59e700 1 Processor -- start 2023-10-14T16:55:09.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.125+0000 7f1feb59e700 1 -- start start 2023-10-14T16:55:09.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1feb59e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1fec13d3c0 0x7f1fec13f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1feb59e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec0a0d30 con 0x7f1fec0a5350 2023-10-14T16:55:09.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1feb59e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec0a4850 con 0x7f1fec0a6a70 2023-10-14T16:55:09.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1feb59e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fec0a2a40 con 0x7f1fec13d3c0 2023-10-14T16:55:09.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1fead9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1fec13d3c0 0x7f1fec13f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1fe9d9b700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1fec0a5350 0x7f1fec13bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:50724/0 (socket says 172.21.15.8:50724) 2023-10-14T16:55:09.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1fead9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1fec13d3c0 0x7f1fec13f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35422/0 (socket says 172.21.15.8:35422) 2023-10-14T16:55:09.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1fe9d9b700 1 -- 172.21.15.8:0/850979041 learned_addr learned my addr 172.21.15.8:0/850979041 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:09.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1fead9d700 1 -- 172.21.15.8:0/850979041 >> v1:172.21.15.155:6789/0 conn(0x7f1fec0a6a70 legacy=0x7f1fec0a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1fead9d700 1 -- 172.21.15.8:0/850979041 >> v1:172.21.15.8:6789/0 conn(0x7f1fec0a5350 legacy=0x7f1fec13bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1fead9d700 1 -- 172.21.15.8:0/850979041 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec0a18c0 con 0x7f1fec13d3c0 2023-10-14T16:55:09.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1fe959a700 1 -- 172.21.15.8:0/850979041 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271027224 0 0) 0x7f1fec0a0d30 con 0x7f1fec0a5350 2023-10-14T16:55:09.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.126+0000 7f1fead9d700 1 --2- 172.21.15.8:0/850979041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fec13d3c0 0x7f1fec13f7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009e60 tx=0x7f1fdc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a579302cd8b16949 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:09.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.127+0000 7f1fe959a700 1 -- 172.21.15.8:0/850979041 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00e070 con 0x7f1fec13d3c0 2023-10-14T16:55:09.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.127+0000 7f1fe959a700 1 -- 172.21.15.8:0/850979041 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc00bc30 con 0x7f1fec13d3c0 2023-10-14T16:55:09.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.127+0000 7f1fe959a700 1 -- 172.21.15.8:0/850979041 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc012430 con 0x7f1fec13d3c0 2023-10-14T16:55:09.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.127+0000 7f1feb59e700 1 -- 172.21.15.8:0/850979041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fec13d3c0 msgr2=0x7f1fec13f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.127+0000 7f1feb59e700 1 --2- 172.21.15.8:0/850979041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fec13d3c0 0x7f1fec13f7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009e60 tx=0x7f1fdc009780 comp rx=0 tx=0).stop 2023-10-14T16:55:09.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.127+0000 7f1feb59e700 1 -- 172.21.15.8:0/850979041 shutdown_connections 2023-10-14T16:55:09.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.127+0000 7f1feb59e700 1 --2- 172.21.15.8:0/850979041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fec13d3c0 0x7f1fec13f7a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.127+0000 7f1feb59e700 1 -- 172.21.15.8:0/850979041 >> 172.21.15.8:0/850979041 conn(0x7f1fec06a960 msgr2=0x7f1fec0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:09.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.127+0000 7f1feb59e700 1 -- 172.21.15.8:0/850979041 shutdown_connections 2023-10-14T16:55:09.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.127+0000 7f1feb59e700 1 -- 172.21.15.8:0/850979041 wait complete. 2023-10-14T16:55:09.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.128+0000 7f1feb59e700 1 Processor -- start 2023-10-14T16:55:09.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.128+0000 7f1feb59e700 1 -- start start 2023-10-14T16:55:09.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.128+0000 7f1feb59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fec0a5350 0x7f1fec09a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1feb59e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec13d3c0 0x7f1fec095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1feb59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fec095fb0 0x7f1fec096400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1feb59e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec096940 con 0x7f1fec095fb0 2023-10-14T16:55:09.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1feb59e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0990a0 con 0x7f1fec0a5350 2023-10-14T16:55:09.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1feb59e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec09a570 con 0x7f1fec13d3c0 2023-10-14T16:55:09.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fec095fb0 0x7f1fec096400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fec095fb0 0x7f1fec096400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35438/0 (socket says 172.21.15.8:35438) 2023-10-14T16:55:09.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fead9d700 1 -- 172.21.15.8:0/1504140654 learned_addr learned my addr 172.21.15.8:0/1504140654 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:09.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fea59c700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fec0a5350 0x7f1fec09a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fe9d9b700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec13d3c0 0x7f1fec095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fead9d700 1 -- 172.21.15.8:0/1504140654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec13d3c0 msgr2=0x7f1fec095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fead9d700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec13d3c0 0x7f1fec095a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fead9d700 1 -- 172.21.15.8:0/1504140654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fec0a5350 msgr2=0x7f1fec09a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fead9d700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fec0a5350 0x7f1fec09a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fead9d700 1 -- 172.21.15.8:0/1504140654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc009a20 con 0x7f1fec095fb0 2023-10-14T16:55:09.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fead9d700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fec095fb0 0x7f1fec096400 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0099f0 tx=0x7f1fdc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:09.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fe27fc700 1 -- 172.21.15.8:0/1504140654 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc012e80 con 0x7f1fec095fb0 2023-10-14T16:55:09.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fe27fc700 1 -- 172.21.15.8:0/1504140654 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc007040 con 0x7f1fec095fb0 2023-10-14T16:55:09.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1fe27fc700 1 -- 172.21.15.8:0/1504140654 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc01b810 con 0x7f1fec095fb0 2023-10-14T16:55:09.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1feb59e700 1 -- 172.21.15.8:0/1504140654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec0992b0 con 0x7f1fec095fb0 2023-10-14T16:55:09.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.129+0000 7f1feb59e700 1 -- 172.21.15.8:0/1504140654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec0998c0 con 0x7f1fec095fb0 2023-10-14T16:55:09.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.131+0000 7f1fe27fc700 1 -- 172.21.15.8:0/1504140654 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fdc01bc00 con 0x7f1fec095fb0 2023-10-14T16:55:09.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.131+0000 7f1fe27fc700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1fcc066f30 0x7f1fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.131+0000 7f1fe27fc700 1 -- 172.21.15.8:0/1504140654 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f1fdc085ca0 con 0x7f1fec095fb0 2023-10-14T16:55:09.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.131+0000 7f1fea59c700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1fcc066f30 0x7f1fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.132+0000 7f1fea59c700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1fcc066f30 0x7f1fcc0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4003860 tx=0x7f1fe4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:09.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.133+0000 7f1ffa17eb80 1 Processor -- start 2023-10-14T16:55:09.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.133+0000 7f1ffa17eb80 1 -- start start 2023-10-14T16:55:09.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1ffa17eb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be211d0 0x55c38be32390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1ffa17eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 0x55c38be328d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1ffa17eb80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be32e10 0x55c38be1e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1ffa17eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c38bd5ea70 con 0x55c38be21e10 2023-10-14T16:55:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1ffa17eb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c38bd5c270 con 0x55c38be211d0 2023-10-14T16:55:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1ffa17eb80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c38bd58060 con 0x55c38be32e10 2023-10-14T16:55:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1fe9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 0x55c38be328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1fe9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 0x55c38be328d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35444/0 (socket says 172.21.15.8:35444) 2023-10-14T16:55:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1fe9d9b700 1 -- 172.21.15.8:0/446497395 learned_addr learned my addr 172.21.15.8:0/446497395 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1fea59c700 1 --2- 172.21.15.8:0/446497395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be211d0 0x55c38be32390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1fead9d700 1 --2- 172.21.15.8:0/446497395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be32e10 0x55c38be1e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1fe9d9b700 1 -- 172.21.15.8:0/446497395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be32e10 msgr2=0x55c38be1e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1fe9d9b700 1 --2- 172.21.15.8:0/446497395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be32e10 0x55c38be1e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1fe9d9b700 1 -- 172.21.15.8:0/446497395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be211d0 msgr2=0x55c38be32390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:09.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1fe9d9b700 1 --2- 172.21.15.8:0/446497395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be211d0 0x55c38be32390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1fe9d9b700 1 -- 172.21.15.8:0/446497395 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c38bbf2270 con 0x55c38be21e10 2023-10-14T16:55:09.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.134+0000 7f1fe9d9b700 1 --2- 172.21.15.8:0/446497395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 0x55c38be328d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4001700 tx=0x7f1fd4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a70c5d7d9f2c74 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:09.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.135+0000 7f1fcb7fe700 1 -- 172.21.15.8:0/446497395 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4005ab0 con 0x55c38be21e10 2023-10-14T16:55:09.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.135+0000 7f1fcb7fe700 1 -- 172.21.15.8:0/446497395 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd4005c10 con 0x55c38be21e10 2023-10-14T16:55:09.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.135+0000 7f1fcb7fe700 1 -- 172.21.15.8:0/446497395 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40070d0 con 0x55c38be21e10 2023-10-14T16:55:09.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.135+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/446497395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 msgr2=0x55c38be328d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.135+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/446497395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 0x55c38be328d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4001700 tx=0x7f1fd4009040 comp rx=0 tx=0).stop 2023-10-14T16:55:09.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.135+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/446497395 shutdown_connections 2023-10-14T16:55:09.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.135+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/446497395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be32e10 0x55c38be1e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.135+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/446497395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be211d0 0x55c38be32390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.135+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/446497395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 0x55c38be328d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.135+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/446497395 >> 172.21.15.8:0/446497395 conn(0x55c38be08bd0 msgr2=0x55c38be07e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:09.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.135+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/446497395 shutdown_connections 2023-10-14T16:55:09.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.135+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/446497395 wait complete. 2023-10-14T16:55:09.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.136+0000 7f1ffa17eb80 1 -- start start 2023-10-14T16:55:09.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.136+0000 7f1ffa17eb80 1 Processor -- start 2023-10-14T16:55:09.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1ffa17eb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be211d0 0x55c38be30870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1ffa17eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 0x55c38be30db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1ffa17eb80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be32e10 0x55c38be312f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1ffa17eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c38bd03890 con 0x55c38be21e10 2023-10-14T16:55:09.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1ffa17eb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c38bd1eea0 con 0x55c38be211d0 2023-10-14T16:55:09.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1ffa17eb80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c38bbdae30 con 0x55c38be32e10 2023-10-14T16:55:09.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1ffa17eb80 10 client.0 _ll_register_callbacks cb 0x55c38bdcb320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T16:55:09.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fe9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 0x55c38be30db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fe9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 0x55c38be30db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35460/0 (socket says 172.21.15.8:35460) 2023-10-14T16:55:09.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fe9d9b700 1 -- 172.21.15.8:0/3118500155 learned_addr learned my addr 172.21.15.8:0/3118500155 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:09.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fea59c700 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be211d0 0x55c38be30870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fead9d700 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be32e10 0x55c38be312f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fe9d9b700 1 -- 172.21.15.8:0/3118500155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be32e10 msgr2=0x55c38be312f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:09.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fe9d9b700 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be32e10 0x55c38be312f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fe9d9b700 1 -- 172.21.15.8:0/3118500155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be211d0 msgr2=0x55c38be30870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:09.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fe9d9b700 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be211d0 0x55c38be30870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fe9d9b700 1 -- 172.21.15.8:0/3118500155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd400f040 con 0x55c38be21e10 2023-10-14T16:55:09.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fead9d700 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be32e10 0x55c38be312f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:09.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fe9d9b700 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 0x55c38be30db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4008fd0 tx=0x7f1fd4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e42a1a6383847 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:09.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fc8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T16:55:09.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fc8ff9700 1 -- 172.21.15.8:0/3118500155 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4005e80 con 0x55c38be21e10 2023-10-14T16:55:09.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/3118500155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c38bdfcc20 con 0x55c38be21e10 2023-10-14T16:55:09.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fc8ff9700 1 -- 172.21.15.8:0/3118500155 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f1fd4007650 con 0x55c38be21e10 2023-10-14T16:55:09.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1fc8ff9700 1 -- 172.21.15.8:0/3118500155 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fd4014690 con 0x55c38be21e10 2023-10-14T16:55:09.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1ffa17eb80 10 client.4599 fetch_fsmap learned FSMap version 8 2023-10-14T16:55:09.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.137+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/3118500155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c38bb94fe0 con 0x55c38be21e10 2023-10-14T16:55:09.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.138+0000 7f1fc8ff9700 1 -- 172.21.15.8:0/3118500155 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c38bdfcc20 con 0x55c38be21e10 2023-10-14T16:55:09.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.138+0000 7f1fc8ff9700 1 -- 172.21.15.8:0/3118500155 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 8) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f1fd4001730 con 0x55c38be21e10 2023-10-14T16:55:09.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.138+0000 7f1ffa17eb80 10 client.4599 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T16:55:09.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.138+0000 7f1ffa17eb80 10 client.4599 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T16:55:09.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.138+0000 7f1ffa17eb80 20 client.4599 populate_metadata read hostname 'smithi008' 2023-10-14T16:55:09.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.138+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.8:6818/3402040876,v1:172.21.15.8:6819/3402040876] conn(0x55c38be1dc80 0x55c38be1e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.138+0000 7f1ffa17eb80 4 client.4599 mds_command: new command op to 4239 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T16:55:09.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.138+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/3118500155 --> [v2:172.21.15.8:6818/3402040876,v1:172.21.15.8:6819/3402040876] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c38bdd9b50 con 0x55c38be1dc80 2023-10-14T16:55:09.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.138+0000 7f1fea59c700 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.8:6818/3402040876,v1:172.21.15.8:6819/3402040876] conn(0x55c38be1dc80 0x55c38be1e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.138+0000 7f1fc8ff9700 10 client.4599 ms_handle_connect on v2:172.21.15.8:6818/3402040876 2023-10-14T16:55:09.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.138+0000 7f1fea59c700 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.8:6818/3402040876,v1:172.21.15.8:6819/3402040876] conn(0x55c38be1dc80 0x55c38be1e050 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ddd3fe679a81e79 server_cookie=b26b7c6a93bf3a7d in_seq=0 out_seq=0 2023-10-14T16:55:09.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1fc8ff9700 1 -- 172.21.15.8:0/3118500155 <== mds.0 v2:172.21.15.8:6818/3402040876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c38bdd9b50 con 0x55c38be1dc80 2023-10-14T16:55:09.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1fc8ff9700 10 client.4599 handle_command_reply: tid=0 2023-10-14T16:55:09.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1ffa17eb80 1 client.4599 shutdown 2023-10-14T16:55:09.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/3118500155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 msgr2=0x55c38be30db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 0x55c38be30db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4008fd0 tx=0x7f1fd4019000 comp rx=0 tx=0).stop 2023-10-14T16:55:09.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/3118500155 shutdown_connections 2023-10-14T16:55:09.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.8:6818/3402040876,v1:172.21.15.8:6819/3402040876] conn(0x55c38be1dc80 0x55c38be1e050 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be32e10 0x55c38be312f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1fc8ff9700 0 client.4599 ms_handle_reset on v2:172.21.15.8:6818/3402040876 2023-10-14T16:55:09.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be211d0 0x55c38be30870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/3118500155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be21e10 0x55c38be30db0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/3118500155 >> 172.21.15.8:0/3118500155 conn(0x55c38be08bd0 msgr2=0x55c38be1e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:09.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/3118500155 shutdown_connections 2023-10-14T16:55:09.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/3118500155 wait complete. 2023-10-14T16:55:09.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.139+0000 7f1ffa17eb80 20 client.4599 trim_cache size 0 max 16384 2023-10-14T16:55:09.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.156+0000 7f1ffa17eb80 1 Processor -- start 2023-10-14T16:55:09.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.156+0000 7f1ffa17eb80 1 -- start start 2023-10-14T16:55:09.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1ffa17eb80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be211d0 0x55c38be04e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1ffa17eb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be21e10 0x55c38be2edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1ffa17eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 0x55c38be2f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1ffa17eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c38be06550 con 0x55c38be32e10 2023-10-14T16:55:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1ffa17eb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c38be07bf0 con 0x55c38be21e10 2023-10-14T16:55:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1ffa17eb80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c38be22ca0 con 0x55c38be211d0 2023-10-14T16:55:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 0x55c38be2f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 0x55c38be2f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35464/0 (socket says 172.21.15.8:35464) 2023-10-14T16:55:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fead9d700 1 -- 172.21.15.8:0/2399211894 learned_addr learned my addr 172.21.15.8:0/2399211894 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fe9d9b700 1 --2- 172.21.15.8:0/2399211894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be21e10 0x55c38be2edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fea59c700 1 --2- 172.21.15.8:0/2399211894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be211d0 0x55c38be04e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fead9d700 1 -- 172.21.15.8:0/2399211894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be211d0 msgr2=0x55c38be04e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fead9d700 1 --2- 172.21.15.8:0/2399211894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be211d0 0x55c38be04e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fead9d700 1 -- 172.21.15.8:0/2399211894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be21e10 msgr2=0x55c38be2edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fead9d700 1 --2- 172.21.15.8:0/2399211894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be21e10 0x55c38be2edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fead9d700 1 -- 172.21.15.8:0/2399211894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c38bd26780 con 0x55c38be32e10 2023-10-14T16:55:09.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fead9d700 1 --2- 172.21.15.8:0/2399211894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 0x55c38be2f300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc053630 tx=0x7f1fdc014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f976552bac0990 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:09.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fcbfff700 1 -- 172.21.15.8:0/2399211894 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00e040 con 0x55c38be32e10 2023-10-14T16:55:09.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fcbfff700 1 -- 172.21.15.8:0/2399211894 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc059030 con 0x55c38be32e10 2023-10-14T16:55:09.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.157+0000 7f1fcbfff700 1 -- 172.21.15.8:0/2399211894 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc057830 con 0x55c38be32e10 2023-10-14T16:55:09.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.158+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/2399211894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 msgr2=0x55c38be2f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.158+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/2399211894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 0x55c38be2f300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc053630 tx=0x7f1fdc014040 comp rx=0 tx=0).stop 2023-10-14T16:55:09.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.158+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/2399211894 shutdown_connections 2023-10-14T16:55:09.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.158+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/2399211894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 0x55c38be2f300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.158+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/2399211894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be211d0 0x55c38be04e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.158+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/2399211894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be21e10 0x55c38be2edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.158+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/2399211894 >> 172.21.15.8:0/2399211894 conn(0x55c38be08bd0 msgr2=0x55c38be1fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:09.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.158+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/2399211894 shutdown_connections 2023-10-14T16:55:09.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.158+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/2399211894 wait complete. 2023-10-14T16:55:09.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.158+0000 7f1ffa17eb80 1 -- start start 2023-10-14T16:55:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.158+0000 7f1ffa17eb80 1 Processor -- start 2023-10-14T16:55:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1ffa17eb80 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be211d0 0x55c38be6f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1ffa17eb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be21e10 0x55c38be8bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1ffa17eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 0x55c38be8c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1ffa17eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c38be6e7b0 con 0x55c38be32e10 2023-10-14T16:55:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1ffa17eb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c38be6ed50 con 0x55c38be21e10 2023-10-14T16:55:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1ffa17eb80 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c38be6d460 con 0x55c38be211d0 2023-10-14T16:55:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1ffa17eb80 10 client.0 _ll_register_callbacks cb 0x55c38bdcb320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T16:55:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1fead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 0x55c38be8c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1fead9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 0x55c38be8c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35470/0 (socket says 172.21.15.8:35470) 2023-10-14T16:55:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1fead9d700 1 -- 172.21.15.8:0/1591907323 learned_addr learned my addr 172.21.15.8:0/1591907323 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1fea59c700 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be211d0 0x55c38be6f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1fe9d9b700 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be21e10 0x55c38be8bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1fead9d700 1 -- 172.21.15.8:0/1591907323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be211d0 msgr2=0x55c38be6f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1fead9d700 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be211d0 0x55c38be6f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1fead9d700 1 -- 172.21.15.8:0/1591907323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be21e10 msgr2=0x55c38be8bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1fead9d700 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be21e10 0x55c38be8bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.159+0000 7f1fead9d700 1 -- 172.21.15.8:0/1591907323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec0998c0 con 0x55c38be32e10 2023-10-14T16:55:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1fead9d700 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 0x55c38be8c4f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0570c0 tx=0x7f1fdc06f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734c9e6989378582 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:09.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1fc8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-14T16:55:09.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1fc8ff9700 1 -- 172.21.15.8:0/1591907323 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc084030 con 0x55c38be32e10 2023-10-14T16:55:09.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1fc8ff9700 1 -- 172.21.15.8:0/1591907323 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f1fdc05a380 con 0x55c38be32e10 2023-10-14T16:55:09.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/1591907323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1fd4005c10 con 0x55c38be32e10 2023-10-14T16:55:09.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1fc8ff9700 1 -- 172.21.15.8:0/1591907323 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fdc00e040 con 0x55c38be32e10 2023-10-14T16:55:09.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1ffa17eb80 10 client.4605 fetch_fsmap learned FSMap version 8 2023-10-14T16:55:09.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/1591907323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c38bd0d470 con 0x55c38be32e10 2023-10-14T16:55:09.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1fc8ff9700 1 -- 172.21.15.8:0/1591907323 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc065080 con 0x55c38be32e10 2023-10-14T16:55:09.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1fc8ff9700 1 -- 172.21.15.8:0/1591907323 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 8) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f1fdc084b40 con 0x55c38be32e10 2023-10-14T16:55:09.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1ffa17eb80 10 client.4605 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T16:55:09.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1ffa17eb80 10 client.4605 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T16:55:09.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1ffa17eb80 20 client.4605 populate_metadata read hostname 'smithi008' 2023-10-14T16:55:09.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.8:6818/3402040876,v1:172.21.15.8:6819/3402040876] conn(0x55c38be6c3f0 0x55c38be6c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1ffa17eb80 4 client.4605 mds_command: new command op to 4239 tid=0[{"prefix": "status"}] 2023-10-14T16:55:09.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/1591907323 --> [v2:172.21.15.8:6818/3402040876,v1:172.21.15.8:6819/3402040876] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c38bcfae00 con 0x55c38be6c3f0 2023-10-14T16:55:09.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1fea59c700 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.8:6818/3402040876,v1:172.21.15.8:6819/3402040876] conn(0x55c38be6c3f0 0x55c38be6c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1fc8ff9700 10 client.4605 ms_handle_connect on v2:172.21.15.8:6818/3402040876 2023-10-14T16:55:09.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.160+0000 7f1fea59c700 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.8:6818/3402040876,v1:172.21.15.8:6819/3402040876] conn(0x55c38be6c3f0 0x55c38be6c7c0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96fcc384fd1ff9dd server_cookie=5e84db964ec6e48e in_seq=0 out_seq=0 2023-10-14T16:55:09.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1fc8ff9700 1 -- 172.21.15.8:0/1591907323 <== mds.0 v2:172.21.15.8:6818/3402040876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55c38bcfae00 con 0x55c38be6c3f0 2023-10-14T16:55:09.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1fc8ff9700 10 client.4605 handle_command_reply: tid=0 2023-10-14T16:55:09.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1ffa17eb80 1 client.4605 shutdown 2023-10-14T16:55:09.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/1591907323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 msgr2=0x55c38be8c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 0x55c38be8c4f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0570c0 tx=0x7f1fdc06f000 comp rx=0 tx=0).stop 2023-10-14T16:55:09.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/1591907323 shutdown_connections 2023-10-14T16:55:09.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c38be32e10 0x55c38be8c4f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.8:6818/3402040876,v1:172.21.15.8:6819/3402040876] conn(0x55c38be6c3f0 0x55c38be6c7c0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c38be211d0 0x55c38be6f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1fc8ff9700 0 client.4605 ms_handle_reset on v2:172.21.15.8:6818/3402040876 2023-10-14T16:55:09.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1ffa17eb80 1 --2- 172.21.15.8:0/1591907323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c38be21e10 0x55c38be8bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/1591907323 >> 172.21.15.8:0/1591907323 conn(0x55c38be08bd0 msgr2=0x55c38be1e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:09.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/1591907323 shutdown_connections 2023-10-14T16:55:09.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1ffa17eb80 1 -- 172.21.15.8:0/1591907323 wait complete. 2023-10-14T16:55:09.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1ffa17eb80 20 client.4605 trim_cache size 0 max 16384 2023-10-14T16:55:09.197 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T16:55:09.197 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "95adc750-512b-4c1d-be1d-b471b9b365f8", 2023-10-14T16:55:09.197 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-14T16:55:09.198 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4239, 2023-10-14T16:55:09.198 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-14T16:55:09.198 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-14T16:55:09.198 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-14T16:55:09.199 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 14.07031795, 2023-10-14T16:55:09.199 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 8, 2023-10-14T16:55:09.199 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 16, 2023-10-14T16:55:09.199 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 16, 2023-10-14T16:55:09.200 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 19.991070584999999 2023-10-14T16:55:09.200 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T16:55:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1feb59e700 1 -- 172.21.15.8:0/1504140654 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1fcc066f30 msgr2=0x7f1fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1feb59e700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1fcc066f30 0x7f1fcc0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4003860 tx=0x7f1fe4009040 comp rx=0 tx=0).stop 2023-10-14T16:55:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1feb59e700 1 -- 172.21.15.8:0/1504140654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fec095fb0 msgr2=0x7f1fec096400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.161+0000 7f1feb59e700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fec095fb0 0x7f1fec096400 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0099f0 tx=0x7f1fdc019000 comp rx=0 tx=0).stop 2023-10-14T16:55:09.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.162+0000 7f1feb59e700 1 -- 172.21.15.8:0/1504140654 shutdown_connections 2023-10-14T16:55:09.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.162+0000 7f1feb59e700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f1fcc066f30 0x7f1fcc0693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.162+0000 7f1feb59e700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1fec095fb0 0x7f1fec096400 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.162+0000 7f1feb59e700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fec0a5350 0x7f1fec09a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.162+0000 7f1feb59e700 1 --2- 172.21.15.8:0/1504140654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec13d3c0 0x7f1fec095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.162+0000 7f1feb59e700 1 -- 172.21.15.8:0/1504140654 >> 172.21.15.8:0/1504140654 conn(0x7f1fec06a960 msgr2=0x7f1fec0a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:09.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.162+0000 7f1feb59e700 1 -- 172.21.15.8:0/1504140654 shutdown_connections 2023-10-14T16:55:09.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.162+0000 7f1feb59e700 1 -- 172.21.15.8:0/1504140654 wait complete. 2023-10-14T16:55:09.205 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-14T16:55:09.229 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-14T16:55:09.229 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-14T16:55:09.230 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-14T16:55:09.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T16:55:09.231 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-14T16:55:09.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T16:55:09.247 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-10-14T16:55:09.315 INFO:teuthology.orchestra.run.smithi158.stderr:Cannot find device "ceph-brx" 2023-10-14T16:55:09.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T16:55:09.317 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-14T16:55:09.317 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T16:55:09.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.437+0000 7f3719ff2700 1 Processor -- start 2023-10-14T16:55:09.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.437+0000 7f3719ff2700 1 -- start start 2023-10-14T16:55:09.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.437+0000 7f3719ff2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f37140a25c0 0x7f37140a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.437+0000 7f3719ff2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371413c1a0 0x7f371413e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.437+0000 7f3719ff2700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37140a2df0 con 0x7f37140a6940 2023-10-14T16:55:09.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.437+0000 7f3719ff2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37141338f0 con 0x7f37140a25c0 2023-10-14T16:55:09.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.437+0000 7f3719ff2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3714133ae0 con 0x7f371413c1a0 2023-10-14T16:55:09.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.437+0000 7f37137fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f37140a6940 0x7f3714133f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:50740/0 (socket says 172.21.15.8:50740) 2023-10-14T16:55:09.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.437+0000 7f37137fe700 1 -- 172.21.15.8:0/2104052696 learned_addr learned my addr 172.21.15.8:0/2104052696 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T16:55:09.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.437+0000 7f3712ffd700 1 --2- 172.21.15.8:0/2104052696 >> v2:172.21.15.155:3300/0 conn(0x7f37140a25c0 0x7f37140a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.437+0000 7f3713fff700 1 --2- 172.21.15.8:0/2104052696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371413c1a0 0x7f371413e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.437+0000 7f37127fc700 1 -- 172.21.15.8:0/2104052696 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664072162 0 0) 0x7f37140a2df0 con 0x7f37140a6940 2023-10-14T16:55:09.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.438+0000 7f37127fc700 1 -- 172.21.15.8:0/2104052696 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36fc003570 con 0x7f37140a6940 2023-10-14T16:55:09.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.438+0000 7f3712ffd700 1 -- 172.21.15.8:0/2104052696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371413c1a0 msgr2=0x7f371413e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T16:55:09.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.438+0000 7f3712ffd700 1 --2- 172.21.15.8:0/2104052696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371413c1a0 0x7f371413e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.438+0000 7f3712ffd700 1 -- 172.21.15.8:0/2104052696 >> v1:172.21.15.8:6789/0 conn(0x7f37140a6940 legacy=0x7f3714133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.438+0000 7f3712ffd700 1 -- 172.21.15.8:0/2104052696 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140a1b90 con 0x7f37140a25c0 2023-10-14T16:55:09.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.438+0000 7f3712ffd700 1 --2- 172.21.15.8:0/2104052696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37140a25c0 0x7f37140a1310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f37080098e0 tx=0x7f37080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31d32bb8766ac33d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:09.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.438+0000 7f37127fc700 1 -- 172.21.15.8:0/2104052696 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708011630 con 0x7f37140a25c0 2023-10-14T16:55:09.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.438+0000 7f37127fc700 1 -- 172.21.15.8:0/2104052696 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3708011790 con 0x7f37140a25c0 2023-10-14T16:55:09.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.438+0000 7f37127fc700 1 -- 172.21.15.8:0/2104052696 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708011b30 con 0x7f37140a25c0 2023-10-14T16:55:09.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.438+0000 7f3719ff2700 1 -- 172.21.15.8:0/2104052696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37140a25c0 msgr2=0x7f37140a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.438+0000 7f3719ff2700 1 --2- 172.21.15.8:0/2104052696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37140a25c0 0x7f37140a1310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f37080098e0 tx=0x7f37080091a0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.439+0000 7f3719ff2700 1 -- 172.21.15.8:0/2104052696 shutdown_connections 2023-10-14T16:55:09.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.439+0000 7f3719ff2700 1 --2- 172.21.15.8:0/2104052696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371413c1a0 0x7f371413e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.439+0000 7f3719ff2700 1 --2- 172.21.15.8:0/2104052696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37140a25c0 0x7f37140a1310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.439+0000 7f3719ff2700 1 -- 172.21.15.8:0/2104052696 >> 172.21.15.8:0/2104052696 conn(0x7f371406acd0 msgr2=0x7f37140701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:09.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.439+0000 7f3719ff2700 1 -- 172.21.15.8:0/2104052696 shutdown_connections 2023-10-14T16:55:09.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.439+0000 7f3719ff2700 1 -- 172.21.15.8:0/2104052696 wait complete. 2023-10-14T16:55:09.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.439+0000 7f3719ff2700 1 Processor -- start 2023-10-14T16:55:09.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3719ff2700 1 -- start start 2023-10-14T16:55:09.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3719ff2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37140a25c0 0x7f37141388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3719ff2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f371413c1a0 0x7f3714138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3719ff2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3714139350 0x7f3714146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3719ff2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3714097360 con 0x7f371413c1a0 2023-10-14T16:55:09.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3719ff2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3714139e00 con 0x7f37140a25c0 2023-10-14T16:55:09.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3719ff2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371413a150 con 0x7f3714139350 2023-10-14T16:55:09.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3712ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f371413c1a0 0x7f3714138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3712ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f371413c1a0 0x7f3714138e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35474/0 (socket says 172.21.15.8:35474) 2023-10-14T16:55:09.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3712ffd700 1 -- 172.21.15.8:0/2071784333 learned_addr learned my addr 172.21.15.8:0/2071784333 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T16:55:09.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3713fff700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3714139350 0x7f3714146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f37137fe700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37140a25c0 0x7f37141388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3712ffd700 1 -- 172.21.15.8:0/2071784333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3714139350 msgr2=0x7f3714146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3712ffd700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3714139350 0x7f3714146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3712ffd700 1 -- 172.21.15.8:0/2071784333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37140a25c0 msgr2=0x7f37141388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3712ffd700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37140a25c0 0x7f37141388d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3712ffd700 1 -- 172.21.15.8:0/2071784333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3708009420 con 0x7f371413c1a0 2023-10-14T16:55:09.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.440+0000 7f3713fff700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3714139350 0x7f3714146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T16:55:09.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.441+0000 7f3712ffd700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f371413c1a0 0x7f3714138e10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3708011f20 tx=0x7f3708017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:09.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.441+0000 7f36fb7fe700 1 -- 172.21.15.8:0/2071784333 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708011900 con 0x7f371413c1a0 2023-10-14T16:55:09.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.441+0000 7f36fb7fe700 1 -- 172.21.15.8:0/2071784333 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3708011a60 con 0x7f371413c1a0 2023-10-14T16:55:09.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.441+0000 7f3719ff2700 1 -- 172.21.15.8:0/2071784333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3714096ac0 con 0x7f371413c1a0 2023-10-14T16:55:09.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.441+0000 7f36fb7fe700 1 -- 172.21.15.8:0/2071784333 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708023620 con 0x7f371413c1a0 2023-10-14T16:55:09.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.441+0000 7f3719ff2700 1 -- 172.21.15.8:0/2071784333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3714096110 con 0x7f371413c1a0 2023-10-14T16:55:09.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.442+0000 7f3719ff2700 1 -- 172.21.15.8:0/2071784333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37140708d0 con 0x7f371413c1a0 2023-10-14T16:55:09.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.442+0000 7f36fb7fe700 1 -- 172.21.15.8:0/2071784333 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f370802c3b0 con 0x7f371413c1a0 2023-10-14T16:55:09.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.443+0000 7f36fb7fe700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3700066f30 0x7f37000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T16:55:09.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.443+0000 7f36fb7fe700 1 -- 172.21.15.8:0/2071784333 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f3708085230 con 0x7f371413c1a0 2023-10-14T16:55:09.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.443+0000 7f37137fe700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3700066f30 0x7f37000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T16:55:09.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.443+0000 7f37137fe700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3700066f30 0x7f37000693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3704007fd0 tx=0x7f3704009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T16:55:09.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.447+0000 7f36fb7fe700 1 -- 172.21.15.8:0/2071784333 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3708052a80 con 0x7f371413c1a0 2023-10-14T16:55:09.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.689+0000 7f3719ff2700 1 -- 172.21.15.8:0/2071784333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f37140a1e50 con 0x7f371413c1a0 2023-10-14T16:55:09.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.690+0000 7f36fb7fe700 1 -- 172.21.15.8:0/2071784333 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f37080560a0 con 0x7f371413c1a0 2023-10-14T16:55:09.691 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T16:55:09.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.692+0000 7f3719ff2700 1 -- 172.21.15.8:0/2071784333 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3700066f30 msgr2=0x7f37000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.692+0000 7f3719ff2700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3700066f30 0x7f37000693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3704007fd0 tx=0x7f3704009040 comp rx=0 tx=0).stop 2023-10-14T16:55:09.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.692+0000 7f3719ff2700 1 -- 172.21.15.8:0/2071784333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f371413c1a0 msgr2=0x7f3714138e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T16:55:09.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.692+0000 7f3719ff2700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f371413c1a0 0x7f3714138e10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3708011f20 tx=0x7f3708017000 comp rx=0 tx=0).stop 2023-10-14T16:55:09.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.692+0000 7f3719ff2700 1 -- 172.21.15.8:0/2071784333 shutdown_connections 2023-10-14T16:55:09.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.692+0000 7f3719ff2700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3700066f30 0x7f37000693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.692+0000 7f3719ff2700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3714139350 0x7f3714146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.692+0000 7f3719ff2700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37140a25c0 0x7f37141388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.692+0000 7f3719ff2700 1 --2- 172.21.15.8:0/2071784333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f371413c1a0 0x7f3714138e10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T16:55:09.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.692+0000 7f3719ff2700 1 -- 172.21.15.8:0/2071784333 >> 172.21.15.8:0/2071784333 conn(0x7f371406acd0 msgr2=0x7f37141309f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T16:55:09.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.692+0000 7f3719ff2700 1 -- 172.21.15.8:0/2071784333 shutdown_connections 2023-10-14T16:55:09.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T16:55:09.692+0000 7f3719ff2700 1 -- 172.21.15.8:0/2071784333 wait complete. 2023-10-14T16:55:09.705 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T16:55:09.705 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T16:55:09.705 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-10-14T16:55:09.705 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T16:55:09.706 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T16:55:09.706 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T16:55:09.706 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T16:55:09.706 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T16:55:09.707 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T16:55:09.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T16:55:09.707 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-10-14T16:55:09.723 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T16:55:09.724 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T16:55:09.724 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T16:55:09.724 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-14T16:55:09.724 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-10-14T16:55:09.724 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-14T16:55:09.725 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T16:55:09.725 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-10-14T16:55:09.725 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-10-14T16:55:09.725 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T16:55:09.725 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-10-14T16:55:09.726 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-10-14T16:55:09.726 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T16:55:09.726 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-10-14T16:55:09.726 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T16:55:09.726 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-10-14T16:55:09.727 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T16:55:09.727 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42187sec preferred_lft 42187sec 2023-10-14T16:55:09.727 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-10-14T16:55:09.727 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-10-14T16:55:09.728 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T16:55:09.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T16:55:09.728 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-14T16:55:09.729 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-14T16:55:09.729 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add name ceph-brx type bridge 2023-10-14T16:55:09.729 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip addr flush dev ceph-brx 2023-10-14T16:55:09.730 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set ceph-brx up 2023-10-14T16:55:09.730 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T16:55:09.730 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-14T16:55:09.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T16:55:09.888 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T16:55:09.928 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-10-14T16:55:09.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T16:55:09.930 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-10-14T16:55:09.999 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-10-14T16:55:10.000 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T16:55:10.000 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T16:55:10.000 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T16:55:10.000 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T16:55:10.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T16:55:10.001 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-14T16:55:10.001 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-14T16:55:10.002 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T16:55:10.002 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T16:55:10.002 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T16:55:10.003 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-14T16:55:10.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T16:55:10.284 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-14T16:55:10.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T16:55:10.300 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list-id 2023-10-14T16:55:10.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T16:55:10.354 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-14T16:55:10.354 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-14T16:55:10.355 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T16:55:10.355 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-14T16:55:10.355 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-14T16:55:10.443 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-14T16:55:10.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T16:55:10.444 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-14T16:55:10.444 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-14T16:55:10.445 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-14T16:55:10.445 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T16:55:10.445 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-14T16:55:10.445 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-14T16:55:10.446 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-14T16:55:10.446 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-14T16:55:10.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T16:55:10.622 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-10-14T16:55:10.623 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-10-14T16:55:10.623 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-10-14T16:55:10.623 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T16:55:10.623 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-10-14T16:55:10.715 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-14T16:55:10.716 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T16:55:10.716 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T16:55:10.730 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T16:55:10.731 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T16:55:10.731 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T16:55:10.785 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2023-10-14T16:55:10.851 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-14T16:55:10.851 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-14T16:55:10.915 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-14T16:55:10.916 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-14T16:55:10.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T16:55:10.917 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2023-10-14T16:55:10.971 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T16:55:10.972 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-14T16:55:11.014 DEBUG:teuthology.orchestra.run.smithi158:> sudo modprobe fuse 2023-10-14T16:55:11.038 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-14T16:55:11.039 DEBUG:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-14T16:55:11.102 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-14T16:55:11.103 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-14T16:55:11.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T16:55:11.104 DEBUG:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2023-10-14T16:55:11.127 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:2023-10-14T16:55:11.125+0000 7f5abb26f540 -1 init, newargv = 0x5606ee512c60 newargc=15 2023-10-14T16:55:11.127 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:ceph-fuse[83323]: starting ceph client 2023-10-14T16:55:11.132 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:ceph-fuse[83323]: starting fuse 2023-10-14T16:55:11.141 INFO:teuthology.orchestra.run.smithi158.stdout:46 2023-10-14T16:55:11.141 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-14T16:55:11.142 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-14T16:55:11.142 DEBUG:teuthology.orchestra.run.smithi158:> import glob 2023-10-14T16:55:11.142 DEBUG:teuthology.orchestra.run.smithi158:> import re 2023-10-14T16:55:11.143 DEBUG:teuthology.orchestra.run.smithi158:> import os 2023-10-14T16:55:11.143 DEBUG:teuthology.orchestra.run.smithi158:> import subprocess 2023-10-14T16:55:11.143 DEBUG:teuthology.orchestra.run.smithi158:> 2023-10-14T16:55:11.144 DEBUG:teuthology.orchestra.run.smithi158:> def _find_admin_socket(client_name): 2023-10-14T16:55:11.144 DEBUG:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-14T16:55:11.144 DEBUG:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2023-10-14T16:55:11.145 DEBUG:teuthology.orchestra.run.smithi158:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-14T16:55:11.145 DEBUG:teuthology.orchestra.run.smithi158:> 2023-10-14T16:55:11.145 DEBUG:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2023-10-14T16:55:11.146 DEBUG:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2023-10-14T16:55:11.146 DEBUG:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2023-10-14T16:55:11.146 DEBUG:teuthology.orchestra.run.smithi158:> return files[0] 2023-10-14T16:55:11.146 DEBUG:teuthology.orchestra.run.smithi158:> 2023-10-14T16:55:11.147 DEBUG:teuthology.orchestra.run.smithi158:> for f in files: 2023-10-14T16:55:11.147 DEBUG:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T16:55:11.147 DEBUG:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T16:55:11.148 DEBUG:teuthology.orchestra.run.smithi158:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T16:55:11.148 DEBUG:teuthology.orchestra.run.smithi158:> contents = proc_f.read() 2023-10-14T16:55:11.148 DEBUG:teuthology.orchestra.run.smithi158:> if mountpoint in contents: 2023-10-14T16:55:11.149 DEBUG:teuthology.orchestra.run.smithi158:> return f 2023-10-14T16:55:11.149 DEBUG:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T16:55:11.149 DEBUG:teuthology.orchestra.run.smithi158:> 2023-10-14T16:55:11.150 DEBUG:teuthology.orchestra.run.smithi158:> print(_find_admin_socket("client.0")) 2023-10-14T16:55:11.150 DEBUG:teuthology.orchestra.run.smithi158:> ' 2023-10-14T16:55:11.261 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.0.83323.asok 2023-10-14T16:55:11.443 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.83323.asok 2023-10-14T16:55:11.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T16:55:11.444 DEBUG:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.83323.asok status 2023-10-14T16:55:11.593 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2023-10-14T16:55:11.594 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2023-10-14T16:55:11.594 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "9d6d32bb3452d5179bde2ee1cfa05df7a65f4586", 2023-10-14T16:55:11.594 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 17.2.6-1415-g9d6d32bb (9d6d32bb3452d5179bde2ee1cfa05df7a65f4586) quincy (stable)", 2023-10-14T16:55:11.594 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "0", 2023-10-14T16:55:11.595 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2023-10-14T16:55:11.595 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-14T16:55:11.595 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "83323", 2023-10-14T16:55:11.595 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2023-10-14T16:55:11.595 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-14T16:55:11.596 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2023-10-14T16:55:11.596 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2023-10-14T16:55:11.596 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 4620, 2023-10-14T16:55:11.596 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2023-10-14T16:55:11.596 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2023-10-14T16:55:11.597 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2023-10-14T16:55:11.597 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 4620 2023-10-14T16:55:11.597 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-14T16:55:11.597 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2023-10-14T16:55:11.597 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2023-10-14T16:55:11.598 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2023-10-14T16:55:11.598 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 4009381102 2023-10-14T16:55:11.598 INFO:teuthology.orchestra.run.smithi158.stdout: } 2023-10-14T16:55:11.598 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-14T16:55:11.599 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2023-10-14T16:55:11.599 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2023-10-14T16:55:11.599 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2023-10-14T16:55:11.599 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 4009381102 2023-10-14T16:55:11.599 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2023-10-14T16:55:11.600 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.4620 172.21.15.158:0/4009381102", 2023-10-14T16:55:11.600 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/4009381102", 2023-10-14T16:55:11.600 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2023-10-14T16:55:11.600 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 8, 2023-10-14T16:55:11.600 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 16, 2023-10-14T16:55:11.601 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2023-10-14T16:55:11.601 INFO:teuthology.orchestra.run.smithi158.stdout: "blocklisted": false, 2023-10-14T16:55:11.601 INFO:teuthology.orchestra.run.smithi158.stdout: "fs_name": "cephfs" 2023-10-14T16:55:11.601 INFO:teuthology.orchestra.run.smithi158.stdout:} 2023-10-14T16:55:11.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T16:55:11.604 DEBUG:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2023-10-14T16:55:11.604 DEBUG:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-14T16:55:11.619 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2023-10-14T16:55:11.620 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-14T16:55:11.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T16:55:11.620 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T16:55:11.686 INFO:teuthology.run_tasks:Running task workunit... 2023-10-14T16:55:11.699 INFO:tasks.workunit:Pulling workunits from ref 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T16:55:11.700 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-14T16:55:11.701 DEBUG:teuthology.orchestra.run.smithi158:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-14T16:55:11.742 INFO:teuthology.orchestra.run.smithi158.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-14T16:55:11.742 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-10-14T16:55:11.743 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 2eh/46d Inode: 1 Links: 2 2023-10-14T16:55:11.743 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T16:55:11.743 INFO:teuthology.orchestra.run.smithi158.stdout:Context: system_u:object_r:fusefs_t:s0 2023-10-14T16:55:11.743 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-10-14T16:55:11.743 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2023-10-14 16:54:55.092612484 +0000 2023-10-14T16:55:11.744 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2023-10-14 16:55:11.684346556 +0000 2023-10-14T16:55:11.744 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2023-10-14T16:55:11.744 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-14T16:55:11.745 DEBUG:teuthology.orchestra.run.smithi158:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-14T16:55:11.815 INFO:tasks.workunit:timeout=3h 2023-10-14T16:55:11.815 INFO:tasks.workunit:cleanup=True 2023-10-14T16:55:11.816 DEBUG:teuthology.orchestra.run.smithi158:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T16:55:11.870 INFO:tasks.workunit.client.0.smithi158.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-14T16:55:14.555 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:55:14.558 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:55:14.561 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:55:44.639 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:55:44.643 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:55:44.646 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:55:57.639 INFO:tasks.workunit.client.0.smithi158.stderr:Note: switching to '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'. 2023-10-14T16:55:57.639 INFO:tasks.workunit.client.0.smithi158.stderr: 2023-10-14T16:55:57.640 INFO:tasks.workunit.client.0.smithi158.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-14T16:55:57.640 INFO:tasks.workunit.client.0.smithi158.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-14T16:55:57.640 INFO:tasks.workunit.client.0.smithi158.stderr:state without impacting any branches by switching back to a branch. 2023-10-14T16:55:57.640 INFO:tasks.workunit.client.0.smithi158.stderr: 2023-10-14T16:55:57.640 INFO:tasks.workunit.client.0.smithi158.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-14T16:55:57.641 INFO:tasks.workunit.client.0.smithi158.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-14T16:55:57.641 INFO:tasks.workunit.client.0.smithi158.stderr: 2023-10-14T16:55:57.641 INFO:tasks.workunit.client.0.smithi158.stderr: git switch -c 2023-10-14T16:55:57.641 INFO:tasks.workunit.client.0.smithi158.stderr: 2023-10-14T16:55:57.641 INFO:tasks.workunit.client.0.smithi158.stderr:Or undo this operation with: 2023-10-14T16:55:57.642 INFO:tasks.workunit.client.0.smithi158.stderr: 2023-10-14T16:55:57.642 INFO:tasks.workunit.client.0.smithi158.stderr: git switch - 2023-10-14T16:55:57.642 INFO:tasks.workunit.client.0.smithi158.stderr: 2023-10-14T16:55:57.643 INFO:tasks.workunit.client.0.smithi158.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-14T16:55:57.643 INFO:tasks.workunit.client.0.smithi158.stderr: 2023-10-14T16:55:57.643 INFO:tasks.workunit.client.0.smithi158.stderr:HEAD is now at 9d6d32bb345 Merge pull request #54001 from zdover23/wip-doc-2023-10-13-backport-53986-to-quincy 2023-10-14T16:55:57.645 DEBUG:teuthology.orchestra.run.smithi158:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-14T16:55:57.675 INFO:tasks.workunit.client.0.smithi158.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-14T16:55:57.676 INFO:tasks.workunit.client.0.smithi158.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-14T16:55:57.677 INFO:tasks.workunit.client.0.smithi158.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-14T16:55:58.272 INFO:tasks.workunit.client.0.smithi158.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-14T16:55:58.324 INFO:tasks.workunit.client.0.smithi158.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-14T16:55:58.361 INFO:tasks.workunit.client.0.smithi158.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-14T16:55:58.362 INFO:tasks.workunit.client.0.smithi158.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-14T16:55:58.363 INFO:tasks.workunit.client.0.smithi158.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-14T16:55:58.399 INFO:tasks.workunit.client.0.smithi158.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-14T16:55:58.402 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-10-14T16:55:58.403 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-14T16:55:58.458 INFO:tasks.workunit:Running workunits matching libcephfs/test.sh on client.0... 2023-10-14T16:55:58.459 INFO:tasks.workunit:Running workunit libcephfs/test.sh... 2023-10-14T16:55:58.460 DEBUG:teuthology.orchestra.run.smithi158:workunit test libcephfs/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh 2023-10-14T16:55:58.554 INFO:tasks.workunit.client.0.smithi158.stdout:[==========] Running 123 tests from 4 test suites. 2023-10-14T16:55:58.555 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] Global test environment set-up. 2023-10-14T16:55:58.555 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] 114 tests from LibCephFS 2023-10-14T16:55:58.555 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2023-10-14T16:55:58.637 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OpenEmptyComponent (83 ms) 2023-10-14T16:55:58.638 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2023-10-14T16:55:59.182 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OpenReadTruncate (545 ms) 2023-10-14T16:55:59.183 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OpenReadWrite 2023-10-14T16:55:59.217 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OpenReadWrite (34 ms) 2023-10-14T16:55:59.217 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.MountNonExist 2023-10-14T16:55:59.235 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.MountNonExist (18 ms) 2023-10-14T16:55:59.235 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.MountDouble 2023-10-14T16:56:00.250 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.MountDouble (1016 ms) 2023-10-14T16:56:00.251 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.MountRemount 2023-10-14T16:56:01.279 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.MountRemount (1028 ms) 2023-10-14T16:56:01.279 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2023-10-14T16:56:01.288 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.UnmountUnmounted (10 ms) 2023-10-14T16:56:01.288 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2023-10-14T16:56:01.297 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ReleaseUnmounted (9 ms) 2023-10-14T16:56:01.297 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ReleaseMounted 2023-10-14T16:56:01.317 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ReleaseMounted (20 ms) 2023-10-14T16:56:01.318 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.UnmountRelease 2023-10-14T16:56:02.334 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.UnmountRelease (1017 ms) 2023-10-14T16:56:02.334 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Mount 2023-10-14T16:56:04.369 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Mount (2035 ms) 2023-10-14T16:56:04.370 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OpenLayout 2023-10-14T16:56:04.412 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OpenLayout (42 ms) 2023-10-14T16:56:04.412 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DirLs 2023-10-14T16:56:13.880 INFO:tasks.workunit.client.0.smithi158.stdout:rand: 2228 2023-10-14T16:56:13.880 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DirLs (9468 ms) 2023-10-14T16:56:13.880 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2023-10-14T16:56:14.677 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ManyNestedDirs (797 ms) 2023-10-14T16:56:14.677 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Xattrs 2023-10-14T16:56:14.715 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:56:14.718 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:56:14.720 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:56:14.724 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_a 2023-10-14T16:56:14.724 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_b 2023-10-14T16:56:14.724 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_c 2023-10-14T16:56:14.724 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_d 2023-10-14T16:56:14.724 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_e 2023-10-14T16:56:14.725 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_f 2023-10-14T16:56:14.725 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_g 2023-10-14T16:56:14.725 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_h 2023-10-14T16:56:14.725 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_i 2023-10-14T16:56:14.725 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_j 2023-10-14T16:56:14.726 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_k 2023-10-14T16:56:14.726 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_l 2023-10-14T16:56:14.726 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_m 2023-10-14T16:56:14.726 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_n 2023-10-14T16:56:14.726 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_o 2023-10-14T16:56:14.727 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_p 2023-10-14T16:56:14.727 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_q 2023-10-14T16:56:14.727 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_r 2023-10-14T16:56:14.727 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_s 2023-10-14T16:56:14.727 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_t 2023-10-14T16:56:14.728 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_u 2023-10-14T16:56:14.728 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_v 2023-10-14T16:56:14.728 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_w 2023-10-14T16:56:14.728 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_x 2023-10-14T16:56:14.728 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_y 2023-10-14T16:56:14.728 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_z 2023-10-14T16:56:14.756 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Xattrs (79 ms) 2023-10-14T16:56:14.756 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Xattrs_ll 2023-10-14T16:56:14.777 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Xattrs_ll (21 ms) 2023-10-14T16:56:14.777 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LstatSlashdot 2023-10-14T16:56:14.793 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LstatSlashdot (17 ms) 2023-10-14T16:56:14.793 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.StatDirNlink 2023-10-14T16:56:14.896 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.StatDirNlink (102 ms) 2023-10-14T16:56:14.896 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DoubleChmod 2023-10-14T16:56:14.920 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DoubleChmod (24 ms) 2023-10-14T16:56:14.920 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Fchmod 2023-10-14T16:56:14.942 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Fchmod (23 ms) 2023-10-14T16:56:14.942 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Lchmod 2023-10-14T16:56:14.970 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Lchmod (27 ms) 2023-10-14T16:56:14.970 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Fchown 2023-10-14T16:56:14.991 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Fchown (21 ms) 2023-10-14T16:56:14.991 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.FlagO_PATH 2023-10-14T16:56:15.010 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.FlagO_PATH (20 ms) 2023-10-14T16:56:15.010 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Symlinks 2023-10-14T16:56:15.041 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Symlinks (31 ms) 2023-10-14T16:56:15.041 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DirSyms 2023-10-14T16:56:15.085 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DirSyms (44 ms) 2023-10-14T16:56:15.086 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LoopSyms 2023-10-14T16:56:15.143 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LoopSyms (58 ms) 2023-10-14T16:56:15.144 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2023-10-14T16:56:15.231 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (87 ms) 2023-10-14T16:56:15.231 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.BadArgument 2023-10-14T16:56:15.256 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.BadArgument (26 ms) 2023-10-14T16:56:15.257 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.BadFileDesc 2023-10-14T16:56:15.273 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.BadFileDesc (17 ms) 2023-10-14T16:56:15.274 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2023-10-14T16:56:15.295 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ReadEmptyFile (21 ms) 2023-10-14T16:56:15.295 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.PreadvPwritev 2023-10-14T16:56:15.321 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.PreadvPwritev (26 ms) 2023-10-14T16:56:15.321 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2023-10-14T16:56:15.343 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LlreadvLlwritev (22 ms) 2023-10-14T16:56:15.343 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.StripeUnitGran 2023-10-14T16:56:15.359 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.StripeUnitGran (16 ms) 2023-10-14T16:56:15.359 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Rename 2023-10-14T16:56:15.387 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Rename (28 ms) 2023-10-14T16:56:15.388 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.UseUnmounted 2023-10-14T16:56:15.395 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.UseUnmounted (8 ms) 2023-10-14T16:56:15.396 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetPoolId 2023-10-14T16:56:15.413 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetPoolId (17 ms) 2023-10-14T16:56:15.413 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetPoolReplication 2023-10-14T16:56:15.430 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetPoolReplication (18 ms) 2023-10-14T16:56:15.430 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetExtentOsds 2023-10-14T16:56:15.450 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetExtentOsds (20 ms) 2023-10-14T16:56:15.450 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2023-10-14T16:56:15.470 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (19 ms) 2023-10-14T16:56:15.470 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetOsdAddr 2023-10-14T16:56:15.486 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetOsdAddr (17 ms) 2023-10-14T16:56:15.487 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OpenNoClose 2023-10-14T16:56:15.517 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OpenNoClose (30 ms) 2023-10-14T16:56:15.517 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Nlink 2023-10-14T16:56:15.568 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Nlink (51 ms) 2023-10-14T16:56:15.568 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SlashDotDot 2023-10-14T16:56:17.605 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SlashDotDot (2037 ms) 2023-10-14T16:56:17.605 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Btime 2023-10-14T16:56:18.633 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Btime (1028 ms) 2023-10-14T16:56:18.633 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SetBtime 2023-10-14T16:56:18.659 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SetBtime (26 ms) 2023-10-14T16:56:18.659 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LazyStatx 2023-10-14T16:56:19.707 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LazyStatx (1048 ms) 2023-10-14T16:56:19.708 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ChangeAttr 2023-10-14T16:56:19.739 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ChangeAttr (32 ms) 2023-10-14T16:56:19.739 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2023-10-14T16:56:19.779 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (41 ms) 2023-10-14T16:56:19.780 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2023-10-14T16:56:19.843 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (64 ms) 2023-10-14T16:56:19.844 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2023-10-14T16:56:19.902 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (58 ms) 2023-10-14T16:56:19.903 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SetSize 2023-10-14T16:56:19.942 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SetSize (41 ms) 2023-10-14T16:56:19.943 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2023-10-14T16:56:19.962 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OperationsOnRoot (20 ms) 2023-10-14T16:56:19.962 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ShutdownRace 2023-10-14T16:56:19.963 INFO:tasks.workunit.client.0.smithi158.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2023-10-14T16:56:45.121 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:56:45.125 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:56:45.127 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:56:53.012 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ShutdownRace (33050 ms) 2023-10-14T16:56:53.013 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.TestUtime 2023-10-14T16:56:53.044 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.TestUtime (32 ms) 2023-10-14T16:56:53.045 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.TestUtimes 2023-10-14T16:56:53.081 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.TestUtimes (36 ms) 2023-10-14T16:56:53.081 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.TestFutimens 2023-10-14T16:56:53.108 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.TestFutimens (27 ms) 2023-10-14T16:56:53.108 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2023-10-14T16:56:53.143 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OperationsOnDotDot (35 ms) 2023-10-14T16:56:53.143 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Caps_vxattr 2023-10-14T16:56:53.165 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Caps_vxattr (23 ms) 2023-10-14T16:56:53.166 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SnapXattrs 2023-10-14T16:56:54.183 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SnapXattrs (1017 ms) 2023-10-14T16:56:54.183 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SnapQuota 2023-10-14T16:56:55.201 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SnapQuota (1018 ms) 2023-10-14T16:56:55.201 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Lseek 2023-10-14T16:56:55.230 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Lseek (30 ms) 2023-10-14T16:56:55.231 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2023-10-14T16:56:56.248 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (1017 ms) 2023-10-14T16:56:56.248 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2023-10-14T16:56:57.266 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.EmptySnapInfo (1018 ms) 2023-10-14T16:56:57.267 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SnapInfo 2023-10-14T16:56:58.284 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SnapInfo (1017 ms) 2023-10-14T16:56:58.284 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2023-10-14T16:56:58.303 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LookupInoMDSDir (20 ms) 2023-10-14T16:56:58.304 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LookupVino 2023-10-14T16:57:00.349 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LookupVino (2045 ms) 2023-10-14T16:57:00.349 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Openat 2023-10-14T16:57:00.395 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Openat (46 ms) 2023-10-14T16:57:00.395 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Statxat 2023-10-14T16:57:00.467 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Statxat (72 ms) 2023-10-14T16:57:00.467 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2023-10-14T16:57:00.533 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.StatxatATFDCWD (67 ms) 2023-10-14T16:57:00.534 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Fdopendir 2023-10-14T16:57:00.599 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Fdopendir (66 ms) 2023-10-14T16:57:00.599 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2023-10-14T16:57:00.663 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (63 ms) 2023-10-14T16:57:00.663 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2023-10-14T16:57:00.723 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (60 ms) 2023-10-14T16:57:00.723 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2023-10-14T16:57:00.783 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (60 ms) 2023-10-14T16:57:00.783 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Mkdirat 2023-10-14T16:57:00.837 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Mkdirat (54 ms) 2023-10-14T16:57:00.837 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2023-10-14T16:57:00.870 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (34 ms) 2023-10-14T16:57:00.871 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Readlinkat 2023-10-14T16:57:00.910 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Readlinkat (39 ms) 2023-10-14T16:57:00.910 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2023-10-14T16:57:00.980 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (70 ms) 2023-10-14T16:57:00.980 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Symlinkat 2023-10-14T16:57:01.047 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Symlinkat (67 ms) 2023-10-14T16:57:01.047 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2023-10-14T16:57:01.107 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (61 ms) 2023-10-14T16:57:01.108 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Unlinkat 2023-10-14T16:57:01.177 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Unlinkat (69 ms) 2023-10-14T16:57:01.177 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2023-10-14T16:57:01.244 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (67 ms) 2023-10-14T16:57:01.244 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Chownat 2023-10-14T16:57:01.307 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Chownat (64 ms) 2023-10-14T16:57:01.308 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2023-10-14T16:57:01.363 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ChownatATFDCWD (55 ms) 2023-10-14T16:57:01.363 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Chmodat 2023-10-14T16:57:01.431 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Chmodat (68 ms) 2023-10-14T16:57:01.431 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2023-10-14T16:57:01.495 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (65 ms) 2023-10-14T16:57:01.495 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Utimensat 2023-10-14T16:57:04.223 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Utimensat (2728 ms) 2023-10-14T16:57:04.224 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2023-10-14T16:57:09.224 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (5001 ms) 2023-10-14T16:57:09.225 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2023-10-14T16:57:09.508 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (283 ms) 2023-10-14T16:57:09.508 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2023-10-14T16:57:09.526 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (19 ms) 2023-10-14T16:57:09.527 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SetMountTimeout 2023-10-14T16:57:10.542 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SetMountTimeout (1016 ms) 2023-10-14T16:57:10.543 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2023-10-14T16:57:11.560 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SnapdirAttrs (1017 ms) 2023-10-14T16:57:11.560 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ReaddirRCB 2023-10-14T16:57:12.583 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ReaddirRCB (1023 ms) 2023-10-14T16:57:12.583 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.MulticlientSimple 2023-10-14T16:57:12.695 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.MulticlientSimple (112 ms) 2023-10-14T16:57:12.695 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.MulticlientHoleEOF 2023-10-14T16:57:12.748 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.MulticlientHoleEOF (54 ms) 2023-10-14T16:57:12.749 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.MulticlientRevokeCaps 2023-10-14T16:57:15.185 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:57:15.188 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:57:15.191 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:57:45.254 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:57:45.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:57:45.259 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:58:12.790 INFO:tasks.workunit.client.0.smithi158.stdout: Will run test for 60 seconds! 2023-10-14T16:58:12.790 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.MulticlientRevokeCaps (60041 ms) 2023-10-14T16:58:12.790 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.BasicLocking 2023-10-14T16:58:12.824 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.BasicLocking (35 ms) 2023-10-14T16:58:12.825 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ConcurrentLocking 2023-10-14T16:58:12.875 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ConcurrentLocking (50 ms) 2023-10-14T16:58:12.875 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ThreesomeLocking 2023-10-14T16:58:12.938 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ThreesomeLocking (63 ms) 2023-10-14T16:58:12.938 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.BasicRecordLocking 2023-10-14T16:58:12.966 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.BasicRecordLocking (29 ms) 2023-10-14T16:58:12.967 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ConcurrentRecordLocking 2023-10-14T16:58:13.016 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ConcurrentRecordLocking (50 ms) 2023-10-14T16:58:13.017 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ThreesomeRecordLocking 2023-10-14T16:58:13.079 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ThreesomeRecordLocking (63 ms) 2023-10-14T16:58:13.080 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DelegMultiClient 2023-10-14T16:58:14.368 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DelegMultiClient (1288 ms) 2023-10-14T16:58:14.368 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DelegSingleClient 2023-10-14T16:58:15.423 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:58:15.426 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:58:15.429 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:58:19.251 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DelegSingleClient (4884 ms) 2023-10-14T16:58:19.252 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DelegTimeout 2023-10-14T16:58:21.334 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DelegTimeout (2082 ms) 2023-10-14T16:58:21.334 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.RecalledGetattr 2023-10-14T16:58:21.402 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.RecalledGetattr (68 ms) 2023-10-14T16:58:21.402 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LayoutVerifyDefaultLayout 2023-10-14T16:58:21.423 INFO:tasks.workunit.client.0.smithi158.stderr:layout:{"stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_name": "cephfs_data", "pool_id": 4, "pool_namespace": "", "inheritance": "@default"} 2023-10-14T16:58:21.440 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LayoutVerifyDefaultLayout (38 ms) 2023-10-14T16:58:21.440 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout 2023-10-14T16:58:21.463 INFO:tasks.workunit.client.0.smithi158.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 4, "pool_namespace": "", "inheritance": "@set"} 2023-10-14T16:58:21.464 INFO:tasks.workunit.client.0.smithi158.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 4, "pool_namespace": "", "inheritance": "@inherited"} 2023-10-14T16:58:21.480 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout (40 ms) 2023-10-14T16:58:21.480 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LayoutSetBadJSON 2023-10-14T16:58:21.516 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LayoutSetBadJSON (37 ms) 2023-10-14T16:58:21.517 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolName 2023-10-14T16:58:21.552 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LayoutSetBadPoolName (36 ms) 2023-10-14T16:58:21.553 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolId 2023-10-14T16:58:21.589 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LayoutSetBadPoolId (36 ms) 2023-10-14T16:58:21.589 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LayoutSetInvalidFieldName 2023-10-14T16:58:21.631 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LayoutSetInvalidFieldName (43 ms) 2023-10-14T16:58:21.631 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetAndSetDirPin 2023-10-14T16:58:21.668 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetAndSetDirPin (36 ms) 2023-10-14T16:58:21.668 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetAndSetDirDistribution 2023-10-14T16:58:21.705 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetAndSetDirDistribution (38 ms) 2023-10-14T16:58:21.706 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetAndSetDirRandom 2023-10-14T16:58:21.737 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetAndSetDirRandom (32 ms) 2023-10-14T16:58:21.738 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] 114 tests from LibCephFS (143183 ms total) 2023-10-14T16:58:21.738 INFO:tasks.workunit.client.0.smithi158.stdout: 2023-10-14T16:58:21.738 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] 1 test from Caps 2023-10-14T16:58:21.738 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] Caps.ReadZero 2023-10-14T16:58:21.889 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] Caps.ReadZero (151 ms) 2023-10-14T16:58:21.889 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] 1 test from Caps (151 ms total) 2023-10-14T16:58:21.889 INFO:tasks.workunit.client.0.smithi158.stdout: 2023-10-14T16:58:21.889 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] 5 tests from ACL 2023-10-14T16:58:21.890 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] ACL.SetACL 2023-10-14T16:58:21.928 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] ACL.SetACL (39 ms) 2023-10-14T16:58:21.928 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] ACL.Chmod 2023-10-14T16:58:21.950 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] ACL.Chmod (23 ms) 2023-10-14T16:58:21.951 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] ACL.DefaultACL 2023-10-14T16:58:21.987 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] ACL.DefaultACL (36 ms) 2023-10-14T16:58:21.988 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] ACL.Disabled 2023-10-14T16:58:22.030 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] ACL.Disabled (44 ms) 2023-10-14T16:58:22.031 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] ACL.SnapdirACL 2023-10-14T16:58:23.046 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] ACL.SnapdirACL (1015 ms) 2023-10-14T16:58:23.046 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] 5 tests from ACL (1157 ms total) 2023-10-14T16:58:23.046 INFO:tasks.workunit.client.0.smithi158.stdout: 2023-10-14T16:58:23.046 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] 3 tests from MonConfig 2023-10-14T16:58:23.047 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] MonConfig.MonAddrsMissing 2023-10-14T16:58:23.055 INFO:tasks.workunit.client.0.smithi158.stderr:failed to get an address for mon.a: error -2 2023-10-14T16:58:23.055 INFO:tasks.workunit.client.0.smithi158.stderr:failed to get an address for mon.b: error -2 2023-10-14T16:58:23.055 INFO:tasks.workunit.client.0.smithi158.stderr:failed to get an address for mon.c: error -2 2023-10-14T16:58:23.308 INFO:tasks.workunit.client.0.smithi158.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2023-10-14T16:58:23.309 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] MonConfig.MonAddrsMissing (263 ms) 2023-10-14T16:58:23.309 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] MonConfig.MonAddrsInConfigProxy 2023-10-14T16:58:24.326 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] MonConfig.MonAddrsInConfigProxy (1017 ms) 2023-10-14T16:58:24.326 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] MonConfig.MonAddrsInCct 2023-10-14T16:58:25.354 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] MonConfig.MonAddrsInCct (1028 ms) 2023-10-14T16:58:25.354 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] 3 tests from MonConfig (2308 ms total) 2023-10-14T16:58:25.354 INFO:tasks.workunit.client.0.smithi158.stdout: 2023-10-14T16:58:25.355 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] Global test environment tear-down 2023-10-14T16:58:25.355 INFO:tasks.workunit.client.0.smithi158.stdout:[==========] 123 tests from 4 test suites ran. (146799 ms total) 2023-10-14T16:58:25.355 INFO:tasks.workunit.client.0.smithi158.stdout:[ PASSED ] 123 tests. 2023-10-14T16:58:25.355 INFO:tasks.workunit.client.0.smithi158.stdout: 2023-10-14T16:58:25.355 INFO:tasks.workunit.client.0.smithi158.stdout: YOU HAVE 4 DISABLED TESTS 2023-10-14T16:58:25.356 INFO:tasks.workunit.client.0.smithi158.stdout: 2023-10-14T16:58:25.410 INFO:tasks.workunit.client.0.smithi158.stdout:[==========] Running 95 tests from 2 test suites. 2023-10-14T16:58:25.411 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] Global test environment set-up. 2023-10-14T16:58:25.411 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] 91 tests from LibCephFS 2023-10-14T16:58:25.411 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2023-10-14T16:58:25.504 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OpenEmptyComponent (93 ms) 2023-10-14T16:58:25.504 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2023-10-14T16:58:29.218 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OpenReadTruncate (3714 ms) 2023-10-14T16:58:29.218 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OpenReadWrite 2023-10-14T16:58:29.249 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OpenReadWrite (32 ms) 2023-10-14T16:58:29.250 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.MountNonExist 2023-10-14T16:58:29.269 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.MountNonExist (19 ms) 2023-10-14T16:58:29.269 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.MountDouble 2023-10-14T16:58:30.285 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.MountDouble (1016 ms) 2023-10-14T16:58:30.285 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.MountRemount 2023-10-14T16:58:31.313 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.MountRemount (1029 ms) 2023-10-14T16:58:31.314 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2023-10-14T16:58:31.322 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.UnmountUnmounted (9 ms) 2023-10-14T16:58:31.323 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2023-10-14T16:58:31.331 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ReleaseUnmounted (8 ms) 2023-10-14T16:58:31.331 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ReleaseMounted 2023-10-14T16:58:31.350 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ReleaseMounted (20 ms) 2023-10-14T16:58:31.351 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.UnmountRelease 2023-10-14T16:58:32.367 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.UnmountRelease (1017 ms) 2023-10-14T16:58:32.368 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Mount 2023-10-14T16:58:34.404 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Mount (2036 ms) 2023-10-14T16:58:34.404 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OpenLayout 2023-10-14T16:58:34.442 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OpenLayout (39 ms) 2023-10-14T16:58:34.443 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DirLs 2023-10-14T16:58:45.489 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:58:45.491 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:58:45.494 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:58:51.647 INFO:tasks.workunit.client.0.smithi158.stdout:rand: 3892 2023-10-14T16:58:51.647 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DirLs (17204 ms) 2023-10-14T16:58:51.647 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2023-10-14T16:58:52.124 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ManyNestedDirs (478 ms) 2023-10-14T16:58:52.125 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Xattrs 2023-10-14T16:58:52.168 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_a 2023-10-14T16:58:52.168 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_b 2023-10-14T16:58:52.168 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_c 2023-10-14T16:58:52.169 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_d 2023-10-14T16:58:52.169 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_e 2023-10-14T16:58:52.169 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_f 2023-10-14T16:58:52.169 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_g 2023-10-14T16:58:52.169 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_h 2023-10-14T16:58:52.169 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_i 2023-10-14T16:58:52.170 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_j 2023-10-14T16:58:52.170 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_k 2023-10-14T16:58:52.170 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_l 2023-10-14T16:58:52.170 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_m 2023-10-14T16:58:52.170 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_n 2023-10-14T16:58:52.171 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_o 2023-10-14T16:58:52.171 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_p 2023-10-14T16:58:52.171 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_q 2023-10-14T16:58:52.171 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_r 2023-10-14T16:58:52.171 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_s 2023-10-14T16:58:52.172 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_t 2023-10-14T16:58:52.172 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_u 2023-10-14T16:58:52.172 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_v 2023-10-14T16:58:52.172 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_w 2023-10-14T16:58:52.172 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_x 2023-10-14T16:58:52.173 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_y 2023-10-14T16:58:52.173 INFO:tasks.workunit.client.0.smithi158.stdout:getting attr user.test_xattr_z 2023-10-14T16:58:52.197 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Xattrs (73 ms) 2023-10-14T16:58:52.198 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Xattrs_ll 2023-10-14T16:58:52.220 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Xattrs_ll (22 ms) 2023-10-14T16:58:52.220 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LstatSlashdot 2023-10-14T16:58:52.238 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LstatSlashdot (18 ms) 2023-10-14T16:58:52.238 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.StatDirNlink 2023-10-14T16:58:52.283 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.StatDirNlink (45 ms) 2023-10-14T16:58:52.283 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DoubleChmod 2023-10-14T16:58:52.312 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DoubleChmod (29 ms) 2023-10-14T16:58:52.312 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Fchmod 2023-10-14T16:58:52.335 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Fchmod (24 ms) 2023-10-14T16:58:52.336 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Lchmod 2023-10-14T16:58:52.364 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Lchmod (29 ms) 2023-10-14T16:58:52.365 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Fchown 2023-10-14T16:58:52.387 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Fchown (23 ms) 2023-10-14T16:58:52.388 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.FlagO_PATH 2023-10-14T16:58:52.479 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.FlagO_PATH (92 ms) 2023-10-14T16:58:52.480 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Symlinks 2023-10-14T16:58:52.657 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Symlinks (177 ms) 2023-10-14T16:58:52.657 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DirSyms 2023-10-14T16:58:52.724 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DirSyms (67 ms) 2023-10-14T16:58:52.724 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LoopSyms 2023-10-14T16:58:52.786 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LoopSyms (62 ms) 2023-10-14T16:58:52.786 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2023-10-14T16:58:52.913 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (128 ms) 2023-10-14T16:58:52.914 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.BadArgument 2023-10-14T16:58:52.939 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.BadArgument (26 ms) 2023-10-14T16:58:52.939 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.BadFileDesc 2023-10-14T16:58:52.956 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.BadFileDesc (17 ms) 2023-10-14T16:58:52.956 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2023-10-14T16:58:52.979 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ReadEmptyFile (23 ms) 2023-10-14T16:58:52.979 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.PreadvPwritev 2023-10-14T16:58:53.003 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.PreadvPwritev (24 ms) 2023-10-14T16:58:53.004 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2023-10-14T16:58:53.028 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LlreadvLlwritev (25 ms) 2023-10-14T16:58:53.029 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.StripeUnitGran 2023-10-14T16:58:54.044 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.StripeUnitGran (1016 ms) 2023-10-14T16:58:54.045 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Rename 2023-10-14T16:58:54.076 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Rename (32 ms) 2023-10-14T16:58:54.077 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.UseUnmounted 2023-10-14T16:58:54.085 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.UseUnmounted (8 ms) 2023-10-14T16:58:54.086 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetPoolId 2023-10-14T16:58:54.103 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetPoolId (19 ms) 2023-10-14T16:58:54.104 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetPoolReplication 2023-10-14T16:58:54.121 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetPoolReplication (18 ms) 2023-10-14T16:58:54.121 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetExtentOsds 2023-10-14T16:58:54.143 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetExtentOsds (21 ms) 2023-10-14T16:58:54.143 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2023-10-14T16:58:54.163 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (21 ms) 2023-10-14T16:58:54.164 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.GetOsdAddr 2023-10-14T16:58:54.181 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.GetOsdAddr (18 ms) 2023-10-14T16:58:54.182 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OpenNoClose 2023-10-14T16:58:54.213 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OpenNoClose (32 ms) 2023-10-14T16:58:54.214 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Nlink 2023-10-14T16:58:54.269 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Nlink (55 ms) 2023-10-14T16:58:54.269 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SlashDotDot 2023-10-14T16:58:56.329 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SlashDotDot (2060 ms) 2023-10-14T16:58:56.329 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Btime 2023-10-14T16:58:57.374 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Btime (1045 ms) 2023-10-14T16:58:57.374 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SetBtime 2023-10-14T16:58:57.402 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SetBtime (29 ms) 2023-10-14T16:58:57.403 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LazyStatx 2023-10-14T16:58:58.454 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LazyStatx (1051 ms) 2023-10-14T16:58:58.454 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ChangeAttr 2023-10-14T16:58:58.491 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ChangeAttr (37 ms) 2023-10-14T16:58:58.491 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2023-10-14T16:58:58.535 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (44 ms) 2023-10-14T16:58:58.535 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2023-10-14T16:58:58.623 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (88 ms) 2023-10-14T16:58:58.623 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2023-10-14T16:58:58.674 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (52 ms) 2023-10-14T16:58:58.675 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SetSize 2023-10-14T16:58:58.722 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SetSize (48 ms) 2023-10-14T16:58:58.723 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2023-10-14T16:58:58.743 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OperationsOnRoot (20 ms) 2023-10-14T16:58:58.743 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ShutdownRace 2023-10-14T16:58:58.743 INFO:tasks.workunit.client.0.smithi158.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2023-10-14T16:59:15.719 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:59:15.722 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:59:15.724 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:59:31.806 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ShutdownRace (33064 ms) 2023-10-14T16:59:31.807 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.TestUtime 2023-10-14T16:59:31.840 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.TestUtime (34 ms) 2023-10-14T16:59:31.841 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.TestUtimes 2023-10-14T16:59:31.877 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.TestUtimes (37 ms) 2023-10-14T16:59:31.878 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.TestFutimens 2023-10-14T16:59:31.908 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.TestFutimens (30 ms) 2023-10-14T16:59:31.908 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2023-10-14T16:59:31.941 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.OperationsOnDotDot (34 ms) 2023-10-14T16:59:31.942 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Caps_vxattr 2023-10-14T16:59:31.965 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Caps_vxattr (23 ms) 2023-10-14T16:59:31.965 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SnapXattrs 2023-10-14T16:59:32.982 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SnapXattrs (1018 ms) 2023-10-14T16:59:32.983 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SnapQuota 2023-10-14T16:59:34.002 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SnapQuota (1020 ms) 2023-10-14T16:59:34.003 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Lseek 2023-10-14T16:59:34.036 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Lseek (33 ms) 2023-10-14T16:59:34.036 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2023-10-14T16:59:35.055 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (1019 ms) 2023-10-14T16:59:35.055 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2023-10-14T16:59:36.073 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.EmptySnapInfo (1018 ms) 2023-10-14T16:59:36.073 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SnapInfo 2023-10-14T16:59:37.092 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SnapInfo (1019 ms) 2023-10-14T16:59:37.092 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2023-10-14T16:59:37.114 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LookupInoMDSDir (23 ms) 2023-10-14T16:59:37.114 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LookupVino 2023-10-14T16:59:39.169 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LookupVino (2055 ms) 2023-10-14T16:59:39.170 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Openat 2023-10-14T16:59:39.219 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Openat (50 ms) 2023-10-14T16:59:39.219 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Statxat 2023-10-14T16:59:39.295 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Statxat (76 ms) 2023-10-14T16:59:39.296 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2023-10-14T16:59:39.358 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.StatxatATFDCWD (62 ms) 2023-10-14T16:59:39.358 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Fdopendir 2023-10-14T16:59:39.425 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Fdopendir (67 ms) 2023-10-14T16:59:39.425 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2023-10-14T16:59:39.500 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (76 ms) 2023-10-14T16:59:39.501 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2023-10-14T16:59:39.563 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (62 ms) 2023-10-14T16:59:39.563 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2023-10-14T16:59:39.635 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (73 ms) 2023-10-14T16:59:39.636 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Mkdirat 2023-10-14T16:59:39.694 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Mkdirat (59 ms) 2023-10-14T16:59:39.695 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2023-10-14T16:59:39.730 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (36 ms) 2023-10-14T16:59:39.730 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Readlinkat 2023-10-14T16:59:39.782 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Readlinkat (52 ms) 2023-10-14T16:59:39.783 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2023-10-14T16:59:39.837 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (54 ms) 2023-10-14T16:59:39.837 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Symlinkat 2023-10-14T16:59:39.908 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Symlinkat (71 ms) 2023-10-14T16:59:39.908 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2023-10-14T16:59:39.989 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (81 ms) 2023-10-14T16:59:39.989 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Unlinkat 2023-10-14T16:59:40.069 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Unlinkat (80 ms) 2023-10-14T16:59:40.069 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2023-10-14T16:59:40.145 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (77 ms) 2023-10-14T16:59:40.146 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Chownat 2023-10-14T16:59:40.217 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Chownat (72 ms) 2023-10-14T16:59:40.217 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2023-10-14T16:59:40.281 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ChownatATFDCWD (64 ms) 2023-10-14T16:59:40.282 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Chmodat 2023-10-14T16:59:40.356 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Chmodat (75 ms) 2023-10-14T16:59:40.357 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2023-10-14T16:59:40.429 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (72 ms) 2023-10-14T16:59:40.429 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.Utimensat 2023-10-14T16:59:44.230 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.Utimensat (3801 ms) 2023-10-14T16:59:44.230 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2023-10-14T16:59:45.792 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:59:45.795 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:59:45.797 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:59:49.230 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (5000 ms) 2023-10-14T16:59:49.230 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2023-10-14T16:59:49.540 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (310 ms) 2023-10-14T16:59:49.540 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2023-10-14T16:59:49.557 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (18 ms) 2023-10-14T16:59:49.558 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SetMountTimeout 2023-10-14T16:59:50.573 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SetMountTimeout (1016 ms) 2023-10-14T16:59:50.573 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2023-10-14T16:59:51.591 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] LibCephFS.SnapdirAttrs (1017 ms) 2023-10-14T16:59:51.591 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] 91 tests from LibCephFS (86180 ms total) 2023-10-14T16:59:51.591 INFO:tasks.workunit.client.0.smithi158.stdout: 2023-10-14T16:59:51.591 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] 4 tests from AccessTest 2023-10-14T16:59:51.592 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] AccessTest.Foo 2023-10-14T16:59:51.616 INFO:tasks.workunit.client.0.smithi158.stdout:out: [{"entity":"client.libcephfs_foo_test.1375169618","key":"AQAHySplhJyQJBAA/TdkZOgRhTuQ3f3aBlHfHw==","caps":{"mds":"allow rw","mon":"allow *","osd":"allow rw"}}] 2023-10-14T16:59:51.617 INFO:tasks.workunit.client.0.smithi158.stdout:key: AQAHySplhJyQJBAA/TdkZOgRhTuQ3f3aBlHfHw== 2023-10-14T16:59:51.645 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] AccessTest.Foo (54 ms) 2023-10-14T16:59:51.645 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] AccessTest.Path 2023-10-14T16:59:51.678 INFO:tasks.workunit.client.0.smithi158.stdout:out: [{"entity":"client.libcephfs_path_test.279286240","key":"AQAHySpl9bRFKBAAA/6sidKatDxrlk/gT7Rs3A==","caps":{"mds":"allow r, allow rw path=/ceph_test_libcephfs_access.386780112","mon":"allow r","osd":"allow rwx"}}] 2023-10-14T16:59:51.679 INFO:tasks.workunit.client.0.smithi158.stdout:key: AQAHySpl9bRFKBAAA/6sidKatDxrlk/gT7Rs3A== 2023-10-14T16:59:54.778 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] AccessTest.Path (3134 ms) 2023-10-14T16:59:54.779 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] AccessTest.ReadOnly 2023-10-14T16:59:54.842 INFO:tasks.workunit.client.0.smithi158.stdout:out: [{"entity":"client.libcephfs_readonly_test.841930888","key":"AQAKySpl5eoHMhAA6hQg6Agip5pT7gF4BdcYfQ==","caps":{"mds":"allow r","mon":"allow r","osd":"allow rw"}}] 2023-10-14T16:59:54.842 INFO:tasks.workunit.client.0.smithi158.stdout:key: AQAKySpl5eoHMhAA6hQg6Agip5pT7gF4BdcYfQ== 2023-10-14T16:59:54.898 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] AccessTest.ReadOnly (119 ms) 2023-10-14T16:59:54.898 INFO:tasks.workunit.client.0.smithi158.stdout:[ RUN ] AccessTest.User 2023-10-14T16:59:54.949 INFO:tasks.workunit.client.0.smithi158.stdout:out: [{"entity":"client.libcephfs_user_test.252847435","key":"AQAKySplC9JpOBAAFit/WM8BoGVtR4TWQururg==","caps":{"mds":"allow rw uid=123 gids=456,789","mon":"allow *","osd":"allow rw"}}] 2023-10-14T16:59:54.949 INFO:tasks.workunit.client.0.smithi158.stdout:key: AQAKySplC9JpOBAAFit/WM8BoGVtR4TWQururg== 2023-10-14T16:59:55.072 INFO:tasks.workunit.client.0.smithi158.stdout:[ OK ] AccessTest.User (174 ms) 2023-10-14T16:59:55.072 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] 4 tests from AccessTest (3481 ms total) 2023-10-14T16:59:55.072 INFO:tasks.workunit.client.0.smithi158.stdout: 2023-10-14T16:59:55.072 INFO:tasks.workunit.client.0.smithi158.stdout:[----------] Global test environment tear-down 2023-10-14T16:59:55.073 INFO:tasks.workunit.client.0.smithi158.stdout:[==========] 95 tests from 2 test suites ran. (89661 ms total) 2023-10-14T16:59:55.073 INFO:tasks.workunit.client.0.smithi158.stdout:[ PASSED ] 95 tests. 2023-10-14T16:59:55.079 INFO:tasks.workunit.client.0.smithi158.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh: line 5: ceph_test_libcephfs_reclaim: command not found 2023-10-14T16:59:55.079 DEBUG:teuthology.orchestra.run:got remote process result: 127 2023-10-14T16:59:55.080 INFO:tasks.workunit:Stopping ['libcephfs/test.sh'] on client.0... 2023-10-14T16:59:55.080 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-14T16:59:55.348 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test libcephfs/test.sh) on smithi158 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2023-10-14T16:59:55.421 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=57526decaeb6495c9313e3f6fa9d5a4b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test libcephfs/test.sh) on smithi158 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2023-10-14T16:59:55.425 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-14T16:59:55.434 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-14T16:59:55.435 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2023-10-14T16:59:55.435 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T16:59:55.435 DEBUG:teuthology.orchestra.run.smithi158:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-14T16:59:55.481 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:ceph-fuse[83323]: fuse finished with error 0 and tester_r 0 2023-10-14T16:59:55.482 INFO:teuthology.orchestra.run:waiting for 900 2023-10-14T17:00:01.584 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-10-14T17:00:01.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T17:00:01.585 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T17:00:01.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T17:00:01.604 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-10-14T17:00:01.661 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T17:00:01.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T17:00:01.662 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T17:00:01.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T17:00:01.737 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-10-14T17:00:01.839 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T17:00:01.849 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-14T17:00:01.850 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T17:00:01.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.984+0000 7f29eba3e700 1 Processor -- start 2023-10-14T17:00:01.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.984+0000 7f29eba3e700 1 -- start start 2023-10-14T17:00:01.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.984+0000 7f29eba3e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29e4070410 0x7f29e4136d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:01.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29eba3e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e409efb0 con 0x7f29e4137290 2023-10-14T17:00:01.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29eba3e700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e409de30 con 0x7f29e41376a0 2023-10-14T17:00:01.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29eba3e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e409e860 con 0x7f29e4070410 2023-10-14T17:00:01.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29e8fd9700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f29e4137290 0x7f29e40a0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40384/0 (socket says 172.21.15.8:40384) 2023-10-14T17:00:01.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29e8fd9700 1 -- 172.21.15.8:0/4083243987 learned_addr learned my addr 172.21.15.8:0/4083243987 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:00:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29e97da700 1 --2- 172.21.15.8:0/4083243987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29e4070410 0x7f29e4136d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29dbfff700 1 -- 172.21.15.8:0/4083243987 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494107655 0 0) 0x7f29e409efb0 con 0x7f29e4137290 2023-10-14T17:00:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29dbfff700 1 -- 172.21.15.8:0/4083243987 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29d0003570 con 0x7f29e4137290 2023-10-14T17:00:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29dbfff700 1 -- 172.21.15.8:0/4083243987 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636399794 0 0) 0x7f29e409de30 con 0x7f29e41376a0 2023-10-14T17:00:01.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29dbfff700 1 -- 172.21.15.8:0/4083243987 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e409efb0 con 0x7f29e41376a0 2023-10-14T17:00:01.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29e97da700 1 -- 172.21.15.8:0/4083243987 >> v1:172.21.15.155:6789/0 conn(0x7f29e41376a0 legacy=0x7f29e40a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:01.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29e97da700 1 -- 172.21.15.8:0/4083243987 >> v1:172.21.15.8:6789/0 conn(0x7f29e4137290 legacy=0x7f29e40a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:01.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29dbfff700 1 -- 172.21.15.8:0/4083243987 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3677583751 0 0) 0x7f29d0003570 con 0x7f29e4137290 2023-10-14T17:00:01.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29e97da700 1 -- 172.21.15.8:0/4083243987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e409db20 con 0x7f29e4070410 2023-10-14T17:00:01.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.985+0000 7f29e97da700 1 --2- 172.21.15.8:0/4083243987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29e4070410 0x7f29e4136d50 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f29e409dd10 tx=0x7f29e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c89540285afef25 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:01.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.986+0000 7f29dbfff700 1 -- 172.21.15.8:0/4083243987 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4001470 con 0x7f29e4070410 2023-10-14T17:00:01.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.986+0000 7f29dbfff700 1 -- 172.21.15.8:0/4083243987 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e0011420 con 0x7f29e4070410 2023-10-14T17:00:01.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.986+0000 7f29dbfff700 1 -- 172.21.15.8:0/4083243987 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e00117c0 con 0x7f29e4070410 2023-10-14T17:00:01.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.986+0000 7f29eba3e700 1 -- 172.21.15.8:0/4083243987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29e4070410 msgr2=0x7f29e4136d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:01.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.986+0000 7f29eba3e700 1 --2- 172.21.15.8:0/4083243987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29e4070410 0x7f29e4136d50 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f29e409dd10 tx=0x7f29e00091a0 comp rx=0 tx=0).stop 2023-10-14T17:00:01.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.986+0000 7f29eba3e700 1 -- 172.21.15.8:0/4083243987 shutdown_connections 2023-10-14T17:00:01.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.986+0000 7f29eba3e700 1 --2- 172.21.15.8:0/4083243987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29e4070410 0x7f29e4136d50 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:01.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.986+0000 7f29eba3e700 1 -- 172.21.15.8:0/4083243987 >> 172.21.15.8:0/4083243987 conn(0x7f29e4067820 msgr2=0x7f29e4067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:01.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.986+0000 7f29eba3e700 1 -- 172.21.15.8:0/4083243987 shutdown_connections 2023-10-14T17:00:01.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.986+0000 7f29eba3e700 1 -- 172.21.15.8:0/4083243987 wait complete. 2023-10-14T17:00:01.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.987+0000 7f29eba3e700 1 Processor -- start 2023-10-14T17:00:01.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.987+0000 7f29eba3e700 1 -- start start 2023-10-14T17:00:01.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.988+0000 7f29eba3e700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29e4137290 0x7f29e4097190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:01.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.988+0000 7f29eba3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e41376a0 0x7f29e40976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:01.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.988+0000 7f29eba3e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29e4097c10 0x7f29e4146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.988+0000 7f29eba3e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e4099cd0 con 0x7f29e41376a0 2023-10-14T17:00:02.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.988+0000 7f29eba3e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e4098750 con 0x7f29e4097c10 2023-10-14T17:00:02.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.988+0000 7f29eba3e700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e4099aa0 con 0x7f29e4137290 2023-10-14T17:00:02.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.988+0000 7f29e8fd9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e41376a0 0x7f29e40976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.988+0000 7f29e8fd9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e41376a0 0x7f29e40976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60108/0 (socket says 172.21.15.8:60108) 2023-10-14T17:00:02.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.988+0000 7f29e8fd9700 1 -- 172.21.15.8:0/758543815 learned_addr learned my addr 172.21.15.8:0/758543815 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:02.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.988+0000 7f29e97da700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29e4137290 0x7f29e4097190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.988+0000 7f29e9fdb700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29e4097c10 0x7f29e4146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.989+0000 7f29e8fd9700 1 -- 172.21.15.8:0/758543815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29e4137290 msgr2=0x7f29e4097190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.989+0000 7f29e8fd9700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29e4137290 0x7f29e4097190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.989+0000 7f29e8fd9700 1 -- 172.21.15.8:0/758543815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29e4097c10 msgr2=0x7f29e4146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.989+0000 7f29e8fd9700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29e4097c10 0x7f29e4146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.989+0000 7f29e8fd9700 1 -- 172.21.15.8:0/758543815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e0009420 con 0x7f29e41376a0 2023-10-14T17:00:02.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.989+0000 7f29e8fd9700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e41376a0 0x7f29e40976d0 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7f29d400cb70 tx=0x7f29d4001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.989+0000 7f29d97fa700 1 -- 172.21.15.8:0/758543815 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400ce80 con 0x7f29e41376a0 2023-10-14T17:00:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.989+0000 7f29d97fa700 1 -- 172.21.15.8:0/758543815 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d4007360 con 0x7f29e41376a0 2023-10-14T17:00:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.989+0000 7f29eba3e700 1 -- 172.21.15.8:0/758543815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e409b440 con 0x7f29e41376a0 2023-10-14T17:00:02.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.989+0000 7f29d97fa700 1 -- 172.21.15.8:0/758543815 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4007700 con 0x7f29e41376a0 2023-10-14T17:00:02.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.989+0000 7f29eba3e700 1 -- 172.21.15.8:0/758543815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e4099e70 con 0x7f29e41376a0 2023-10-14T17:00:02.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.990+0000 7f29eba3e700 1 -- 172.21.15.8:0/758543815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e4068330 con 0x7f29e41376a0 2023-10-14T17:00:02.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.990+0000 7f29d97fa700 1 -- 172.21.15.8:0/758543815 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29d4004a40 con 0x7f29e41376a0 2023-10-14T17:00:02.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.991+0000 7f29d97fa700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f29c8066f30 0x7f29c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.991+0000 7f29d97fa700 1 -- 172.21.15.8:0/758543815 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f29d4083750 con 0x7f29e41376a0 2023-10-14T17:00:02.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.991+0000 7f29e97da700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f29c8066f30 0x7f29c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.991+0000 7f29e97da700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f29c8066f30 0x7f29c80693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f29e00030c0 tx=0x7f29e0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:02.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:01.995+0000 7f29d97fa700 1 -- 172.21.15.8:0/758543815 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29d4050f60 con 0x7f29e41376a0 2023-10-14T17:00:02.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.189+0000 7f29eba3e700 1 -- 172.21.15.8:0/758543815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29e409eca0 con 0x7f29e41376a0 2023-10-14T17:00:02.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.190+0000 7f29d97fa700 1 -- 172.21.15.8:0/758543815 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12273 (secure 0 0 0) 0x7f29d4054580 con 0x7f29e41376a0 2023-10-14T17:00:02.191 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:00:02.192 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:59:47.965865+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-14T16:54:52.330193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-14T16:54:53.459270+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":14,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T17:00:02.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.192+0000 7f29eba3e700 1 -- 172.21.15.8:0/758543815 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f29c8066f30 msgr2=0x7f29c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.192+0000 7f29eba3e700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f29c8066f30 0x7f29c80693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f29e00030c0 tx=0x7f29e0016000 comp rx=0 tx=0).stop 2023-10-14T17:00:02.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.192+0000 7f29eba3e700 1 -- 172.21.15.8:0/758543815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e41376a0 msgr2=0x7f29e40976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.192+0000 7f29eba3e700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e41376a0 0x7f29e40976d0 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7f29d400cb70 tx=0x7f29d4001b50 comp rx=0 tx=0).stop 2023-10-14T17:00:02.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.192+0000 7f29eba3e700 1 -- 172.21.15.8:0/758543815 shutdown_connections 2023-10-14T17:00:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.192+0000 7f29eba3e700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f29c8066f30 0x7f29c80693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.192+0000 7f29eba3e700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29e4097c10 0x7f29e4146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.192+0000 7f29eba3e700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29e4137290 0x7f29e4097190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.192+0000 7f29eba3e700 1 --2- 172.21.15.8:0/758543815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29e41376a0 0x7f29e40976d0 unknown :-1 s=CLOSED pgs=2457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.192+0000 7f29eba3e700 1 -- 172.21.15.8:0/758543815 >> 172.21.15.8:0/758543815 conn(0x7f29e4067820 msgr2=0x7f29e4132ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:02.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.192+0000 7f29eba3e700 1 -- 172.21.15.8:0/758543815 shutdown_connections 2023-10-14T17:00:02.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.192+0000 7f29eba3e700 1 -- 172.21.15.8:0/758543815 wait complete. 2023-10-14T17:00:02.205 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T17:00:02.206 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T17:00:02.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.323+0000 7fd8027b3700 1 Processor -- start 2023-10-14T17:00:02.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.323+0000 7fd8027b3700 1 -- start start 2023-10-14T17:00:02.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.324+0000 7fd8027b3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7fc0a41c0 0x7fd7fc06e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.324+0000 7fd8027b3700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd7fc131890 0x7fd7fc131ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.324+0000 7fd8027b3700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc0a4640 con 0x7fd7fc0a2690 2023-10-14T17:00:02.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.324+0000 7fd8027b3700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc06e7d0 con 0x7fd7fc131890 2023-10-14T17:00:02.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.324+0000 7fd8027b3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0a4900 con 0x7fd7fc0a41c0 2023-10-14T17:00:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.324+0000 7fd7fb7fe700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd7fc131890 0x7fd7fc131ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.324+0000 7fd7fbfff700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7fc0a41c0 0x7fd7fc06e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.324+0000 7fd800d50700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd7fc0a2690 0x7fd7fc0a2aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.8:34072/0 (socket says 172.21.15.8:34072) 2023-10-14T17:00:02.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.324+0000 7fd800d50700 1 -- 172.21.15.8:0/4170597990 learned_addr learned my addr 172.21.15.8:0/4170597990 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:00:02.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd7faffd700 1 -- 172.21.15.8:0/4170597990 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190714124 0 0) 0x7fd7fc0a4640 con 0x7fd7fc0a2690 2023-10-14T17:00:02.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd7faffd700 1 -- 172.21.15.8:0/4170597990 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e4003570 con 0x7fd7fc0a2690 2023-10-14T17:00:02.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd7fbfff700 1 -- 172.21.15.8:0/4170597990 >> v2:172.21.15.155:3300/0 conn(0x7fd7fc131890 msgr2=0x7fd7fc131ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:02.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd7fbfff700 1 --2- 172.21.15.8:0/4170597990 >> v2:172.21.15.155:3300/0 conn(0x7fd7fc131890 0x7fd7fc131ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd7fbfff700 1 -- 172.21.15.8:0/4170597990 >> v1:172.21.15.155:6789/0 conn(0x7fd7fc0a2690 legacy=0x7fd7fc0a2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd7fbfff700 1 -- 172.21.15.8:0/4170597990 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc06d860 con 0x7fd7fc0a41c0 2023-10-14T17:00:02.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd7fb7fe700 1 --2- 172.21.15.8:0/4170597990 >> v2:172.21.15.155:3300/0 conn(0x7fd7fc131890 0x7fd7fc131ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T17:00:02.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd7fbfff700 1 --2- 172.21.15.8:0/4170597990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7fc0a41c0 0x7fd7fc06e290 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0098e0 tx=0x7fd7ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=939249d50413b97c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:02.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd7faffd700 1 -- 172.21.15.8:0/4170597990 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec011630 con 0x7fd7fc0a41c0 2023-10-14T17:00:02.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd7faffd700 1 -- 172.21.15.8:0/4170597990 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec011790 con 0x7fd7fc0a41c0 2023-10-14T17:00:02.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd7faffd700 1 -- 172.21.15.8:0/4170597990 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec011b30 con 0x7fd7fc0a41c0 2023-10-14T17:00:02.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd8027b3700 1 -- 172.21.15.8:0/4170597990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7fc0a41c0 msgr2=0x7fd7fc06e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd8027b3700 1 --2- 172.21.15.8:0/4170597990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7fc0a41c0 0x7fd7fc06e290 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0098e0 tx=0x7fd7ec0091a0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd8027b3700 1 -- 172.21.15.8:0/4170597990 shutdown_connections 2023-10-14T17:00:02.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd8027b3700 1 --2- 172.21.15.8:0/4170597990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7fc0a41c0 0x7fd7fc06e290 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd8027b3700 1 --2- 172.21.15.8:0/4170597990 >> v2:172.21.15.155:3300/0 conn(0x7fd7fc131890 0x7fd7fc131ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.325+0000 7fd8027b3700 1 -- 172.21.15.8:0/4170597990 >> 172.21.15.8:0/4170597990 conn(0x7fd7fc06f840 msgr2=0x7fd7fc0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:02.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.326+0000 7fd8027b3700 1 -- 172.21.15.8:0/4170597990 shutdown_connections 2023-10-14T17:00:02.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.326+0000 7fd8027b3700 1 -- 172.21.15.8:0/4170597990 wait complete. 2023-10-14T17:00:02.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.326+0000 7fd8027b3700 1 Processor -- start 2023-10-14T17:00:02.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd8027b3700 1 -- start start 2023-10-14T17:00:02.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd8027b3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7fc0a2690 0x7fd7fc096480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd8027b3700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7fc131890 0x7fd7fc0969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd8027b3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7fc09a4a0 0x7fd7fc096f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd8027b3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0992e0 con 0x7fd7fc0a2690 2023-10-14T17:00:02.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd8027b3700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc099d50 con 0x7fd7fc09a4a0 2023-10-14T17:00:02.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd8027b3700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc099510 con 0x7fd7fc131890 2023-10-14T17:00:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd7fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7fc0a2690 0x7fd7fc096480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd7fbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7fc0a2690 0x7fd7fc096480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60118/0 (socket says 172.21.15.8:60118) 2023-10-14T17:00:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd7fbfff700 1 -- 172.21.15.8:0/4059222581 learned_addr learned my addr 172.21.15.8:0/4059222581 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd7fb7fe700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7fc131890 0x7fd7fc0969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd800d50700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7fc09a4a0 0x7fd7fc096f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd7fbfff700 1 -- 172.21.15.8:0/4059222581 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7fc131890 msgr2=0x7fd7fc0969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd7fbfff700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7fc131890 0x7fd7fc0969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd7fbfff700 1 -- 172.21.15.8:0/4059222581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7fc09a4a0 msgr2=0x7fd7fc096f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd7fbfff700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7fc09a4a0 0x7fd7fc096f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.327+0000 7fd7fbfff700 1 -- 172.21.15.8:0/4059222581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f0009420 con 0x7fd7fc0a2690 2023-10-14T17:00:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.328+0000 7fd7fbfff700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7fc0a2690 0x7fd7fc096480 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc06e910 tx=0x7fd7ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.328+0000 7fd7e3fff700 1 -- 172.21.15.8:0/4059222581 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec011900 con 0x7fd7fc0a2690 2023-10-14T17:00:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.328+0000 7fd7e3fff700 1 -- 172.21.15.8:0/4059222581 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec011a60 con 0x7fd7fc0a2690 2023-10-14T17:00:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.328+0000 7fd7e3fff700 1 -- 172.21.15.8:0/4059222581 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec023620 con 0x7fd7fc0a2690 2023-10-14T17:00:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.328+0000 7fd8027b3700 1 -- 172.21.15.8:0/4059222581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec009420 con 0x7fd7fc0a2690 2023-10-14T17:00:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.328+0000 7fd8027b3700 1 -- 172.21.15.8:0/4059222581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc0a1210 con 0x7fd7fc0a2690 2023-10-14T17:00:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.329+0000 7fd8027b3700 1 -- 172.21.15.8:0/4059222581 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7fc0708d0 con 0x7fd7fc0a2690 2023-10-14T17:00:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.329+0000 7fd7e3fff700 1 -- 172.21.15.8:0/4059222581 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7ec02c3b0 con 0x7fd7fc0a2690 2023-10-14T17:00:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.330+0000 7fd7e3fff700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fd7e8066f30 0x7fd7e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.330+0000 7fd7e3fff700 1 -- 172.21.15.8:0/4059222581 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7fd7ec085260 con 0x7fd7fc0a2690 2023-10-14T17:00:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.330+0000 7fd7fb7fe700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fd7e8066f30 0x7fd7e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.330+0000 7fd7fb7fe700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fd7e8066f30 0x7fd7e80693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc06f1d0 tx=0x7fd7f00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.334+0000 7fd7e3fff700 1 -- 172.21.15.8:0/4059222581 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7ec0529f0 con 0x7fd7fc0a2690 2023-10-14T17:00:02.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.523+0000 7fd8027b3700 1 -- 172.21.15.8:0/4059222581 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7fc099ec0 con 0x7fd7e8066f30 2023-10-14T17:00:02.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.531+0000 7fd7e3fff700 1 -- 172.21.15.8:0/4059222581 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278903 (secure 0 0 0) 0x7fd7fc099ec0 con 0x7fd7e8066f30 2023-10-14T17:00:02.537 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:00:02.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.534+0000 7fd8027b3700 1 -- 172.21.15.8:0/4059222581 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fd7e8066f30 msgr2=0x7fd7e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.534+0000 7fd8027b3700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fd7e8066f30 0x7fd7e80693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc06f1d0 tx=0x7fd7f00091a0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.534+0000 7fd8027b3700 1 -- 172.21.15.8:0/4059222581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7fc0a2690 msgr2=0x7fd7fc096480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.534+0000 7fd8027b3700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7fc0a2690 0x7fd7fc096480 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc06e910 tx=0x7fd7ec017000 comp rx=0 tx=0).stop 2023-10-14T17:00:02.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.534+0000 7fd8027b3700 1 -- 172.21.15.8:0/4059222581 shutdown_connections 2023-10-14T17:00:02.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.534+0000 7fd8027b3700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fd7e8066f30 0x7fd7e80693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.534+0000 7fd8027b3700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7fc09a4a0 0x7fd7fc096f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.534+0000 7fd8027b3700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd7fc0a2690 0x7fd7fc096480 unknown :-1 s=CLOSED pgs=2458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.534+0000 7fd8027b3700 1 --2- 172.21.15.8:0/4059222581 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7fc131890 0x7fd7fc0969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.534+0000 7fd8027b3700 1 -- 172.21.15.8:0/4059222581 >> 172.21.15.8:0/4059222581 conn(0x7fd7fc06f840 msgr2=0x7fd7fc137da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:02.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.534+0000 7fd8027b3700 1 -- 172.21.15.8:0/4059222581 shutdown_connections 2023-10-14T17:00:02.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.534+0000 7fd8027b3700 1 -- 172.21.15.8:0/4059222581 wait complete. 2023-10-14T17:00:02.543 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T17:00:02.547 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2023-10-14T17:00:02.049811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":191247906,"num_objects":152,"num_object_clones":21,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":8,"num_read":210,"num_read_kb":798,"num_write":33907,"num_write_kb":206276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75326,"ondisk_log_size":75326,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1608864,"kb_used_data":374656,"kb_used_omap":0,"kb_used_meta":1234176,"kb_avail":375878496,"statfs":{"total":386547056640,"available":384899579904,"internally_reserved":0,"allocated":383647744,"data_stored":382824603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1263796224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":559526,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":3,"num_read":7,"num_read_kb":8,"num_write":110,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002923"},"pg_stats":[{"pgid":"4.3f","version":"23'645","reported_seq":711,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939505+0000","last_change":"2023-10-14T16:59:40.048771+0000","last_active":"2023-10-14T16:59:54.939505+0000","last_peered":"2023-10-14T16:59:54.939505+0000","last_clean":"2023-10-14T16:59:54.939505+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T16:59:54.939505+0000","last_undegraded":"2023-10-14T16:59:54.939505+0000","last_fullsized":"2023-10-14T16:59:54.939505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070427155000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"23'746","reported_seq":812,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938563+0000","last_change":"2023-10-14T16:59:40.012472+0000","last_active":"2023-10-14T16:59:54.938563+0000","last_peered":"2023-10-14T16:59:54.938563+0000","last_clean":"2023-10-14T16:59:54.938563+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T16:59:54.938563+0000","last_undegraded":"2023-10-14T16:59:54.938563+0000","last_fullsized":"2023-10-14T16:59:54.938563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038749005000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'628","reported_seq":694,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933861+0000","last_change":"2023-10-14T16:59:40.031831+0000","last_active":"2023-10-14T16:59:54.933861+0000","last_peered":"2023-10-14T16:59:54.933861+0000","last_clean":"2023-10-14T16:59:54.933861+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T16:59:54.933861+0000","last_undegraded":"2023-10-14T16:59:54.933861+0000","last_fullsized":"2023-10-14T16:59:54.933861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:56.343441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152503000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"23'646","reported_seq":712,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.923219+0000","last_change":"2023-10-14T16:59:40.006348+0000","last_active":"2023-10-14T16:59:54.923219+0000","last_peered":"2023-10-14T16:59:54.923219+0000","last_clean":"2023-10-14T16:59:54.923219+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T16:59:54.923219+0000","last_undegraded":"2023-10-14T16:59:54.923219+0000","last_fullsized":"2023-10-14T16:59:54.923219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:05.483417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033834213000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"23'521","reported_seq":587,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937750+0000","last_change":"2023-10-14T16:59:40.046517+0000","last_active":"2023-10-14T16:59:54.937750+0000","last_peered":"2023-10-14T16:59:54.937750+0000","last_clean":"2023-10-14T16:59:54.937750+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T16:59:54.937750+0000","last_undegraded":"2023-10-14T16:59:54.937750+0000","last_fullsized":"2023-10-14T16:59:54.937750+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070258685000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'532","reported_seq":598,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.918042+0000","last_change":"2023-10-14T16:59:40.032103+0000","last_active":"2023-10-14T16:59:54.918042+0000","last_peered":"2023-10-14T16:59:54.918042+0000","last_clean":"2023-10-14T16:59:54.918042+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T16:59:54.918042+0000","last_undegraded":"2023-10-14T16:59:54.918042+0000","last_fullsized":"2023-10-14T16:59:54.918042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:59.572769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058053194000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'962","reported_seq":1028,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921346+0000","last_change":"2023-10-14T16:59:40.032217+0000","last_active":"2023-10-14T16:59:54.921346+0000","last_peered":"2023-10-14T16:59:54.921346+0000","last_clean":"2023-10-14T16:59:54.921346+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T16:59:54.921346+0000","last_undegraded":"2023-10-14T16:59:54.921346+0000","last_fullsized":"2023-10-14T16:59:54.921346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:15:51.621106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058433710999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'666","reported_seq":732,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.919451+0000","last_change":"2023-10-14T16:59:40.032894+0000","last_active":"2023-10-14T16:59:54.919451+0000","last_peered":"2023-10-14T16:59:54.919451+0000","last_clean":"2023-10-14T16:59:54.919451+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T16:59:54.919451+0000","last_undegraded":"2023-10-14T16:59:54.919451+0000","last_fullsized":"2023-10-14T16:59:54.919451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:40.295415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057530364000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"23'726","reported_seq":792,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939207+0000","last_change":"2023-10-14T16:59:40.048548+0000","last_active":"2023-10-14T16:59:54.939207+0000","last_peered":"2023-10-14T16:59:54.939207+0000","last_clean":"2023-10-14T16:59:54.939207+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T16:59:54.939207+0000","last_undegraded":"2023-10-14T16:59:54.939207+0000","last_fullsized":"2023-10-14T16:59:54.939207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070350251000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'591","reported_seq":657,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933559+0000","last_change":"2023-10-14T16:59:40.030928+0000","last_active":"2023-10-14T16:59:54.933559+0000","last_peered":"2023-10-14T16:59:54.933559+0000","last_clean":"2023-10-14T16:59:54.933559+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T16:59:54.933559+0000","last_undegraded":"2023-10-14T16:59:54.933559+0000","last_fullsized":"2023-10-14T16:59:54.933559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:54:37.853332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057828565999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"23'504","reported_seq":569,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.920075+0000","last_change":"2023-10-14T16:59:40.011889+0000","last_active":"2023-10-14T16:59:54.920075+0000","last_peered":"2023-10-14T16:59:54.920075+0000","last_clean":"2023-10-14T16:59:54.920075+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T16:59:54.920075+0000","last_undegraded":"2023-10-14T16:59:54.920075+0000","last_fullsized":"2023-10-14T16:59:54.920075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:18:19.208533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039012109000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"23'510","reported_seq":576,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938970+0000","last_change":"2023-10-14T16:59:40.020882+0000","last_active":"2023-10-14T16:59:54.938970+0000","last_peered":"2023-10-14T16:59:54.938970+0000","last_clean":"2023-10-14T16:59:54.938970+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T16:59:54.938970+0000","last_undegraded":"2023-10-14T16:59:54.938970+0000","last_fullsized":"2023-10-14T16:59:54.938970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047436036000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"23'512","reported_seq":578,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930357+0000","last_change":"2023-10-14T16:59:40.046901+0000","last_active":"2023-10-14T16:59:54.930357+0000","last_peered":"2023-10-14T16:59:54.930357+0000","last_clean":"2023-10-14T16:59:54.930357+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T16:59:54.930357+0000","last_undegraded":"2023-10-14T16:59:54.930357+0000","last_fullsized":"2023-10-14T16:59:54.930357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:13.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070191972000000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"23'757","reported_seq":822,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938286+0000","last_change":"2023-10-14T16:59:40.009015+0000","last_active":"2023-10-14T16:59:54.938286+0000","last_peered":"2023-10-14T16:59:54.938286+0000","last_clean":"2023-10-14T16:59:54.938286+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T16:59:54.938286+0000","last_undegraded":"2023-10-14T16:59:54.938286+0000","last_fullsized":"2023-10-14T16:59:54.938286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036605058000000003,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"23'655","reported_seq":721,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.932286+0000","last_change":"2023-10-14T16:59:40.012646+0000","last_active":"2023-10-14T16:59:54.932286+0000","last_peered":"2023-10-14T16:59:54.932286+0000","last_clean":"2023-10-14T16:59:54.932286+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T16:59:54.932286+0000","last_undegraded":"2023-10-14T16:59:54.932286+0000","last_fullsized":"2023-10-14T16:59:54.932286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038947427,"stat_sum":{"num_bytes":4105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"23'745","reported_seq":810,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933504+0000","last_change":"2023-10-14T16:59:40.032292+0000","last_active":"2023-10-14T16:59:54.933504+0000","last_peered":"2023-10-14T16:59:54.933504+0000","last_clean":"2023-10-14T16:59:54.933504+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T16:59:54.933504+0000","last_undegraded":"2023-10-14T16:59:54.933504+0000","last_fullsized":"2023-10-14T16:59:54.933504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:41:12.510526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058345898,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'595","reported_seq":661,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939581+0000","last_change":"2023-10-14T16:59:40.048812+0000","last_active":"2023-10-14T16:59:54.939581+0000","last_peered":"2023-10-14T16:59:54.939581+0000","last_clean":"2023-10-14T16:59:54.939581+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T16:59:54.939581+0000","last_undegraded":"2023-10-14T16:59:54.939581+0000","last_fullsized":"2023-10-14T16:59:54.939581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071573409000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'693","reported_seq":759,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.932562+0000","last_change":"2023-10-14T16:59:40.030743+0000","last_active":"2023-10-14T16:59:54.932562+0000","last_peered":"2023-10-14T16:59:54.932562+0000","last_clean":"2023-10-14T16:59:54.932562+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T16:59:54.932562+0000","last_undegraded":"2023-10-14T16:59:54.932562+0000","last_fullsized":"2023-10-14T16:59:54.932562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057407435999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"23'572","reported_seq":639,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.929581+0000","last_change":"2023-10-14T16:59:40.045847+0000","last_active":"2023-10-14T16:59:54.929581+0000","last_peered":"2023-10-14T16:59:54.929581+0000","last_clean":"2023-10-14T16:59:54.929581+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T16:59:54.929581+0000","last_undegraded":"2023-10-14T16:59:54.929581+0000","last_fullsized":"2023-10-14T16:59:54.929581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070060102999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"23'761","reported_seq":827,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939075+0000","last_change":"2023-10-14T16:59:40.029354+0000","last_active":"2023-10-14T16:59:54.939075+0000","last_peered":"2023-10-14T16:59:54.939075+0000","last_clean":"2023-10-14T16:59:54.939075+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T16:59:54.939075+0000","last_undegraded":"2023-10-14T16:59:54.939075+0000","last_fullsized":"2023-10-14T16:59:54.939075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056633790000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"23'810","reported_seq":876,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938705+0000","last_change":"2023-10-14T16:59:40.012817+0000","last_active":"2023-10-14T16:59:54.938705+0000","last_peered":"2023-10-14T16:59:54.938705+0000","last_clean":"2023-10-14T16:59:54.938705+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T16:59:54.938705+0000","last_undegraded":"2023-10-14T16:59:54.938705+0000","last_fullsized":"2023-10-14T16:59:54.938705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038418550000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"23'694","reported_seq":760,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938748+0000","last_change":"2023-10-14T16:59:40.041012+0000","last_active":"2023-10-14T16:59:54.938748+0000","last_peered":"2023-10-14T16:59:54.938748+0000","last_clean":"2023-10-14T16:59:54.938748+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T16:59:54.938748+0000","last_undegraded":"2023-10-14T16:59:54.938748+0000","last_fullsized":"2023-10-14T16:59:54.938748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.065688290999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'638","reported_seq":704,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935953+0000","last_change":"2023-10-14T16:59:39.983318+0000","last_active":"2023-10-14T16:59:54.935953+0000","last_peered":"2023-10-14T16:59:54.935953+0000","last_clean":"2023-10-14T16:59:54.935953+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T16:59:54.935953+0000","last_undegraded":"2023-10-14T16:59:54.935953+0000","last_fullsized":"2023-10-14T16:59:54.935953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011260075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"23'846","reported_seq":912,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934718+0000","last_change":"2023-10-14T16:59:40.031942+0000","last_active":"2023-10-14T16:59:54.934718+0000","last_peered":"2023-10-14T16:59:54.934718+0000","last_clean":"2023-10-14T16:59:54.934718+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T16:59:54.934718+0000","last_undegraded":"2023-10-14T16:59:54.934718+0000","last_fullsized":"2023-10-14T16:59:54.934718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"23'636","reported_seq":702,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938462+0000","last_change":"2023-10-14T16:59:40.023150+0000","last_active":"2023-10-14T16:59:54.938462+0000","last_peered":"2023-10-14T16:59:54.938462+0000","last_clean":"2023-10-14T16:59:54.938462+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T16:59:54.938462+0000","last_undegraded":"2023-10-14T16:59:54.938462+0000","last_fullsized":"2023-10-14T16:59:54.938462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048983802,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'679","reported_seq":745,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935906+0000","last_change":"2023-10-14T16:59:40.021577+0000","last_active":"2023-10-14T16:59:54.935906+0000","last_peered":"2023-10-14T16:59:54.935906+0000","last_clean":"2023-10-14T16:59:54.935906+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T16:59:54.935906+0000","last_undegraded":"2023-10-14T16:59:54.935906+0000","last_fullsized":"2023-10-14T16:59:54.935906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047799974000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'513","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933795+0000","last_change":"2023-10-14T16:59:40.032393+0000","last_active":"2023-10-14T16:59:54.933795+0000","last_peered":"2023-10-14T16:59:54.933795+0000","last_clean":"2023-10-14T16:59:54.933795+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T16:59:54.933795+0000","last_undegraded":"2023-10-14T16:59:54.933795+0000","last_fullsized":"2023-10-14T16:59:54.933795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:46.761206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058565578,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1532","reported_seq":1549,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972294+0000","last_change":"2023-10-14T16:54:54.101946+0000","last_active":"2023-10-14T16:59:39.972294+0000","last_peered":"2023-10-14T16:59:39.972294+0000","last_clean":"2023-10-14T16:59:39.972294+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T16:59:39.972294+0000","last_undegraded":"2023-10-14T16:59:39.972294+0000","last_fullsized":"2023-10-14T16:59:39.972294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1532,"log_dups_size":0,"ondisk_log_size":1532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1524,"num_write_kb":13073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"23'653","reported_seq":720,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936652+0000","last_change":"2023-10-14T16:59:40.043067+0000","last_active":"2023-10-14T16:59:54.936652+0000","last_peered":"2023-10-14T16:59:54.936652+0000","last_clean":"2023-10-14T16:59:54.936652+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T16:59:54.936652+0000","last_undegraded":"2023-10-14T16:59:54.936652+0000","last_fullsized":"2023-10-14T16:59:54.936652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067459389999999994,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"22'755","reported_seq":772,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.480503+0000","last_change":"2023-10-14T16:54:54.096872+0000","last_active":"2023-10-14T16:59:40.480503+0000","last_peered":"2023-10-14T16:59:40.480503+0000","last_clean":"2023-10-14T16:59:40.480503+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T16:59:40.480503+0000","last_undegraded":"2023-10-14T16:59:40.480503+0000","last_fullsized":"2023-10-14T16:59:40.480503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'585","reported_seq":651,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937438+0000","last_change":"2023-10-14T16:59:40.047218+0000","last_active":"2023-10-14T16:59:54.937438+0000","last_peered":"2023-10-14T16:59:54.937438+0000","last_clean":"2023-10-14T16:59:54.937438+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T16:59:54.937438+0000","last_undegraded":"2023-10-14T16:59:54.937438+0000","last_fullsized":"2023-10-14T16:59:54.937438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070886901000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1506","reported_seq":1523,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.115969+0000","last_change":"2023-10-14T16:54:54.094974+0000","last_active":"2023-10-14T16:59:48.115969+0000","last_peered":"2023-10-14T16:59:48.115969+0000","last_clean":"2023-10-14T16:59:48.115969+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T16:59:48.115969+0000","last_undegraded":"2023-10-14T16:59:48.115969+0000","last_fullsized":"2023-10-14T16:59:48.115969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"23'593","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936070+0000","last_change":"2023-10-14T16:59:40.031610+0000","last_active":"2023-10-14T16:59:54.936070+0000","last_peered":"2023-10-14T16:59:54.936070+0000","last_clean":"2023-10-14T16:59:54.936070+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T16:59:54.936070+0000","last_undegraded":"2023-10-14T16:59:54.936070+0000","last_fullsized":"2023-10-14T16:59:54.936070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058803686000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"22'4","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.479890+0000","last_change":"2023-10-14T16:54:54.098193+0000","last_active":"2023-10-14T16:59:40.479890+0000","last_peered":"2023-10-14T16:59:40.479890+0000","last_clean":"2023-10-14T16:59:40.479890+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T16:59:40.479890+0000","last_undegraded":"2023-10-14T16:59:40.479890+0000","last_fullsized":"2023-10-14T16:59:40.479890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:33.333473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'583","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935086+0000","last_change":"2023-10-14T16:59:39.997256+0000","last_active":"2023-10-14T16:59:54.935086+0000","last_peered":"2023-10-14T16:59:54.935086+0000","last_clean":"2023-10-14T16:59:54.935086+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T16:59:54.935086+0000","last_undegraded":"2023-10-14T16:59:54.935086+0000","last_fullsized":"2023-10-14T16:59:54.935086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024750503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'756","reported_seq":773,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971815+0000","last_change":"2023-10-14T16:54:54.100620+0000","last_active":"2023-10-14T16:59:47.971815+0000","last_peered":"2023-10-14T16:59:47.971815+0000","last_clean":"2023-10-14T16:59:47.971815+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T16:59:47.971815+0000","last_undegraded":"2023-10-14T16:59:47.971815+0000","last_fullsized":"2023-10-14T16:59:47.971815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'570","reported_seq":636,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.927022+0000","last_change":"2023-10-14T16:59:40.043286+0000","last_active":"2023-10-14T16:59:54.927022+0000","last_peered":"2023-10-14T16:59:54.927022+0000","last_clean":"2023-10-14T16:59:54.927022+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T16:59:54.927022+0000","last_undegraded":"2023-10-14T16:59:54.927022+0000","last_fullsized":"2023-10-14T16:59:54.927022+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067572238000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"23'798","reported_seq":815,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.489258+0000","last_change":"2023-10-14T16:54:54.097908+0000","last_active":"2023-10-14T16:59:55.489258+0000","last_peered":"2023-10-14T16:59:55.489258+0000","last_clean":"2023-10-14T16:59:55.489258+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T16:59:55.489258+0000","last_undegraded":"2023-10-14T16:59:55.489258+0000","last_fullsized":"2023-10-14T16:59:55.489258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"23'414","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936113+0000","last_change":"2023-10-14T16:59:39.986224+0000","last_active":"2023-10-14T16:59:54.936113+0000","last_peered":"2023-10-14T16:59:54.936113+0000","last_clean":"2023-10-14T16:59:54.936113+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T16:59:54.936113+0000","last_undegraded":"2023-10-14T16:59:54.936113+0000","last_fullsized":"2023-10-14T16:59:54.936113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013962693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'2297","reported_seq":2314,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:52.483484+0000","last_change":"2023-10-14T16:54:54.098933+0000","last_active":"2023-10-14T16:59:52.483484+0000","last_peered":"2023-10-14T16:59:52.483484+0000","last_clean":"2023-10-14T16:59:52.483484+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T16:59:52.483484+0000","last_undegraded":"2023-10-14T16:59:52.483484+0000","last_fullsized":"2023-10-14T16:59:52.483484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2297,"log_dups_size":0,"ondisk_log_size":2297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:47.391039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2289,"num_write_kb":13405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"23'485","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.922514+0000","last_change":"2023-10-14T16:59:40.013142+0000","last_active":"2023-10-14T16:59:54.922514+0000","last_peered":"2023-10-14T16:59:54.922514+0000","last_clean":"2023-10-14T16:59:54.922514+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T16:59:54.922514+0000","last_undegraded":"2023-10-14T16:59:54.922514+0000","last_fullsized":"2023-10-14T16:59:54.922514+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038441039000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"21'1506","reported_seq":1523,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972386+0000","last_change":"2023-10-14T16:54:54.103486+0000","last_active":"2023-10-14T16:59:39.972386+0000","last_peered":"2023-10-14T16:59:39.972386+0000","last_clean":"2023-10-14T16:59:39.972386+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T16:59:39.972386+0000","last_undegraded":"2023-10-14T16:59:39.972386+0000","last_fullsized":"2023-10-14T16:59:39.972386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1498,"num_write_kb":8967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"23'532","reported_seq":598,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935883+0000","last_change":"2023-10-14T16:59:40.021641+0000","last_active":"2023-10-14T16:59:54.935883+0000","last_peered":"2023-10-14T16:59:54.935883+0000","last_clean":"2023-10-14T16:59:54.935883+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T16:59:54.935883+0000","last_undegraded":"2023-10-14T16:59:54.935883+0000","last_fullsized":"2023-10-14T16:59:54.935883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047574827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"22'3","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.480173+0000","last_change":"2023-10-14T16:54:54.098087+0000","last_active":"2023-10-14T16:59:40.480173+0000","last_peered":"2023-10-14T16:59:40.480173+0000","last_clean":"2023-10-14T16:59:40.480173+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T16:59:40.480173+0000","last_undegraded":"2023-10-14T16:59:40.480173+0000","last_fullsized":"2023-10-14T16:59:40.480173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:48.428626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'545","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933734+0000","last_change":"2023-10-14T16:59:40.032678+0000","last_active":"2023-10-14T16:59:54.933734+0000","last_peered":"2023-10-14T16:59:54.933734+0000","last_clean":"2023-10-14T16:59:54.933734+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T16:59:54.933734+0000","last_undegraded":"2023-10-14T16:59:54.933734+0000","last_fullsized":"2023-10-14T16:59:54.933734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:21:19.831648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057513697000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"22'5","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:46.477708+0000","last_change":"2023-10-14T16:54:54.099046+0000","last_active":"2023-10-14T16:59:46.477708+0000","last_peered":"2023-10-14T16:59:46.477708+0000","last_clean":"2023-10-14T16:59:46.477708+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T16:59:46.477708+0000","last_undegraded":"2023-10-14T16:59:46.477708+0000","last_fullsized":"2023-10-14T16:59:46.477708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:13.092692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"23'1019","reported_seq":1085,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.940665+0000","last_change":"2023-10-14T16:59:40.049106+0000","last_active":"2023-10-14T16:59:54.940665+0000","last_peered":"2023-10-14T16:59:54.940665+0000","last_clean":"2023-10-14T16:59:54.940665+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T16:59:54.940665+0000","last_undegraded":"2023-10-14T16:59:54.940665+0000","last_fullsized":"2023-10-14T16:59:54.940665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:06.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.07026193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'1511","reported_seq":1528,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.479573+0000","last_change":"2023-10-14T16:54:54.099281+0000","last_active":"2023-10-14T16:59:40.479573+0000","last_peered":"2023-10-14T16:59:40.479573+0000","last_clean":"2023-10-14T16:59:40.479573+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T16:59:40.479573+0000","last_undegraded":"2023-10-14T16:59:40.479573+0000","last_fullsized":"2023-10-14T16:59:40.479573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1511,"log_dups_size":0,"ondisk_log_size":1511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1507,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'585","reported_seq":651,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930146+0000","last_change":"2023-10-14T16:59:40.048352+0000","last_active":"2023-10-14T16:59:54.930146+0000","last_peered":"2023-10-14T16:59:54.930146+0000","last_clean":"2023-10-14T16:59:54.930146+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T16:59:54.930146+0000","last_undegraded":"2023-10-14T16:59:54.930146+0000","last_fullsized":"2023-10-14T16:59:54.930146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071266745000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"23'755","reported_seq":772,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971355+0000","last_change":"2023-10-14T16:54:54.100726+0000","last_active":"2023-10-14T16:59:47.971355+0000","last_peered":"2023-10-14T16:59:47.971355+0000","last_clean":"2023-10-14T16:59:47.971355+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T16:59:47.971355+0000","last_undegraded":"2023-10-14T16:59:47.971355+0000","last_fullsized":"2023-10-14T16:59:47.971355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"23'813","reported_seq":879,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921098+0000","last_change":"2023-10-14T16:59:40.032754+0000","last_active":"2023-10-14T16:59:54.921098+0000","last_peered":"2023-10-14T16:59:54.921098+0000","last_clean":"2023-10-14T16:59:54.921098+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T16:59:54.921098+0000","last_undegraded":"2023-10-14T16:59:54.921098+0000","last_fullsized":"2023-10-14T16:59:54.921098+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057360406000000003,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"22'756","reported_seq":773,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481912+0000","last_change":"2023-10-14T16:54:54.097646+0000","last_active":"2023-10-14T16:59:40.481912+0000","last_peered":"2023-10-14T16:59:40.481912+0000","last_clean":"2023-10-14T16:59:40.481912+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T16:59:40.481912+0000","last_undegraded":"2023-10-14T16:59:40.481912+0000","last_fullsized":"2023-10-14T16:59:40.481912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'593","reported_seq":658,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.932091+0000","last_change":"2023-10-14T16:59:40.012812+0000","last_active":"2023-10-14T16:59:54.932091+0000","last_peered":"2023-10-14T16:59:54.932091+0000","last_clean":"2023-10-14T16:59:54.932091+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T16:59:54.932091+0000","last_undegraded":"2023-10-14T16:59:54.932091+0000","last_fullsized":"2023-10-14T16:59:54.932091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039029367000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'755","reported_seq":772,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:42.475797+0000","last_change":"2023-10-14T16:54:54.100923+0000","last_active":"2023-10-14T16:59:42.475797+0000","last_peered":"2023-10-14T16:59:42.475797+0000","last_clean":"2023-10-14T16:59:42.475797+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T16:59:42.475797+0000","last_undegraded":"2023-10-14T16:59:42.475797+0000","last_fullsized":"2023-10-14T16:59:42.475797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'442","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921947+0000","last_change":"2023-10-14T16:59:40.009237+0000","last_active":"2023-10-14T16:59:54.921947+0000","last_peered":"2023-10-14T16:59:54.921947+0000","last_clean":"2023-10-14T16:59:54.921947+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T16:59:54.921947+0000","last_undegraded":"2023-10-14T16:59:54.921947+0000","last_fullsized":"2023-10-14T16:59:54.921947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036384234000000001,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"23'10","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971383+0000","last_change":"2023-10-14T16:54:54.099363+0000","last_active":"2023-10-14T16:59:47.971383+0000","last_peered":"2023-10-14T16:59:47.971383+0000","last_clean":"2023-10-14T16:59:47.971383+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T16:59:47.971383+0000","last_undegraded":"2023-10-14T16:59:47.971383+0000","last_fullsized":"2023-10-14T16:59:47.971383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.124832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"23'731","reported_seq":797,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937679+0000","last_change":"2023-10-14T16:59:40.046588+0000","last_active":"2023-10-14T16:59:54.937679+0000","last_peered":"2023-10-14T16:59:54.937679+0000","last_clean":"2023-10-14T16:59:54.937679+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T16:59:54.937679+0000","last_undegraded":"2023-10-14T16:59:54.937679+0000","last_fullsized":"2023-10-14T16:59:54.937679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070178661000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'1498","reported_seq":1515,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.487396+0000","last_change":"2023-10-14T16:54:54.093771+0000","last_active":"2023-10-14T16:59:55.487396+0000","last_peered":"2023-10-14T16:59:55.487396+0000","last_clean":"2023-10-14T16:59:55.487396+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T16:59:55.487396+0000","last_undegraded":"2023-10-14T16:59:55.487396+0000","last_fullsized":"2023-10-14T16:59:55.487396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1498,"log_dups_size":0,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":12977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"23'732","reported_seq":798,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939415+0000","last_change":"2023-10-14T16:59:40.007122+0000","last_active":"2023-10-14T16:59:54.939415+0000","last_peered":"2023-10-14T16:59:54.939415+0000","last_clean":"2023-10-14T16:59:54.939415+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T16:59:54.939415+0000","last_undegraded":"2023-10-14T16:59:54.939415+0000","last_fullsized":"2023-10-14T16:59:54.939415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034606716000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"22'3227","reported_seq":3244,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481438+0000","last_change":"2023-10-14T16:54:54.103401+0000","last_active":"2023-10-14T16:59:40.481438+0000","last_peered":"2023-10-14T16:59:40.481438+0000","last_clean":"2023-10-14T16:59:40.481438+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T16:59:40.481438+0000","last_undegraded":"2023-10-14T16:59:40.481438+0000","last_fullsized":"2023-10-14T16:59:40.481438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:28.931284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3218,"num_write_kb":10301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'567","reported_seq":632,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930805+0000","last_change":"2023-10-14T16:59:40.032481+0000","last_active":"2023-10-14T16:59:54.930805+0000","last_peered":"2023-10-14T16:59:54.930805+0000","last_clean":"2023-10-14T16:59:54.930805+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T16:59:54.930805+0000","last_undegraded":"2023-10-14T16:59:54.930805+0000","last_fullsized":"2023-10-14T16:59:54.930805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057531643,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"21'650","reported_seq":667,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974165+0000","last_change":"2023-10-14T16:54:54.099084+0000","last_active":"2023-10-14T16:59:39.974165+0000","last_peered":"2023-10-14T16:59:39.974165+0000","last_clean":"2023-10-14T16:59:39.974165+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T16:59:39.974165+0000","last_undegraded":"2023-10-14T16:59:39.974165+0000","last_fullsized":"2023-10-14T16:59:39.974165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:27.318420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'600","reported_seq":687,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.923665+0000","last_change":"2023-10-14T16:59:40.012352+0000","last_active":"2023-10-14T16:59:54.923665+0000","last_peered":"2023-10-14T16:59:54.923665+0000","last_clean":"2023-10-14T16:59:54.923665+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T16:59:54.923665+0000","last_undegraded":"2023-10-14T16:59:54.923665+0000","last_fullsized":"2023-10-14T16:59:54.923665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:12.562614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038477224999999997,"stat_sum":{"num_bytes":16395,"num_objects":10,"num_object_clones":4,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":32,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"23'757","reported_seq":774,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.115853+0000","last_change":"2023-10-14T16:54:54.095927+0000","last_active":"2023-10-14T16:59:48.115853+0000","last_peered":"2023-10-14T16:59:48.115853+0000","last_clean":"2023-10-14T16:59:48.115853+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T16:59:48.115853+0000","last_undegraded":"2023-10-14T16:59:48.115853+0000","last_fullsized":"2023-10-14T16:59:48.115853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'595","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930450+0000","last_change":"2023-10-14T16:59:40.048170+0000","last_active":"2023-10-14T16:59:54.930450+0000","last_peered":"2023-10-14T16:59:54.930450+0000","last_clean":"2023-10-14T16:59:54.930450+0000","last_became_active":"2023-10-14T16:55:45.058862+0000","last_became_peered":"2023-10-14T16:55:45.058862+0000","last_unstale":"2023-10-14T16:59:54.930450+0000","last_undegraded":"2023-10-14T16:59:54.930450+0000","last_fullsized":"2023-10-14T16:59:54.930450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:08.172437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071388894999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'771","reported_seq":788,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.117367+0000","last_change":"2023-10-14T16:54:54.092032+0000","last_active":"2023-10-14T16:59:48.117367+0000","last_peered":"2023-10-14T16:59:48.117367+0000","last_clean":"2023-10-14T16:59:48.117367+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T16:59:48.117367+0000","last_undegraded":"2023-10-14T16:59:48.117367+0000","last_fullsized":"2023-10-14T16:59:48.117367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973059+0000","last_change":"2023-10-14T16:54:49.689264+0000","last_active":"2023-10-14T16:59:39.973059+0000","last_peered":"2023-10-14T16:59:39.973059+0000","last_clean":"2023-10-14T16:59:39.973059+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T16:59:39.973059+0000","last_undegraded":"2023-10-14T16:59:39.973059+0000","last_fullsized":"2023-10-14T16:59:39.973059+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"23'518","reported_seq":584,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.918996+0000","last_change":"2023-10-14T16:59:40.037294+0000","last_active":"2023-10-14T16:59:54.918996+0000","last_peered":"2023-10-14T16:59:54.918996+0000","last_clean":"2023-10-14T16:59:54.918996+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T16:59:54.918996+0000","last_undegraded":"2023-10-14T16:59:54.918996+0000","last_fullsized":"2023-10-14T16:59:54.918996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061999158999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973570+0000","last_change":"2023-10-14T16:54:49.063336+0000","last_active":"2023-10-14T16:59:39.973570+0000","last_peered":"2023-10-14T16:59:39.973570+0000","last_clean":"2023-10-14T16:59:39.973570+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T16:59:39.973570+0000","last_undegraded":"2023-10-14T16:59:39.973570+0000","last_fullsized":"2023-10-14T16:59:39.973570+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"23'49","reported_seq":66,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.219902+0000","last_change":"2023-10-14T16:54:54.093189+0000","last_active":"2023-10-14T16:59:54.219902+0000","last_peered":"2023-10-14T16:59:54.219902+0000","last_clean":"2023-10-14T16:59:54.219902+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T16:59:54.219902+0000","last_undegraded":"2023-10-14T16:59:54.219902+0000","last_fullsized":"2023-10-14T16:59:54.219902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:47.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'517","reported_seq":583,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.922222+0000","last_change":"2023-10-14T16:59:40.011990+0000","last_active":"2023-10-14T16:59:54.922222+0000","last_peered":"2023-10-14T16:59:54.922222+0000","last_clean":"2023-10-14T16:59:54.922222+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T16:59:54.922222+0000","last_undegraded":"2023-10-14T16:59:54.922222+0000","last_fullsized":"2023-10-14T16:59:54.922222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:48.395824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038513458,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972353+0000","last_change":"2023-10-14T16:54:49.063688+0000","last_active":"2023-10-14T16:59:39.972353+0000","last_peered":"2023-10-14T16:59:39.972353+0000","last_clean":"2023-10-14T16:59:39.972353+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T16:59:39.972353+0000","last_undegraded":"2023-10-14T16:59:39.972353+0000","last_fullsized":"2023-10-14T16:59:39.972353+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:29.004325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974149+0000","last_change":"2023-10-14T16:54:49.063307+0000","last_active":"2023-10-14T16:59:39.974149+0000","last_peered":"2023-10-14T16:59:39.974149+0000","last_clean":"2023-10-14T16:59:39.974149+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T16:59:39.974149+0000","last_undegraded":"2023-10-14T16:59:39.974149+0000","last_fullsized":"2023-10-14T16:59:39.974149+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'76","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.483585+0000","last_change":"2023-10-14T16:54:54.098588+0000","last_active":"2023-10-14T16:59:55.483585+0000","last_peered":"2023-10-14T16:59:55.483585+0000","last_clean":"2023-10-14T16:59:55.483585+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T16:59:55.483585+0000","last_undegraded":"2023-10-14T16:59:55.483585+0000","last_fullsized":"2023-10-14T16:59:55.483585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:18.107600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":646501,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":64,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'754","reported_seq":821,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.940187+0000","last_change":"2023-10-14T16:59:40.048570+0000","last_active":"2023-10-14T16:59:54.940187+0000","last_peered":"2023-10-14T16:59:54.940187+0000","last_clean":"2023-10-14T16:59:54.940187+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T16:59:54.940187+0000","last_undegraded":"2023-10-14T16:59:54.940187+0000","last_fullsized":"2023-10-14T16:59:54.940187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069884818000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972495+0000","last_change":"2023-10-14T16:54:49.689356+0000","last_active":"2023-10-14T16:59:39.972495+0000","last_peered":"2023-10-14T16:59:39.972495+0000","last_clean":"2023-10-14T16:59:39.972495+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T16:59:39.972495+0000","last_undegraded":"2023-10-14T16:59:39.972495+0000","last_fullsized":"2023-10-14T16:59:39.972495+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'2235","reported_seq":2252,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972193+0000","last_change":"2023-10-14T16:54:54.093196+0000","last_active":"2023-10-14T16:59:39.972193+0000","last_peered":"2023-10-14T16:59:39.972193+0000","last_clean":"2023-10-14T16:59:39.972193+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T16:59:39.972193+0000","last_undegraded":"2023-10-14T16:59:39.972193+0000","last_fullsized":"2023-10-14T16:59:39.972193+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2235,"log_dups_size":0,"ondisk_log_size":2235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2227,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'634","reported_seq":700,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935223+0000","last_change":"2023-10-14T16:59:40.021827+0000","last_active":"2023-10-14T16:59:54.935223+0000","last_peered":"2023-10-14T16:59:54.935223+0000","last_clean":"2023-10-14T16:59:54.935223+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T16:59:54.935223+0000","last_undegraded":"2023-10-14T16:59:54.935223+0000","last_fullsized":"2023-10-14T16:59:54.935223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047771027000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974066+0000","last_change":"2023-10-14T16:54:49.689595+0000","last_active":"2023-10-14T16:59:39.974066+0000","last_peered":"2023-10-14T16:59:39.974066+0000","last_clean":"2023-10-14T16:59:39.974066+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T16:59:39.974066+0000","last_undegraded":"2023-10-14T16:59:39.974066+0000","last_fullsized":"2023-10-14T16:59:39.974066+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:46:44.177180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1503","reported_seq":1520,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972138+0000","last_change":"2023-10-14T16:54:54.099381+0000","last_active":"2023-10-14T16:59:39.972138+0000","last_peered":"2023-10-14T16:59:39.972138+0000","last_clean":"2023-10-14T16:59:39.972138+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T16:59:39.972138+0000","last_undegraded":"2023-10-14T16:59:39.972138+0000","last_fullsized":"2023-10-14T16:59:39.972138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"23'759","reported_seq":824,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.931088+0000","last_change":"2023-10-14T16:59:40.032574+0000","last_active":"2023-10-14T16:59:54.931088+0000","last_peered":"2023-10-14T16:59:54.931088+0000","last_clean":"2023-10-14T16:59:54.931088+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T16:59:54.931088+0000","last_undegraded":"2023-10-14T16:59:54.931088+0000","last_fullsized":"2023-10-14T16:59:54.931088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057422879000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974081+0000","last_change":"2023-10-14T16:54:49.689614+0000","last_active":"2023-10-14T16:59:39.974081+0000","last_peered":"2023-10-14T16:59:39.974081+0000","last_clean":"2023-10-14T16:59:39.974081+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T16:59:39.974081+0000","last_undegraded":"2023-10-14T16:59:39.974081+0000","last_fullsized":"2023-10-14T16:59:39.974081+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:09.272835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'741","reported_seq":758,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.483744+0000","last_change":"2023-10-14T16:54:54.100656+0000","last_active":"2023-10-14T16:59:54.483744+0000","last_peered":"2023-10-14T16:59:54.483744+0000","last_clean":"2023-10-14T16:59:54.483744+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T16:59:54.483744+0000","last_undegraded":"2023-10-14T16:59:54.483744+0000","last_fullsized":"2023-10-14T16:59:54.483744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'580","reported_seq":646,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938837+0000","last_change":"2023-10-14T16:59:40.021216+0000","last_active":"2023-10-14T16:59:54.938837+0000","last_peered":"2023-10-14T16:59:54.938837+0000","last_clean":"2023-10-14T16:59:54.938837+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T16:59:54.938837+0000","last_undegraded":"2023-10-14T16:59:54.938837+0000","last_fullsized":"2023-10-14T16:59:54.938837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047665379000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973447+0000","last_change":"2023-10-14T16:54:49.689836+0000","last_active":"2023-10-14T16:59:39.973447+0000","last_peered":"2023-10-14T16:59:39.973447+0000","last_clean":"2023-10-14T16:59:39.973447+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T16:59:39.973447+0000","last_undegraded":"2023-10-14T16:59:39.973447+0000","last_fullsized":"2023-10-14T16:59:39.973447+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:24.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"21'737","reported_seq":754,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973689+0000","last_change":"2023-10-14T16:54:54.096618+0000","last_active":"2023-10-14T16:59:39.973689+0000","last_peered":"2023-10-14T16:59:39.973689+0000","last_clean":"2023-10-14T16:59:39.973689+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T16:59:39.973689+0000","last_undegraded":"2023-10-14T16:59:39.973689+0000","last_fullsized":"2023-10-14T16:59:39.973689+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'697","reported_seq":763,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930425+0000","last_change":"2023-10-14T16:59:40.044773+0000","last_active":"2023-10-14T16:59:54.930425+0000","last_peered":"2023-10-14T16:59:54.930425+0000","last_clean":"2023-10-14T16:59:54.930425+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T16:59:54.930425+0000","last_undegraded":"2023-10-14T16:59:54.930425+0000","last_fullsized":"2023-10-14T16:59:54.930425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068678344000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972989+0000","last_change":"2023-10-14T16:54:49.064767+0000","last_active":"2023-10-14T16:59:39.972989+0000","last_peered":"2023-10-14T16:59:39.972989+0000","last_clean":"2023-10-14T16:59:39.972989+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T16:59:39.972989+0000","last_undegraded":"2023-10-14T16:59:39.972989+0000","last_fullsized":"2023-10-14T16:59:39.972989+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:34:26.616500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"21'1040","reported_seq":1057,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972984+0000","last_change":"2023-10-14T16:54:54.106280+0000","last_active":"2023-10-14T16:59:39.972984+0000","last_peered":"2023-10-14T16:59:39.972984+0000","last_clean":"2023-10-14T16:59:39.972984+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T16:59:39.972984+0000","last_undegraded":"2023-10-14T16:59:39.972984+0000","last_fullsized":"2023-10-14T16:59:39.972984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1040,"log_dups_size":0,"ondisk_log_size":1040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":8695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"23'754","reported_seq":820,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936228+0000","last_change":"2023-10-14T16:59:39.988269+0000","last_active":"2023-10-14T16:59:54.936228+0000","last_peered":"2023-10-14T16:59:54.936228+0000","last_clean":"2023-10-14T16:59:54.936228+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T16:59:54.936228+0000","last_undegraded":"2023-10-14T16:59:54.936228+0000","last_fullsized":"2023-10-14T16:59:54.936228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015859669999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'740","reported_seq":757,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481350+0000","last_change":"2023-10-14T16:54:54.102987+0000","last_active":"2023-10-14T16:59:40.481350+0000","last_peered":"2023-10-14T16:59:40.481350+0000","last_clean":"2023-10-14T16:59:40.481350+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T16:59:40.481350+0000","last_undegraded":"2023-10-14T16:59:40.481350+0000","last_fullsized":"2023-10-14T16:59:40.481350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'627","reported_seq":693,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.929135+0000","last_change":"2023-10-14T16:59:40.021896+0000","last_active":"2023-10-14T16:59:54.929135+0000","last_peered":"2023-10-14T16:59:54.929135+0000","last_clean":"2023-10-14T16:59:54.929135+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T16:59:54.929135+0000","last_undegraded":"2023-10-14T16:59:54.929135+0000","last_fullsized":"2023-10-14T16:59:54.929135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048042644000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"22'754","reported_seq":771,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.480495+0000","last_change":"2023-10-14T16:54:54.095975+0000","last_active":"2023-10-14T16:59:40.480495+0000","last_peered":"2023-10-14T16:59:40.480495+0000","last_clean":"2023-10-14T16:59:40.480495+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T16:59:40.480495+0000","last_undegraded":"2023-10-14T16:59:40.480495+0000","last_fullsized":"2023-10-14T16:59:40.480495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"23'834","reported_seq":900,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938606+0000","last_change":"2023-10-14T16:59:40.012979+0000","last_active":"2023-10-14T16:59:54.938606+0000","last_peered":"2023-10-14T16:59:54.938606+0000","last_clean":"2023-10-14T16:59:54.938606+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T16:59:54.938606+0000","last_undegraded":"2023-10-14T16:59:54.938606+0000","last_fullsized":"2023-10-14T16:59:54.938606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038542571999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2256","reported_seq":2273,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481355+0000","last_change":"2023-10-14T16:54:54.103049+0000","last_active":"2023-10-14T16:59:40.481355+0000","last_peered":"2023-10-14T16:59:40.481355+0000","last_clean":"2023-10-14T16:59:40.481355+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T16:59:40.481355+0000","last_undegraded":"2023-10-14T16:59:40.481355+0000","last_fullsized":"2023-10-14T16:59:40.481355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2256,"log_dups_size":0,"ondisk_log_size":2256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:17:46.369733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2245,"num_write_kb":13441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"23'673","reported_seq":739,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.924367+0000","last_change":"2023-10-14T16:59:40.011333+0000","last_active":"2023-10-14T16:59:54.924367+0000","last_peered":"2023-10-14T16:59:54.924367+0000","last_clean":"2023-10-14T16:59:54.924367+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T16:59:54.924367+0000","last_undegraded":"2023-10-14T16:59:54.924367+0000","last_fullsized":"2023-10-14T16:59:54.924367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038619158000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3072","reported_seq":3089,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.486482+0000","last_change":"2023-10-14T16:54:54.095418+0000","last_active":"2023-10-14T16:59:55.486482+0000","last_peered":"2023-10-14T16:59:55.486482+0000","last_clean":"2023-10-14T16:59:55.486482+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T16:59:55.486482+0000","last_undegraded":"2023-10-14T16:59:55.486482+0000","last_fullsized":"2023-10-14T16:59:55.486482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3072,"log_dups_size":0,"ondisk_log_size":3072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:42.952466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5333059,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3064,"num_write_kb":7239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"23'766","reported_seq":832,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934086+0000","last_change":"2023-10-14T16:59:40.044481+0000","last_active":"2023-10-14T16:59:54.934086+0000","last_peered":"2023-10-14T16:59:54.934086+0000","last_clean":"2023-10-14T16:59:54.934086+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T16:59:54.934086+0000","last_undegraded":"2023-10-14T16:59:54.934086+0000","last_fullsized":"2023-10-14T16:59:54.934086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068737623999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"21'784","reported_seq":801,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.976916+0000","last_change":"2023-10-14T16:54:54.098491+0000","last_active":"2023-10-14T16:59:39.976916+0000","last_peered":"2023-10-14T16:59:39.976916+0000","last_clean":"2023-10-14T16:59:39.976916+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T16:59:39.976916+0000","last_undegraded":"2023-10-14T16:59:39.976916+0000","last_fullsized":"2023-10-14T16:59:39.976916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389162,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'693","reported_seq":757,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934762+0000","last_change":"2023-10-14T16:59:39.998765+0000","last_active":"2023-10-14T16:59:54.934762+0000","last_peered":"2023-10-14T16:59:54.934762+0000","last_clean":"2023-10-14T16:59:54.934762+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T16:59:54.934762+0000","last_undegraded":"2023-10-14T16:59:54.934762+0000","last_fullsized":"2023-10-14T16:59:54.934762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026701018,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"23'669","reported_seq":734,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935703+0000","last_change":"2023-10-14T16:59:39.991721+0000","last_active":"2023-10-14T16:59:54.935703+0000","last_peered":"2023-10-14T16:59:54.935703+0000","last_clean":"2023-10-14T16:59:54.935703+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T16:59:54.935703+0000","last_undegraded":"2023-10-14T16:59:54.935703+0000","last_fullsized":"2023-10-14T16:59:54.935703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01972498,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"23'706","reported_seq":771,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935578+0000","last_change":"2023-10-14T16:59:39.984241+0000","last_active":"2023-10-14T16:59:54.935578+0000","last_peered":"2023-10-14T16:59:54.935578+0000","last_clean":"2023-10-14T16:59:54.935578+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T16:59:54.935578+0000","last_undegraded":"2023-10-14T16:59:54.935578+0000","last_fullsized":"2023-10-14T16:59:54.935578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012044934,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"23'775","reported_seq":840,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938669+0000","last_change":"2023-10-14T16:59:40.032026+0000","last_active":"2023-10-14T16:59:54.938669+0000","last_peered":"2023-10-14T16:59:54.938669+0000","last_clean":"2023-10-14T16:59:54.938669+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T16:59:54.938669+0000","last_undegraded":"2023-10-14T16:59:54.938669+0000","last_fullsized":"2023-10-14T16:59:54.938669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058085603999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"23'600","reported_seq":665,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937844+0000","last_change":"2023-10-14T16:59:40.046985+0000","last_active":"2023-10-14T16:59:54.937844+0000","last_peered":"2023-10-14T16:59:54.937844+0000","last_clean":"2023-10-14T16:59:54.937844+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T16:59:54.937844+0000","last_undegraded":"2023-10-14T16:59:54.937844+0000","last_fullsized":"2023-10-14T16:59:54.937844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070423702000000005,"stat_sum":{"num_bytes":8224,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"23'394","reported_seq":459,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938679+0000","last_change":"2023-10-14T16:59:40.023267+0000","last_active":"2023-10-14T16:59:54.938679+0000","last_peered":"2023-10-14T16:59:54.938679+0000","last_clean":"2023-10-14T16:59:54.938679+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T16:59:54.938679+0000","last_undegraded":"2023-10-14T16:59:54.938679+0000","last_fullsized":"2023-10-14T16:59:54.938679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048708460000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":30,"num_read_kb":20,"num_write":108,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41370,"ondisk_log_size":41370,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":190530350,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":33640,"num_write_kb":203671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381116416,"data_stored":381054111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33839,"ondisk_log_size":33839,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705730,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396524,"kb_used_data":86948,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93975316,"statfs":{"total":96636764160,"available":96230723584,"internally_reserved":0,"allocated":89034752,"data_stored":88829719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39000000000000001,"15min":0.41599999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.55100000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.372},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39900000000000002,"15min":0.42699999999999999},"min":{"1min":0.246,"5min":0.217,"15min":0.217},"max":{"1min":0.60399999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.40300000000000002}]},{"osd":1,"last update":"Sat Oct 14 16:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.437,"15min":0.46700000000000003},"min":{"1min":0.27700000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.64900000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.439},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.437,"15min":0.46700000000000003},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.66100000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Oct 14 16:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.315,"15min":0.34499999999999997},"min":{"1min":0.19800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.437,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.308,"5min":0.32000000000000001,"15min":0.34899999999999998},"min":{"1min":0.20399999999999999,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.45400000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.38400000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705730,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426360,"kb_used_data":116784,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93945480,"statfs":{"total":96636764160,"available":96200171520,"internally_reserved":0,"allocated":119586816,"data_stored":119357205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.46300000000000002,"15min":0.44900000000000001},"min":{"1min":0.22,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.57299999999999995,"5min":5.992,"15min":5.992},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.503,"15min":0.46200000000000002},"min":{"1min":0.218,"5min":0.215,"15min":0.215},"max":{"1min":0.59599999999999997,"5min":9.2620000000000005,"15min":9.2620000000000005},"last":0.56499999999999995}]},{"osd":1,"last update":"Sat Oct 14 16:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55800000000000005,"5min":6.266,"15min":6.266},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.54300000000000004,"15min":0.49299999999999999},"min":{"1min":0.25600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.61499999999999999,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":0.503}]},{"osd":3,"last update":"Sat Oct 14 16:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.317,"15min":0.31900000000000001},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.45900000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.316},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.38100000000000001,"15min":0.35799999999999998},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.503,"5min":6.3170000000000002,"15min":6.3170000000000002},"last":0.34699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705729,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397668,"kb_used_data":92188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":93974172,"statfs":{"total":96636764160,"available":96229552128,"internally_reserved":0,"allocated":94400512,"data_stored":94210119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.27200000000000002,"15min":0.29599999999999999},"min":{"1min":0.20799999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.318},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.50800000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.45700000000000002},"min":{"1min":0.24099999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56299999999999994,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.46500000000000002},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61399999999999999,"5min":0.629,"15min":0.629},"last":0.432}]},{"osd":3,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29299999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.63300000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.45100000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705730,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388312,"kb_used_data":78736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93983528,"statfs":{"total":96636764160,"available":96239132672,"internally_reserved":0,"allocated":80625664,"data_stored":80427560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.27400000000000002},"min":{"1min":0.21099999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.28699999999999998,"15min":0.29899999999999999},"min":{"1min":0.24099999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42599999999999999,"15min":0.45700000000000002},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42199999999999999,"15min":0.46100000000000002},"min":{"1min":0.28399999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63900000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.67100000000000004}]},{"osd":3,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.45300000000000001},"min":{"1min":0.29699999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.59699999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.48599999999999999},"min":{"1min":0.33500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94076928,"data_stored":94060658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":79691776,"data_stored":79691776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":119242752,"data_stored":119219969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88104960,"data_stored":88081708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":53391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":73798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T17:00:02.553 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T17:00:02.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.703+0000 7f5727558700 1 Processor -- start 2023-10-14T17:00:02.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.703+0000 7f5727558700 1 -- start start 2023-10-14T17:00:02.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5727558700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f57200a25c0 0x7f57200a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5727558700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f572013c1a0 0x7f572013e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5727558700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57200a2df0 con 0x7f57200a6940 2023-10-14T17:00:02.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5727558700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57201338f0 con 0x7f57200a25c0 2023-10-14T17:00:02.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5727558700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5720133ae0 con 0x7f572013c1a0 2023-10-14T17:00:02.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5724af3700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f57200a25c0 0x7f57200a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5724af3700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f57200a25c0 0x7f57200a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60128/0 (socket says 172.21.15.8:60128) 2023-10-14T17:00:02.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5724af3700 1 -- 172.21.15.8:0/3492936679 learned_addr learned my addr 172.21.15.8:0/3492936679 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:02.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5725af5700 1 --2- 172.21.15.8:0/3492936679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f572013c1a0 0x7f572013e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5724af3700 1 -- 172.21.15.8:0/3492936679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f572013c1a0 msgr2=0x7f572013e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:02.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5724af3700 1 --2- 172.21.15.8:0/3492936679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f572013c1a0 0x7f572013e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5724af3700 1 -- 172.21.15.8:0/3492936679 >> v1:172.21.15.155:6789/0 conn(0x7f57200a6940 legacy=0x7f5720133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5724af3700 1 -- 172.21.15.8:0/3492936679 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57200a1b90 con 0x7f57200a25c0 2023-10-14T17:00:02.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.704+0000 7f5724af3700 1 --2- 172.21.15.8:0/3492936679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57200a25c0 0x7f57200a1310 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7f57140099b0 tx=0x7f5714009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a20ec46e678c9d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:02.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.705+0000 7f571ffff700 1 -- 172.21.15.8:0/3492936679 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714009ea0 con 0x7f57200a25c0 2023-10-14T17:00:02.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.705+0000 7f571ffff700 1 -- 172.21.15.8:0/3492936679 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571400b860 con 0x7f57200a25c0 2023-10-14T17:00:02.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.705+0000 7f571ffff700 1 -- 172.21.15.8:0/3492936679 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571400bc00 con 0x7f57200a25c0 2023-10-14T17:00:02.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.705+0000 7f5727558700 1 -- 172.21.15.8:0/3492936679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57200a25c0 msgr2=0x7f57200a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.705+0000 7f5727558700 1 --2- 172.21.15.8:0/3492936679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57200a25c0 0x7f57200a1310 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7f57140099b0 tx=0x7f5714009250 comp rx=0 tx=0).stop 2023-10-14T17:00:02.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.705+0000 7f5727558700 1 -- 172.21.15.8:0/3492936679 shutdown_connections 2023-10-14T17:00:02.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.705+0000 7f5727558700 1 --2- 172.21.15.8:0/3492936679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f572013c1a0 0x7f572013e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.705+0000 7f5727558700 1 --2- 172.21.15.8:0/3492936679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57200a25c0 0x7f57200a1310 unknown :-1 s=CLOSED pgs=2459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.705+0000 7f5727558700 1 -- 172.21.15.8:0/3492936679 >> 172.21.15.8:0/3492936679 conn(0x7f572006acd0 msgr2=0x7f57200701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:02.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.705+0000 7f5727558700 1 -- 172.21.15.8:0/3492936679 shutdown_connections 2023-10-14T17:00:02.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.705+0000 7f5727558700 1 -- 172.21.15.8:0/3492936679 wait complete. 2023-10-14T17:00:02.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.706+0000 7f5727558700 1 Processor -- start 2023-10-14T17:00:02.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.706+0000 7f5727558700 1 -- start start 2023-10-14T17:00:02.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f5727558700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57200a25c0 0x7f57201395e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f5727558700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f572013c1a0 0x7f5720139b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f5727558700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5720095d20 0x7f572013a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f5727558700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200975a0 con 0x7f57200a25c0 2023-10-14T17:00:02.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f5727558700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5720096b80 con 0x7f572013c1a0 2023-10-14T17:00:02.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f5727558700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57200a0a90 con 0x7f5720095d20 2023-10-14T17:00:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f57252f4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57200a25c0 0x7f57201395e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f57252f4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57200a25c0 0x7f57201395e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60136/0 (socket says 172.21.15.8:60136) 2023-10-14T17:00:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f57252f4700 1 -- 172.21.15.8:0/1021833689 learned_addr learned my addr 172.21.15.8:0/1021833689 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:02.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f5724af3700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f572013c1a0 0x7f5720139b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f5725af5700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5720095d20 0x7f572013a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f57252f4700 1 -- 172.21.15.8:0/1021833689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5720095d20 msgr2=0x7f572013a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f57252f4700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5720095d20 0x7f572013a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f57252f4700 1 -- 172.21.15.8:0/1021833689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f572013c1a0 msgr2=0x7f5720139b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f57252f4700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f572013c1a0 0x7f5720139b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f57252f4700 1 -- 172.21.15.8:0/1021833689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57140094f0 con 0x7f57200a25c0 2023-10-14T17:00:02.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f57252f4700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57200a25c0 0x7f57201395e0 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7f571800c590 tx=0x7f571800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:02.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f571d7fa700 1 -- 172.21.15.8:0/1021833689 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718011590 con 0x7f57200a25c0 2023-10-14T17:00:02.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f571d7fa700 1 -- 172.21.15.8:0/1021833689 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5718011710 con 0x7f57200a25c0 2023-10-14T17:00:02.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f571d7fa700 1 -- 172.21.15.8:0/1021833689 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718011ad0 con 0x7f57200a25c0 2023-10-14T17:00:02.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f5727558700 1 -- 172.21.15.8:0/1021833689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57200972c0 con 0x7f57200a25c0 2023-10-14T17:00:02.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.707+0000 7f5727558700 1 -- 172.21.15.8:0/1021833689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572013b4d0 con 0x7f57200a25c0 2023-10-14T17:00:02.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.708+0000 7f5727558700 1 -- 172.21.15.8:0/1021833689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57200708d0 con 0x7f57200a25c0 2023-10-14T17:00:02.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.709+0000 7f571d7fa700 1 -- 172.21.15.8:0/1021833689 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f571801b3b0 con 0x7f57200a25c0 2023-10-14T17:00:02.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.709+0000 7f571d7fa700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f570c066f30 0x7f570c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:02.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.709+0000 7f571d7fa700 1 -- 172.21.15.8:0/1021833689 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f57180834c0 con 0x7f57200a25c0 2023-10-14T17:00:02.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.709+0000 7f5724af3700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f570c066f30 0x7f570c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:02.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.710+0000 7f5724af3700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f570c066f30 0x7f570c0693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f57140099b0 tx=0x7f5714017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:02.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.713+0000 7f571d7fa700 1 -- 172.21.15.8:0/1021833689 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5718050bb0 con 0x7f57200a25c0 2023-10-14T17:00:02.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.899+0000 7f5727558700 1 -- 172.21.15.8:0/1021833689 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5720095b90 con 0x7f570c066f30 2023-10-14T17:00:02.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.907+0000 7f571d7fa700 1 -- 172.21.15.8:0/1021833689 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278903 (secure 0 0 0) 0x7f5720095b90 con 0x7f570c066f30 2023-10-14T17:00:02.911 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:00:02.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.910+0000 7f5727558700 1 -- 172.21.15.8:0/1021833689 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f570c066f30 msgr2=0x7f570c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.910+0000 7f5727558700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f570c066f30 0x7f570c0693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f57140099b0 tx=0x7f5714017000 comp rx=0 tx=0).stop 2023-10-14T17:00:02.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.910+0000 7f5727558700 1 -- 172.21.15.8:0/1021833689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57200a25c0 msgr2=0x7f57201395e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:02.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.910+0000 7f5727558700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57200a25c0 0x7f57201395e0 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7f571800c590 tx=0x7f571800c8a0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.910+0000 7f5727558700 1 -- 172.21.15.8:0/1021833689 shutdown_connections 2023-10-14T17:00:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.910+0000 7f5727558700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f570c066f30 0x7f570c0693e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.910+0000 7f5727558700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5720095d20 0x7f572013a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.910+0000 7f5727558700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57200a25c0 0x7f57201395e0 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.910+0000 7f5727558700 1 --2- 172.21.15.8:0/1021833689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f572013c1a0 0x7f5720139b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:02.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.910+0000 7f5727558700 1 -- 172.21.15.8:0/1021833689 >> 172.21.15.8:0/1021833689 conn(0x7f572006acd0 msgr2=0x7f5720130860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:02.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.910+0000 7f5727558700 1 -- 172.21.15.8:0/1021833689 shutdown_connections 2023-10-14T17:00:02.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:02.910+0000 7f5727558700 1 -- 172.21.15.8:0/1021833689 wait complete. 2023-10-14T17:00:02.917 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T17:00:02.922 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2023-10-14T17:00:02.049811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":191247906,"num_objects":152,"num_object_clones":21,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":8,"num_read":210,"num_read_kb":798,"num_write":33907,"num_write_kb":206276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75326,"ondisk_log_size":75326,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1608864,"kb_used_data":374656,"kb_used_omap":0,"kb_used_meta":1234176,"kb_avail":375878496,"statfs":{"total":386547056640,"available":384899579904,"internally_reserved":0,"allocated":383647744,"data_stored":382824603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1263796224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":559526,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":3,"num_read":7,"num_read_kb":8,"num_write":110,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002923"},"pg_stats":[{"pgid":"4.3f","version":"23'645","reported_seq":711,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939505+0000","last_change":"2023-10-14T16:59:40.048771+0000","last_active":"2023-10-14T16:59:54.939505+0000","last_peered":"2023-10-14T16:59:54.939505+0000","last_clean":"2023-10-14T16:59:54.939505+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T16:59:54.939505+0000","last_undegraded":"2023-10-14T16:59:54.939505+0000","last_fullsized":"2023-10-14T16:59:54.939505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070427155000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"23'746","reported_seq":812,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938563+0000","last_change":"2023-10-14T16:59:40.012472+0000","last_active":"2023-10-14T16:59:54.938563+0000","last_peered":"2023-10-14T16:59:54.938563+0000","last_clean":"2023-10-14T16:59:54.938563+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T16:59:54.938563+0000","last_undegraded":"2023-10-14T16:59:54.938563+0000","last_fullsized":"2023-10-14T16:59:54.938563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038749005000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'628","reported_seq":694,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933861+0000","last_change":"2023-10-14T16:59:40.031831+0000","last_active":"2023-10-14T16:59:54.933861+0000","last_peered":"2023-10-14T16:59:54.933861+0000","last_clean":"2023-10-14T16:59:54.933861+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T16:59:54.933861+0000","last_undegraded":"2023-10-14T16:59:54.933861+0000","last_fullsized":"2023-10-14T16:59:54.933861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:56.343441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152503000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"23'646","reported_seq":712,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.923219+0000","last_change":"2023-10-14T16:59:40.006348+0000","last_active":"2023-10-14T16:59:54.923219+0000","last_peered":"2023-10-14T16:59:54.923219+0000","last_clean":"2023-10-14T16:59:54.923219+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T16:59:54.923219+0000","last_undegraded":"2023-10-14T16:59:54.923219+0000","last_fullsized":"2023-10-14T16:59:54.923219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:05.483417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033834213000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"23'521","reported_seq":587,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937750+0000","last_change":"2023-10-14T16:59:40.046517+0000","last_active":"2023-10-14T16:59:54.937750+0000","last_peered":"2023-10-14T16:59:54.937750+0000","last_clean":"2023-10-14T16:59:54.937750+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T16:59:54.937750+0000","last_undegraded":"2023-10-14T16:59:54.937750+0000","last_fullsized":"2023-10-14T16:59:54.937750+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070258685000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'532","reported_seq":598,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.918042+0000","last_change":"2023-10-14T16:59:40.032103+0000","last_active":"2023-10-14T16:59:54.918042+0000","last_peered":"2023-10-14T16:59:54.918042+0000","last_clean":"2023-10-14T16:59:54.918042+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T16:59:54.918042+0000","last_undegraded":"2023-10-14T16:59:54.918042+0000","last_fullsized":"2023-10-14T16:59:54.918042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:59.572769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058053194000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'962","reported_seq":1028,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921346+0000","last_change":"2023-10-14T16:59:40.032217+0000","last_active":"2023-10-14T16:59:54.921346+0000","last_peered":"2023-10-14T16:59:54.921346+0000","last_clean":"2023-10-14T16:59:54.921346+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T16:59:54.921346+0000","last_undegraded":"2023-10-14T16:59:54.921346+0000","last_fullsized":"2023-10-14T16:59:54.921346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:15:51.621106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058433710999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'666","reported_seq":732,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.919451+0000","last_change":"2023-10-14T16:59:40.032894+0000","last_active":"2023-10-14T16:59:54.919451+0000","last_peered":"2023-10-14T16:59:54.919451+0000","last_clean":"2023-10-14T16:59:54.919451+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T16:59:54.919451+0000","last_undegraded":"2023-10-14T16:59:54.919451+0000","last_fullsized":"2023-10-14T16:59:54.919451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:40.295415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057530364000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"23'726","reported_seq":792,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939207+0000","last_change":"2023-10-14T16:59:40.048548+0000","last_active":"2023-10-14T16:59:54.939207+0000","last_peered":"2023-10-14T16:59:54.939207+0000","last_clean":"2023-10-14T16:59:54.939207+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T16:59:54.939207+0000","last_undegraded":"2023-10-14T16:59:54.939207+0000","last_fullsized":"2023-10-14T16:59:54.939207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070350251000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'591","reported_seq":657,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933559+0000","last_change":"2023-10-14T16:59:40.030928+0000","last_active":"2023-10-14T16:59:54.933559+0000","last_peered":"2023-10-14T16:59:54.933559+0000","last_clean":"2023-10-14T16:59:54.933559+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T16:59:54.933559+0000","last_undegraded":"2023-10-14T16:59:54.933559+0000","last_fullsized":"2023-10-14T16:59:54.933559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:54:37.853332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057828565999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"23'504","reported_seq":569,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.920075+0000","last_change":"2023-10-14T16:59:40.011889+0000","last_active":"2023-10-14T16:59:54.920075+0000","last_peered":"2023-10-14T16:59:54.920075+0000","last_clean":"2023-10-14T16:59:54.920075+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T16:59:54.920075+0000","last_undegraded":"2023-10-14T16:59:54.920075+0000","last_fullsized":"2023-10-14T16:59:54.920075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:18:19.208533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039012109000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"23'510","reported_seq":576,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938970+0000","last_change":"2023-10-14T16:59:40.020882+0000","last_active":"2023-10-14T16:59:54.938970+0000","last_peered":"2023-10-14T16:59:54.938970+0000","last_clean":"2023-10-14T16:59:54.938970+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T16:59:54.938970+0000","last_undegraded":"2023-10-14T16:59:54.938970+0000","last_fullsized":"2023-10-14T16:59:54.938970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047436036000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"23'512","reported_seq":578,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930357+0000","last_change":"2023-10-14T16:59:40.046901+0000","last_active":"2023-10-14T16:59:54.930357+0000","last_peered":"2023-10-14T16:59:54.930357+0000","last_clean":"2023-10-14T16:59:54.930357+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T16:59:54.930357+0000","last_undegraded":"2023-10-14T16:59:54.930357+0000","last_fullsized":"2023-10-14T16:59:54.930357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:13.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070191972000000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"23'757","reported_seq":822,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938286+0000","last_change":"2023-10-14T16:59:40.009015+0000","last_active":"2023-10-14T16:59:54.938286+0000","last_peered":"2023-10-14T16:59:54.938286+0000","last_clean":"2023-10-14T16:59:54.938286+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T16:59:54.938286+0000","last_undegraded":"2023-10-14T16:59:54.938286+0000","last_fullsized":"2023-10-14T16:59:54.938286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036605058000000003,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"23'655","reported_seq":721,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.932286+0000","last_change":"2023-10-14T16:59:40.012646+0000","last_active":"2023-10-14T16:59:54.932286+0000","last_peered":"2023-10-14T16:59:54.932286+0000","last_clean":"2023-10-14T16:59:54.932286+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T16:59:54.932286+0000","last_undegraded":"2023-10-14T16:59:54.932286+0000","last_fullsized":"2023-10-14T16:59:54.932286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038947427,"stat_sum":{"num_bytes":4105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"23'745","reported_seq":810,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933504+0000","last_change":"2023-10-14T16:59:40.032292+0000","last_active":"2023-10-14T16:59:54.933504+0000","last_peered":"2023-10-14T16:59:54.933504+0000","last_clean":"2023-10-14T16:59:54.933504+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T16:59:54.933504+0000","last_undegraded":"2023-10-14T16:59:54.933504+0000","last_fullsized":"2023-10-14T16:59:54.933504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:41:12.510526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058345898,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'595","reported_seq":661,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939581+0000","last_change":"2023-10-14T16:59:40.048812+0000","last_active":"2023-10-14T16:59:54.939581+0000","last_peered":"2023-10-14T16:59:54.939581+0000","last_clean":"2023-10-14T16:59:54.939581+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T16:59:54.939581+0000","last_undegraded":"2023-10-14T16:59:54.939581+0000","last_fullsized":"2023-10-14T16:59:54.939581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071573409000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'693","reported_seq":759,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.932562+0000","last_change":"2023-10-14T16:59:40.030743+0000","last_active":"2023-10-14T16:59:54.932562+0000","last_peered":"2023-10-14T16:59:54.932562+0000","last_clean":"2023-10-14T16:59:54.932562+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T16:59:54.932562+0000","last_undegraded":"2023-10-14T16:59:54.932562+0000","last_fullsized":"2023-10-14T16:59:54.932562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057407435999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"23'572","reported_seq":639,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.929581+0000","last_change":"2023-10-14T16:59:40.045847+0000","last_active":"2023-10-14T16:59:54.929581+0000","last_peered":"2023-10-14T16:59:54.929581+0000","last_clean":"2023-10-14T16:59:54.929581+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T16:59:54.929581+0000","last_undegraded":"2023-10-14T16:59:54.929581+0000","last_fullsized":"2023-10-14T16:59:54.929581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070060102999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"23'761","reported_seq":827,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939075+0000","last_change":"2023-10-14T16:59:40.029354+0000","last_active":"2023-10-14T16:59:54.939075+0000","last_peered":"2023-10-14T16:59:54.939075+0000","last_clean":"2023-10-14T16:59:54.939075+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T16:59:54.939075+0000","last_undegraded":"2023-10-14T16:59:54.939075+0000","last_fullsized":"2023-10-14T16:59:54.939075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056633790000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"23'810","reported_seq":876,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938705+0000","last_change":"2023-10-14T16:59:40.012817+0000","last_active":"2023-10-14T16:59:54.938705+0000","last_peered":"2023-10-14T16:59:54.938705+0000","last_clean":"2023-10-14T16:59:54.938705+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T16:59:54.938705+0000","last_undegraded":"2023-10-14T16:59:54.938705+0000","last_fullsized":"2023-10-14T16:59:54.938705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038418550000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"23'694","reported_seq":760,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938748+0000","last_change":"2023-10-14T16:59:40.041012+0000","last_active":"2023-10-14T16:59:54.938748+0000","last_peered":"2023-10-14T16:59:54.938748+0000","last_clean":"2023-10-14T16:59:54.938748+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T16:59:54.938748+0000","last_undegraded":"2023-10-14T16:59:54.938748+0000","last_fullsized":"2023-10-14T16:59:54.938748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.065688290999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'638","reported_seq":704,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935953+0000","last_change":"2023-10-14T16:59:39.983318+0000","last_active":"2023-10-14T16:59:54.935953+0000","last_peered":"2023-10-14T16:59:54.935953+0000","last_clean":"2023-10-14T16:59:54.935953+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T16:59:54.935953+0000","last_undegraded":"2023-10-14T16:59:54.935953+0000","last_fullsized":"2023-10-14T16:59:54.935953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011260075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"23'846","reported_seq":912,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934718+0000","last_change":"2023-10-14T16:59:40.031942+0000","last_active":"2023-10-14T16:59:54.934718+0000","last_peered":"2023-10-14T16:59:54.934718+0000","last_clean":"2023-10-14T16:59:54.934718+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T16:59:54.934718+0000","last_undegraded":"2023-10-14T16:59:54.934718+0000","last_fullsized":"2023-10-14T16:59:54.934718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"23'636","reported_seq":702,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938462+0000","last_change":"2023-10-14T16:59:40.023150+0000","last_active":"2023-10-14T16:59:54.938462+0000","last_peered":"2023-10-14T16:59:54.938462+0000","last_clean":"2023-10-14T16:59:54.938462+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T16:59:54.938462+0000","last_undegraded":"2023-10-14T16:59:54.938462+0000","last_fullsized":"2023-10-14T16:59:54.938462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048983802,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'679","reported_seq":745,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935906+0000","last_change":"2023-10-14T16:59:40.021577+0000","last_active":"2023-10-14T16:59:54.935906+0000","last_peered":"2023-10-14T16:59:54.935906+0000","last_clean":"2023-10-14T16:59:54.935906+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T16:59:54.935906+0000","last_undegraded":"2023-10-14T16:59:54.935906+0000","last_fullsized":"2023-10-14T16:59:54.935906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047799974000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'513","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933795+0000","last_change":"2023-10-14T16:59:40.032393+0000","last_active":"2023-10-14T16:59:54.933795+0000","last_peered":"2023-10-14T16:59:54.933795+0000","last_clean":"2023-10-14T16:59:54.933795+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T16:59:54.933795+0000","last_undegraded":"2023-10-14T16:59:54.933795+0000","last_fullsized":"2023-10-14T16:59:54.933795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:46.761206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058565578,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1532","reported_seq":1549,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972294+0000","last_change":"2023-10-14T16:54:54.101946+0000","last_active":"2023-10-14T16:59:39.972294+0000","last_peered":"2023-10-14T16:59:39.972294+0000","last_clean":"2023-10-14T16:59:39.972294+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T16:59:39.972294+0000","last_undegraded":"2023-10-14T16:59:39.972294+0000","last_fullsized":"2023-10-14T16:59:39.972294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1532,"log_dups_size":0,"ondisk_log_size":1532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1524,"num_write_kb":13073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"23'653","reported_seq":720,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936652+0000","last_change":"2023-10-14T16:59:40.043067+0000","last_active":"2023-10-14T16:59:54.936652+0000","last_peered":"2023-10-14T16:59:54.936652+0000","last_clean":"2023-10-14T16:59:54.936652+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T16:59:54.936652+0000","last_undegraded":"2023-10-14T16:59:54.936652+0000","last_fullsized":"2023-10-14T16:59:54.936652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067459389999999994,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"22'755","reported_seq":772,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.480503+0000","last_change":"2023-10-14T16:54:54.096872+0000","last_active":"2023-10-14T16:59:40.480503+0000","last_peered":"2023-10-14T16:59:40.480503+0000","last_clean":"2023-10-14T16:59:40.480503+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T16:59:40.480503+0000","last_undegraded":"2023-10-14T16:59:40.480503+0000","last_fullsized":"2023-10-14T16:59:40.480503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'585","reported_seq":651,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937438+0000","last_change":"2023-10-14T16:59:40.047218+0000","last_active":"2023-10-14T16:59:54.937438+0000","last_peered":"2023-10-14T16:59:54.937438+0000","last_clean":"2023-10-14T16:59:54.937438+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T16:59:54.937438+0000","last_undegraded":"2023-10-14T16:59:54.937438+0000","last_fullsized":"2023-10-14T16:59:54.937438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070886901000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1506","reported_seq":1523,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.115969+0000","last_change":"2023-10-14T16:54:54.094974+0000","last_active":"2023-10-14T16:59:48.115969+0000","last_peered":"2023-10-14T16:59:48.115969+0000","last_clean":"2023-10-14T16:59:48.115969+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T16:59:48.115969+0000","last_undegraded":"2023-10-14T16:59:48.115969+0000","last_fullsized":"2023-10-14T16:59:48.115969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"23'593","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936070+0000","last_change":"2023-10-14T16:59:40.031610+0000","last_active":"2023-10-14T16:59:54.936070+0000","last_peered":"2023-10-14T16:59:54.936070+0000","last_clean":"2023-10-14T16:59:54.936070+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T16:59:54.936070+0000","last_undegraded":"2023-10-14T16:59:54.936070+0000","last_fullsized":"2023-10-14T16:59:54.936070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058803686000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"22'4","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.479890+0000","last_change":"2023-10-14T16:54:54.098193+0000","last_active":"2023-10-14T16:59:40.479890+0000","last_peered":"2023-10-14T16:59:40.479890+0000","last_clean":"2023-10-14T16:59:40.479890+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T16:59:40.479890+0000","last_undegraded":"2023-10-14T16:59:40.479890+0000","last_fullsized":"2023-10-14T16:59:40.479890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:33.333473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'583","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935086+0000","last_change":"2023-10-14T16:59:39.997256+0000","last_active":"2023-10-14T16:59:54.935086+0000","last_peered":"2023-10-14T16:59:54.935086+0000","last_clean":"2023-10-14T16:59:54.935086+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T16:59:54.935086+0000","last_undegraded":"2023-10-14T16:59:54.935086+0000","last_fullsized":"2023-10-14T16:59:54.935086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024750503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'756","reported_seq":773,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971815+0000","last_change":"2023-10-14T16:54:54.100620+0000","last_active":"2023-10-14T16:59:47.971815+0000","last_peered":"2023-10-14T16:59:47.971815+0000","last_clean":"2023-10-14T16:59:47.971815+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T16:59:47.971815+0000","last_undegraded":"2023-10-14T16:59:47.971815+0000","last_fullsized":"2023-10-14T16:59:47.971815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'570","reported_seq":636,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.927022+0000","last_change":"2023-10-14T16:59:40.043286+0000","last_active":"2023-10-14T16:59:54.927022+0000","last_peered":"2023-10-14T16:59:54.927022+0000","last_clean":"2023-10-14T16:59:54.927022+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T16:59:54.927022+0000","last_undegraded":"2023-10-14T16:59:54.927022+0000","last_fullsized":"2023-10-14T16:59:54.927022+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067572238000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"23'798","reported_seq":815,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.489258+0000","last_change":"2023-10-14T16:54:54.097908+0000","last_active":"2023-10-14T16:59:55.489258+0000","last_peered":"2023-10-14T16:59:55.489258+0000","last_clean":"2023-10-14T16:59:55.489258+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T16:59:55.489258+0000","last_undegraded":"2023-10-14T16:59:55.489258+0000","last_fullsized":"2023-10-14T16:59:55.489258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"23'414","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936113+0000","last_change":"2023-10-14T16:59:39.986224+0000","last_active":"2023-10-14T16:59:54.936113+0000","last_peered":"2023-10-14T16:59:54.936113+0000","last_clean":"2023-10-14T16:59:54.936113+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T16:59:54.936113+0000","last_undegraded":"2023-10-14T16:59:54.936113+0000","last_fullsized":"2023-10-14T16:59:54.936113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013962693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'2297","reported_seq":2314,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:52.483484+0000","last_change":"2023-10-14T16:54:54.098933+0000","last_active":"2023-10-14T16:59:52.483484+0000","last_peered":"2023-10-14T16:59:52.483484+0000","last_clean":"2023-10-14T16:59:52.483484+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T16:59:52.483484+0000","last_undegraded":"2023-10-14T16:59:52.483484+0000","last_fullsized":"2023-10-14T16:59:52.483484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2297,"log_dups_size":0,"ondisk_log_size":2297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:47.391039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2289,"num_write_kb":13405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"23'485","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.922514+0000","last_change":"2023-10-14T16:59:40.013142+0000","last_active":"2023-10-14T16:59:54.922514+0000","last_peered":"2023-10-14T16:59:54.922514+0000","last_clean":"2023-10-14T16:59:54.922514+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T16:59:54.922514+0000","last_undegraded":"2023-10-14T16:59:54.922514+0000","last_fullsized":"2023-10-14T16:59:54.922514+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038441039000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"21'1506","reported_seq":1523,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972386+0000","last_change":"2023-10-14T16:54:54.103486+0000","last_active":"2023-10-14T16:59:39.972386+0000","last_peered":"2023-10-14T16:59:39.972386+0000","last_clean":"2023-10-14T16:59:39.972386+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T16:59:39.972386+0000","last_undegraded":"2023-10-14T16:59:39.972386+0000","last_fullsized":"2023-10-14T16:59:39.972386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1498,"num_write_kb":8967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"23'532","reported_seq":598,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935883+0000","last_change":"2023-10-14T16:59:40.021641+0000","last_active":"2023-10-14T16:59:54.935883+0000","last_peered":"2023-10-14T16:59:54.935883+0000","last_clean":"2023-10-14T16:59:54.935883+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T16:59:54.935883+0000","last_undegraded":"2023-10-14T16:59:54.935883+0000","last_fullsized":"2023-10-14T16:59:54.935883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047574827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"22'3","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.480173+0000","last_change":"2023-10-14T16:54:54.098087+0000","last_active":"2023-10-14T16:59:40.480173+0000","last_peered":"2023-10-14T16:59:40.480173+0000","last_clean":"2023-10-14T16:59:40.480173+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T16:59:40.480173+0000","last_undegraded":"2023-10-14T16:59:40.480173+0000","last_fullsized":"2023-10-14T16:59:40.480173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:48.428626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'545","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933734+0000","last_change":"2023-10-14T16:59:40.032678+0000","last_active":"2023-10-14T16:59:54.933734+0000","last_peered":"2023-10-14T16:59:54.933734+0000","last_clean":"2023-10-14T16:59:54.933734+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T16:59:54.933734+0000","last_undegraded":"2023-10-14T16:59:54.933734+0000","last_fullsized":"2023-10-14T16:59:54.933734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:21:19.831648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057513697000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"22'5","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:46.477708+0000","last_change":"2023-10-14T16:54:54.099046+0000","last_active":"2023-10-14T16:59:46.477708+0000","last_peered":"2023-10-14T16:59:46.477708+0000","last_clean":"2023-10-14T16:59:46.477708+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T16:59:46.477708+0000","last_undegraded":"2023-10-14T16:59:46.477708+0000","last_fullsized":"2023-10-14T16:59:46.477708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:13.092692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"23'1019","reported_seq":1085,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.940665+0000","last_change":"2023-10-14T16:59:40.049106+0000","last_active":"2023-10-14T16:59:54.940665+0000","last_peered":"2023-10-14T16:59:54.940665+0000","last_clean":"2023-10-14T16:59:54.940665+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T16:59:54.940665+0000","last_undegraded":"2023-10-14T16:59:54.940665+0000","last_fullsized":"2023-10-14T16:59:54.940665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:06.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.07026193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'1511","reported_seq":1528,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.479573+0000","last_change":"2023-10-14T16:54:54.099281+0000","last_active":"2023-10-14T16:59:40.479573+0000","last_peered":"2023-10-14T16:59:40.479573+0000","last_clean":"2023-10-14T16:59:40.479573+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T16:59:40.479573+0000","last_undegraded":"2023-10-14T16:59:40.479573+0000","last_fullsized":"2023-10-14T16:59:40.479573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1511,"log_dups_size":0,"ondisk_log_size":1511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1507,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'585","reported_seq":651,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930146+0000","last_change":"2023-10-14T16:59:40.048352+0000","last_active":"2023-10-14T16:59:54.930146+0000","last_peered":"2023-10-14T16:59:54.930146+0000","last_clean":"2023-10-14T16:59:54.930146+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T16:59:54.930146+0000","last_undegraded":"2023-10-14T16:59:54.930146+0000","last_fullsized":"2023-10-14T16:59:54.930146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071266745000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"23'755","reported_seq":772,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971355+0000","last_change":"2023-10-14T16:54:54.100726+0000","last_active":"2023-10-14T16:59:47.971355+0000","last_peered":"2023-10-14T16:59:47.971355+0000","last_clean":"2023-10-14T16:59:47.971355+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T16:59:47.971355+0000","last_undegraded":"2023-10-14T16:59:47.971355+0000","last_fullsized":"2023-10-14T16:59:47.971355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"23'813","reported_seq":879,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921098+0000","last_change":"2023-10-14T16:59:40.032754+0000","last_active":"2023-10-14T16:59:54.921098+0000","last_peered":"2023-10-14T16:59:54.921098+0000","last_clean":"2023-10-14T16:59:54.921098+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T16:59:54.921098+0000","last_undegraded":"2023-10-14T16:59:54.921098+0000","last_fullsized":"2023-10-14T16:59:54.921098+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057360406000000003,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"22'756","reported_seq":773,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481912+0000","last_change":"2023-10-14T16:54:54.097646+0000","last_active":"2023-10-14T16:59:40.481912+0000","last_peered":"2023-10-14T16:59:40.481912+0000","last_clean":"2023-10-14T16:59:40.481912+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T16:59:40.481912+0000","last_undegraded":"2023-10-14T16:59:40.481912+0000","last_fullsized":"2023-10-14T16:59:40.481912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'593","reported_seq":658,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.932091+0000","last_change":"2023-10-14T16:59:40.012812+0000","last_active":"2023-10-14T16:59:54.932091+0000","last_peered":"2023-10-14T16:59:54.932091+0000","last_clean":"2023-10-14T16:59:54.932091+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T16:59:54.932091+0000","last_undegraded":"2023-10-14T16:59:54.932091+0000","last_fullsized":"2023-10-14T16:59:54.932091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039029367000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'755","reported_seq":772,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:42.475797+0000","last_change":"2023-10-14T16:54:54.100923+0000","last_active":"2023-10-14T16:59:42.475797+0000","last_peered":"2023-10-14T16:59:42.475797+0000","last_clean":"2023-10-14T16:59:42.475797+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T16:59:42.475797+0000","last_undegraded":"2023-10-14T16:59:42.475797+0000","last_fullsized":"2023-10-14T16:59:42.475797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'442","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921947+0000","last_change":"2023-10-14T16:59:40.009237+0000","last_active":"2023-10-14T16:59:54.921947+0000","last_peered":"2023-10-14T16:59:54.921947+0000","last_clean":"2023-10-14T16:59:54.921947+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T16:59:54.921947+0000","last_undegraded":"2023-10-14T16:59:54.921947+0000","last_fullsized":"2023-10-14T16:59:54.921947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036384234000000001,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"23'10","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971383+0000","last_change":"2023-10-14T16:54:54.099363+0000","last_active":"2023-10-14T16:59:47.971383+0000","last_peered":"2023-10-14T16:59:47.971383+0000","last_clean":"2023-10-14T16:59:47.971383+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T16:59:47.971383+0000","last_undegraded":"2023-10-14T16:59:47.971383+0000","last_fullsized":"2023-10-14T16:59:47.971383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.124832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"23'731","reported_seq":797,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937679+0000","last_change":"2023-10-14T16:59:40.046588+0000","last_active":"2023-10-14T16:59:54.937679+0000","last_peered":"2023-10-14T16:59:54.937679+0000","last_clean":"2023-10-14T16:59:54.937679+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T16:59:54.937679+0000","last_undegraded":"2023-10-14T16:59:54.937679+0000","last_fullsized":"2023-10-14T16:59:54.937679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070178661000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'1498","reported_seq":1515,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.487396+0000","last_change":"2023-10-14T16:54:54.093771+0000","last_active":"2023-10-14T16:59:55.487396+0000","last_peered":"2023-10-14T16:59:55.487396+0000","last_clean":"2023-10-14T16:59:55.487396+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T16:59:55.487396+0000","last_undegraded":"2023-10-14T16:59:55.487396+0000","last_fullsized":"2023-10-14T16:59:55.487396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1498,"log_dups_size":0,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":12977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"23'732","reported_seq":798,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939415+0000","last_change":"2023-10-14T16:59:40.007122+0000","last_active":"2023-10-14T16:59:54.939415+0000","last_peered":"2023-10-14T16:59:54.939415+0000","last_clean":"2023-10-14T16:59:54.939415+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T16:59:54.939415+0000","last_undegraded":"2023-10-14T16:59:54.939415+0000","last_fullsized":"2023-10-14T16:59:54.939415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034606716000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"22'3227","reported_seq":3244,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481438+0000","last_change":"2023-10-14T16:54:54.103401+0000","last_active":"2023-10-14T16:59:40.481438+0000","last_peered":"2023-10-14T16:59:40.481438+0000","last_clean":"2023-10-14T16:59:40.481438+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T16:59:40.481438+0000","last_undegraded":"2023-10-14T16:59:40.481438+0000","last_fullsized":"2023-10-14T16:59:40.481438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:28.931284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3218,"num_write_kb":10301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'567","reported_seq":632,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930805+0000","last_change":"2023-10-14T16:59:40.032481+0000","last_active":"2023-10-14T16:59:54.930805+0000","last_peered":"2023-10-14T16:59:54.930805+0000","last_clean":"2023-10-14T16:59:54.930805+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T16:59:54.930805+0000","last_undegraded":"2023-10-14T16:59:54.930805+0000","last_fullsized":"2023-10-14T16:59:54.930805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057531643,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"21'650","reported_seq":667,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974165+0000","last_change":"2023-10-14T16:54:54.099084+0000","last_active":"2023-10-14T16:59:39.974165+0000","last_peered":"2023-10-14T16:59:39.974165+0000","last_clean":"2023-10-14T16:59:39.974165+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T16:59:39.974165+0000","last_undegraded":"2023-10-14T16:59:39.974165+0000","last_fullsized":"2023-10-14T16:59:39.974165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:27.318420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'600","reported_seq":687,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.923665+0000","last_change":"2023-10-14T16:59:40.012352+0000","last_active":"2023-10-14T16:59:54.923665+0000","last_peered":"2023-10-14T16:59:54.923665+0000","last_clean":"2023-10-14T16:59:54.923665+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T16:59:54.923665+0000","last_undegraded":"2023-10-14T16:59:54.923665+0000","last_fullsized":"2023-10-14T16:59:54.923665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:12.562614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038477224999999997,"stat_sum":{"num_bytes":16395,"num_objects":10,"num_object_clones":4,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":32,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"23'757","reported_seq":774,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.115853+0000","last_change":"2023-10-14T16:54:54.095927+0000","last_active":"2023-10-14T16:59:48.115853+0000","last_peered":"2023-10-14T16:59:48.115853+0000","last_clean":"2023-10-14T16:59:48.115853+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T16:59:48.115853+0000","last_undegraded":"2023-10-14T16:59:48.115853+0000","last_fullsized":"2023-10-14T16:59:48.115853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'595","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930450+0000","last_change":"2023-10-14T16:59:40.048170+0000","last_active":"2023-10-14T16:59:54.930450+0000","last_peered":"2023-10-14T16:59:54.930450+0000","last_clean":"2023-10-14T16:59:54.930450+0000","last_became_active":"2023-10-14T16:55:45.058862+0000","last_became_peered":"2023-10-14T16:55:45.058862+0000","last_unstale":"2023-10-14T16:59:54.930450+0000","last_undegraded":"2023-10-14T16:59:54.930450+0000","last_fullsized":"2023-10-14T16:59:54.930450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:08.172437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071388894999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'771","reported_seq":788,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.117367+0000","last_change":"2023-10-14T16:54:54.092032+0000","last_active":"2023-10-14T16:59:48.117367+0000","last_peered":"2023-10-14T16:59:48.117367+0000","last_clean":"2023-10-14T16:59:48.117367+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T16:59:48.117367+0000","last_undegraded":"2023-10-14T16:59:48.117367+0000","last_fullsized":"2023-10-14T16:59:48.117367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973059+0000","last_change":"2023-10-14T16:54:49.689264+0000","last_active":"2023-10-14T16:59:39.973059+0000","last_peered":"2023-10-14T16:59:39.973059+0000","last_clean":"2023-10-14T16:59:39.973059+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T16:59:39.973059+0000","last_undegraded":"2023-10-14T16:59:39.973059+0000","last_fullsized":"2023-10-14T16:59:39.973059+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"23'518","reported_seq":584,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.918996+0000","last_change":"2023-10-14T16:59:40.037294+0000","last_active":"2023-10-14T16:59:54.918996+0000","last_peered":"2023-10-14T16:59:54.918996+0000","last_clean":"2023-10-14T16:59:54.918996+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T16:59:54.918996+0000","last_undegraded":"2023-10-14T16:59:54.918996+0000","last_fullsized":"2023-10-14T16:59:54.918996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061999158999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973570+0000","last_change":"2023-10-14T16:54:49.063336+0000","last_active":"2023-10-14T16:59:39.973570+0000","last_peered":"2023-10-14T16:59:39.973570+0000","last_clean":"2023-10-14T16:59:39.973570+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T16:59:39.973570+0000","last_undegraded":"2023-10-14T16:59:39.973570+0000","last_fullsized":"2023-10-14T16:59:39.973570+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"23'49","reported_seq":66,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.219902+0000","last_change":"2023-10-14T16:54:54.093189+0000","last_active":"2023-10-14T16:59:54.219902+0000","last_peered":"2023-10-14T16:59:54.219902+0000","last_clean":"2023-10-14T16:59:54.219902+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T16:59:54.219902+0000","last_undegraded":"2023-10-14T16:59:54.219902+0000","last_fullsized":"2023-10-14T16:59:54.219902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:47.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'517","reported_seq":583,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.922222+0000","last_change":"2023-10-14T16:59:40.011990+0000","last_active":"2023-10-14T16:59:54.922222+0000","last_peered":"2023-10-14T16:59:54.922222+0000","last_clean":"2023-10-14T16:59:54.922222+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T16:59:54.922222+0000","last_undegraded":"2023-10-14T16:59:54.922222+0000","last_fullsized":"2023-10-14T16:59:54.922222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:48.395824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038513458,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972353+0000","last_change":"2023-10-14T16:54:49.063688+0000","last_active":"2023-10-14T16:59:39.972353+0000","last_peered":"2023-10-14T16:59:39.972353+0000","last_clean":"2023-10-14T16:59:39.972353+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T16:59:39.972353+0000","last_undegraded":"2023-10-14T16:59:39.972353+0000","last_fullsized":"2023-10-14T16:59:39.972353+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:29.004325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974149+0000","last_change":"2023-10-14T16:54:49.063307+0000","last_active":"2023-10-14T16:59:39.974149+0000","last_peered":"2023-10-14T16:59:39.974149+0000","last_clean":"2023-10-14T16:59:39.974149+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T16:59:39.974149+0000","last_undegraded":"2023-10-14T16:59:39.974149+0000","last_fullsized":"2023-10-14T16:59:39.974149+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'76","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.483585+0000","last_change":"2023-10-14T16:54:54.098588+0000","last_active":"2023-10-14T16:59:55.483585+0000","last_peered":"2023-10-14T16:59:55.483585+0000","last_clean":"2023-10-14T16:59:55.483585+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T16:59:55.483585+0000","last_undegraded":"2023-10-14T16:59:55.483585+0000","last_fullsized":"2023-10-14T16:59:55.483585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:18.107600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":646501,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":64,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'754","reported_seq":821,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.940187+0000","last_change":"2023-10-14T16:59:40.048570+0000","last_active":"2023-10-14T16:59:54.940187+0000","last_peered":"2023-10-14T16:59:54.940187+0000","last_clean":"2023-10-14T16:59:54.940187+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T16:59:54.940187+0000","last_undegraded":"2023-10-14T16:59:54.940187+0000","last_fullsized":"2023-10-14T16:59:54.940187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069884818000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972495+0000","last_change":"2023-10-14T16:54:49.689356+0000","last_active":"2023-10-14T16:59:39.972495+0000","last_peered":"2023-10-14T16:59:39.972495+0000","last_clean":"2023-10-14T16:59:39.972495+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T16:59:39.972495+0000","last_undegraded":"2023-10-14T16:59:39.972495+0000","last_fullsized":"2023-10-14T16:59:39.972495+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'2235","reported_seq":2252,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972193+0000","last_change":"2023-10-14T16:54:54.093196+0000","last_active":"2023-10-14T16:59:39.972193+0000","last_peered":"2023-10-14T16:59:39.972193+0000","last_clean":"2023-10-14T16:59:39.972193+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T16:59:39.972193+0000","last_undegraded":"2023-10-14T16:59:39.972193+0000","last_fullsized":"2023-10-14T16:59:39.972193+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2235,"log_dups_size":0,"ondisk_log_size":2235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2227,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'634","reported_seq":700,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935223+0000","last_change":"2023-10-14T16:59:40.021827+0000","last_active":"2023-10-14T16:59:54.935223+0000","last_peered":"2023-10-14T16:59:54.935223+0000","last_clean":"2023-10-14T16:59:54.935223+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T16:59:54.935223+0000","last_undegraded":"2023-10-14T16:59:54.935223+0000","last_fullsized":"2023-10-14T16:59:54.935223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047771027000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974066+0000","last_change":"2023-10-14T16:54:49.689595+0000","last_active":"2023-10-14T16:59:39.974066+0000","last_peered":"2023-10-14T16:59:39.974066+0000","last_clean":"2023-10-14T16:59:39.974066+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T16:59:39.974066+0000","last_undegraded":"2023-10-14T16:59:39.974066+0000","last_fullsized":"2023-10-14T16:59:39.974066+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:46:44.177180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1503","reported_seq":1520,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972138+0000","last_change":"2023-10-14T16:54:54.099381+0000","last_active":"2023-10-14T16:59:39.972138+0000","last_peered":"2023-10-14T16:59:39.972138+0000","last_clean":"2023-10-14T16:59:39.972138+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T16:59:39.972138+0000","last_undegraded":"2023-10-14T16:59:39.972138+0000","last_fullsized":"2023-10-14T16:59:39.972138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"23'759","reported_seq":824,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.931088+0000","last_change":"2023-10-14T16:59:40.032574+0000","last_active":"2023-10-14T16:59:54.931088+0000","last_peered":"2023-10-14T16:59:54.931088+0000","last_clean":"2023-10-14T16:59:54.931088+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T16:59:54.931088+0000","last_undegraded":"2023-10-14T16:59:54.931088+0000","last_fullsized":"2023-10-14T16:59:54.931088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057422879000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974081+0000","last_change":"2023-10-14T16:54:49.689614+0000","last_active":"2023-10-14T16:59:39.974081+0000","last_peered":"2023-10-14T16:59:39.974081+0000","last_clean":"2023-10-14T16:59:39.974081+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T16:59:39.974081+0000","last_undegraded":"2023-10-14T16:59:39.974081+0000","last_fullsized":"2023-10-14T16:59:39.974081+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:09.272835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'741","reported_seq":758,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.483744+0000","last_change":"2023-10-14T16:54:54.100656+0000","last_active":"2023-10-14T16:59:54.483744+0000","last_peered":"2023-10-14T16:59:54.483744+0000","last_clean":"2023-10-14T16:59:54.483744+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T16:59:54.483744+0000","last_undegraded":"2023-10-14T16:59:54.483744+0000","last_fullsized":"2023-10-14T16:59:54.483744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'580","reported_seq":646,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938837+0000","last_change":"2023-10-14T16:59:40.021216+0000","last_active":"2023-10-14T16:59:54.938837+0000","last_peered":"2023-10-14T16:59:54.938837+0000","last_clean":"2023-10-14T16:59:54.938837+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T16:59:54.938837+0000","last_undegraded":"2023-10-14T16:59:54.938837+0000","last_fullsized":"2023-10-14T16:59:54.938837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047665379000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973447+0000","last_change":"2023-10-14T16:54:49.689836+0000","last_active":"2023-10-14T16:59:39.973447+0000","last_peered":"2023-10-14T16:59:39.973447+0000","last_clean":"2023-10-14T16:59:39.973447+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T16:59:39.973447+0000","last_undegraded":"2023-10-14T16:59:39.973447+0000","last_fullsized":"2023-10-14T16:59:39.973447+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:24.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"21'737","reported_seq":754,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973689+0000","last_change":"2023-10-14T16:54:54.096618+0000","last_active":"2023-10-14T16:59:39.973689+0000","last_peered":"2023-10-14T16:59:39.973689+0000","last_clean":"2023-10-14T16:59:39.973689+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T16:59:39.973689+0000","last_undegraded":"2023-10-14T16:59:39.973689+0000","last_fullsized":"2023-10-14T16:59:39.973689+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'697","reported_seq":763,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930425+0000","last_change":"2023-10-14T16:59:40.044773+0000","last_active":"2023-10-14T16:59:54.930425+0000","last_peered":"2023-10-14T16:59:54.930425+0000","last_clean":"2023-10-14T16:59:54.930425+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T16:59:54.930425+0000","last_undegraded":"2023-10-14T16:59:54.930425+0000","last_fullsized":"2023-10-14T16:59:54.930425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068678344000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972989+0000","last_change":"2023-10-14T16:54:49.064767+0000","last_active":"2023-10-14T16:59:39.972989+0000","last_peered":"2023-10-14T16:59:39.972989+0000","last_clean":"2023-10-14T16:59:39.972989+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T16:59:39.972989+0000","last_undegraded":"2023-10-14T16:59:39.972989+0000","last_fullsized":"2023-10-14T16:59:39.972989+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:34:26.616500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"21'1040","reported_seq":1057,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972984+0000","last_change":"2023-10-14T16:54:54.106280+0000","last_active":"2023-10-14T16:59:39.972984+0000","last_peered":"2023-10-14T16:59:39.972984+0000","last_clean":"2023-10-14T16:59:39.972984+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T16:59:39.972984+0000","last_undegraded":"2023-10-14T16:59:39.972984+0000","last_fullsized":"2023-10-14T16:59:39.972984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1040,"log_dups_size":0,"ondisk_log_size":1040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":8695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"23'754","reported_seq":820,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936228+0000","last_change":"2023-10-14T16:59:39.988269+0000","last_active":"2023-10-14T16:59:54.936228+0000","last_peered":"2023-10-14T16:59:54.936228+0000","last_clean":"2023-10-14T16:59:54.936228+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T16:59:54.936228+0000","last_undegraded":"2023-10-14T16:59:54.936228+0000","last_fullsized":"2023-10-14T16:59:54.936228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015859669999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'740","reported_seq":757,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481350+0000","last_change":"2023-10-14T16:54:54.102987+0000","last_active":"2023-10-14T16:59:40.481350+0000","last_peered":"2023-10-14T16:59:40.481350+0000","last_clean":"2023-10-14T16:59:40.481350+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T16:59:40.481350+0000","last_undegraded":"2023-10-14T16:59:40.481350+0000","last_fullsized":"2023-10-14T16:59:40.481350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'627","reported_seq":693,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.929135+0000","last_change":"2023-10-14T16:59:40.021896+0000","last_active":"2023-10-14T16:59:54.929135+0000","last_peered":"2023-10-14T16:59:54.929135+0000","last_clean":"2023-10-14T16:59:54.929135+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T16:59:54.929135+0000","last_undegraded":"2023-10-14T16:59:54.929135+0000","last_fullsized":"2023-10-14T16:59:54.929135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048042644000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"22'754","reported_seq":771,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.480495+0000","last_change":"2023-10-14T16:54:54.095975+0000","last_active":"2023-10-14T16:59:40.480495+0000","last_peered":"2023-10-14T16:59:40.480495+0000","last_clean":"2023-10-14T16:59:40.480495+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T16:59:40.480495+0000","last_undegraded":"2023-10-14T16:59:40.480495+0000","last_fullsized":"2023-10-14T16:59:40.480495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"23'834","reported_seq":900,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938606+0000","last_change":"2023-10-14T16:59:40.012979+0000","last_active":"2023-10-14T16:59:54.938606+0000","last_peered":"2023-10-14T16:59:54.938606+0000","last_clean":"2023-10-14T16:59:54.938606+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T16:59:54.938606+0000","last_undegraded":"2023-10-14T16:59:54.938606+0000","last_fullsized":"2023-10-14T16:59:54.938606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038542571999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2256","reported_seq":2273,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481355+0000","last_change":"2023-10-14T16:54:54.103049+0000","last_active":"2023-10-14T16:59:40.481355+0000","last_peered":"2023-10-14T16:59:40.481355+0000","last_clean":"2023-10-14T16:59:40.481355+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T16:59:40.481355+0000","last_undegraded":"2023-10-14T16:59:40.481355+0000","last_fullsized":"2023-10-14T16:59:40.481355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2256,"log_dups_size":0,"ondisk_log_size":2256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:17:46.369733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2245,"num_write_kb":13441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"23'673","reported_seq":739,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.924367+0000","last_change":"2023-10-14T16:59:40.011333+0000","last_active":"2023-10-14T16:59:54.924367+0000","last_peered":"2023-10-14T16:59:54.924367+0000","last_clean":"2023-10-14T16:59:54.924367+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T16:59:54.924367+0000","last_undegraded":"2023-10-14T16:59:54.924367+0000","last_fullsized":"2023-10-14T16:59:54.924367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038619158000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3072","reported_seq":3089,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.486482+0000","last_change":"2023-10-14T16:54:54.095418+0000","last_active":"2023-10-14T16:59:55.486482+0000","last_peered":"2023-10-14T16:59:55.486482+0000","last_clean":"2023-10-14T16:59:55.486482+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T16:59:55.486482+0000","last_undegraded":"2023-10-14T16:59:55.486482+0000","last_fullsized":"2023-10-14T16:59:55.486482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3072,"log_dups_size":0,"ondisk_log_size":3072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:42.952466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5333059,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3064,"num_write_kb":7239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"23'766","reported_seq":832,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934086+0000","last_change":"2023-10-14T16:59:40.044481+0000","last_active":"2023-10-14T16:59:54.934086+0000","last_peered":"2023-10-14T16:59:54.934086+0000","last_clean":"2023-10-14T16:59:54.934086+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T16:59:54.934086+0000","last_undegraded":"2023-10-14T16:59:54.934086+0000","last_fullsized":"2023-10-14T16:59:54.934086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068737623999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"21'784","reported_seq":801,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.976916+0000","last_change":"2023-10-14T16:54:54.098491+0000","last_active":"2023-10-14T16:59:39.976916+0000","last_peered":"2023-10-14T16:59:39.976916+0000","last_clean":"2023-10-14T16:59:39.976916+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T16:59:39.976916+0000","last_undegraded":"2023-10-14T16:59:39.976916+0000","last_fullsized":"2023-10-14T16:59:39.976916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389162,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'693","reported_seq":757,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934762+0000","last_change":"2023-10-14T16:59:39.998765+0000","last_active":"2023-10-14T16:59:54.934762+0000","last_peered":"2023-10-14T16:59:54.934762+0000","last_clean":"2023-10-14T16:59:54.934762+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T16:59:54.934762+0000","last_undegraded":"2023-10-14T16:59:54.934762+0000","last_fullsized":"2023-10-14T16:59:54.934762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026701018,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"23'669","reported_seq":734,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935703+0000","last_change":"2023-10-14T16:59:39.991721+0000","last_active":"2023-10-14T16:59:54.935703+0000","last_peered":"2023-10-14T16:59:54.935703+0000","last_clean":"2023-10-14T16:59:54.935703+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T16:59:54.935703+0000","last_undegraded":"2023-10-14T16:59:54.935703+0000","last_fullsized":"2023-10-14T16:59:54.935703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01972498,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"23'706","reported_seq":771,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935578+0000","last_change":"2023-10-14T16:59:39.984241+0000","last_active":"2023-10-14T16:59:54.935578+0000","last_peered":"2023-10-14T16:59:54.935578+0000","last_clean":"2023-10-14T16:59:54.935578+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T16:59:54.935578+0000","last_undegraded":"2023-10-14T16:59:54.935578+0000","last_fullsized":"2023-10-14T16:59:54.935578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012044934,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"23'775","reported_seq":840,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938669+0000","last_change":"2023-10-14T16:59:40.032026+0000","last_active":"2023-10-14T16:59:54.938669+0000","last_peered":"2023-10-14T16:59:54.938669+0000","last_clean":"2023-10-14T16:59:54.938669+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T16:59:54.938669+0000","last_undegraded":"2023-10-14T16:59:54.938669+0000","last_fullsized":"2023-10-14T16:59:54.938669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058085603999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"23'600","reported_seq":665,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937844+0000","last_change":"2023-10-14T16:59:40.046985+0000","last_active":"2023-10-14T16:59:54.937844+0000","last_peered":"2023-10-14T16:59:54.937844+0000","last_clean":"2023-10-14T16:59:54.937844+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T16:59:54.937844+0000","last_undegraded":"2023-10-14T16:59:54.937844+0000","last_fullsized":"2023-10-14T16:59:54.937844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070423702000000005,"stat_sum":{"num_bytes":8224,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"23'394","reported_seq":459,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938679+0000","last_change":"2023-10-14T16:59:40.023267+0000","last_active":"2023-10-14T16:59:54.938679+0000","last_peered":"2023-10-14T16:59:54.938679+0000","last_clean":"2023-10-14T16:59:54.938679+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T16:59:54.938679+0000","last_undegraded":"2023-10-14T16:59:54.938679+0000","last_fullsized":"2023-10-14T16:59:54.938679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048708460000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":30,"num_read_kb":20,"num_write":108,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41370,"ondisk_log_size":41370,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":190530350,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":33640,"num_write_kb":203671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381116416,"data_stored":381054111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33839,"ondisk_log_size":33839,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705730,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396524,"kb_used_data":86948,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93975316,"statfs":{"total":96636764160,"available":96230723584,"internally_reserved":0,"allocated":89034752,"data_stored":88829719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39000000000000001,"15min":0.41599999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.55100000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.372},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39900000000000002,"15min":0.42699999999999999},"min":{"1min":0.246,"5min":0.217,"15min":0.217},"max":{"1min":0.60399999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.40300000000000002}]},{"osd":1,"last update":"Sat Oct 14 16:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.437,"15min":0.46700000000000003},"min":{"1min":0.27700000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.64900000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.439},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.437,"15min":0.46700000000000003},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.66100000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Oct 14 16:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.315,"15min":0.34499999999999997},"min":{"1min":0.19800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.437,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.308,"5min":0.32000000000000001,"15min":0.34899999999999998},"min":{"1min":0.20399999999999999,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.45400000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.38400000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705730,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426360,"kb_used_data":116784,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93945480,"statfs":{"total":96636764160,"available":96200171520,"internally_reserved":0,"allocated":119586816,"data_stored":119357205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.46300000000000002,"15min":0.44900000000000001},"min":{"1min":0.22,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.57299999999999995,"5min":5.992,"15min":5.992},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.503,"15min":0.46200000000000002},"min":{"1min":0.218,"5min":0.215,"15min":0.215},"max":{"1min":0.59599999999999997,"5min":9.2620000000000005,"15min":9.2620000000000005},"last":0.56499999999999995}]},{"osd":1,"last update":"Sat Oct 14 16:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55800000000000005,"5min":6.266,"15min":6.266},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.54300000000000004,"15min":0.49299999999999999},"min":{"1min":0.25600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.61499999999999999,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":0.503}]},{"osd":3,"last update":"Sat Oct 14 16:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.317,"15min":0.31900000000000001},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.45900000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.316},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.38100000000000001,"15min":0.35799999999999998},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.503,"5min":6.3170000000000002,"15min":6.3170000000000002},"last":0.34699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705729,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397668,"kb_used_data":92188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":93974172,"statfs":{"total":96636764160,"available":96229552128,"internally_reserved":0,"allocated":94400512,"data_stored":94210119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.27200000000000002,"15min":0.29599999999999999},"min":{"1min":0.20799999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.318},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.50800000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.45700000000000002},"min":{"1min":0.24099999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56299999999999994,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.46500000000000002},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61399999999999999,"5min":0.629,"15min":0.629},"last":0.432}]},{"osd":3,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29299999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.63300000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.45100000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705730,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388312,"kb_used_data":78736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93983528,"statfs":{"total":96636764160,"available":96239132672,"internally_reserved":0,"allocated":80625664,"data_stored":80427560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.27400000000000002},"min":{"1min":0.21099999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.28699999999999998,"15min":0.29899999999999999},"min":{"1min":0.24099999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42599999999999999,"15min":0.45700000000000002},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42199999999999999,"15min":0.46100000000000002},"min":{"1min":0.28399999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63900000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.67100000000000004}]},{"osd":3,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.45300000000000001},"min":{"1min":0.29699999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.59699999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.48599999999999999},"min":{"1min":0.33500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94076928,"data_stored":94060658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":79691776,"data_stored":79691776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":119242752,"data_stored":119219969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88104960,"data_stored":88081708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":53391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":73798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T17:00:02.928 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T17:00:02.928 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T17:00:03.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.080+0000 7fd87e96a700 1 Processor -- start 2023-10-14T17:00:03.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.080+0000 7fd87e96a700 1 -- start start 2023-10-14T17:00:03.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.080+0000 7fd87e96a700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8780a9fa0 0x7fd878133f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.080+0000 7fd87e96a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8780a47b0 0x7fd8780a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.080+0000 7fd87e96a700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd878133740 con 0x7fd8780a5140 2023-10-14T17:00:03.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.080+0000 7fd87e96a700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8780a12a0 con 0x7fd8780a9fa0 2023-10-14T17:00:03.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.080+0000 7fd87e96a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780a1bc0 con 0x7fd8780a47b0 2023-10-14T17:00:03.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.080+0000 7fd877fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8780a9fa0 0x7fd878133f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.080+0000 7fd877fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd8780a9fa0 0x7fd878133f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60150/0 (socket says 172.21.15.8:60150) 2023-10-14T17:00:03.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.080+0000 7fd87cf07700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd8780a5140 0x7fd87813e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40394/0 (socket says 172.21.15.8:40394) 2023-10-14T17:00:03.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.080+0000 7fd877fff700 1 -- 172.21.15.8:0/4176158603 learned_addr learned my addr 172.21.15.8:0/4176158603 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:03.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.081+0000 7fd8777fe700 1 --2- 172.21.15.8:0/4176158603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8780a47b0 0x7fd8780a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.081+0000 7fd877fff700 1 -- 172.21.15.8:0/4176158603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8780a47b0 msgr2=0x7fd8780a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:03.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.081+0000 7fd877fff700 1 --2- 172.21.15.8:0/4176158603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8780a47b0 0x7fd8780a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.081+0000 7fd877fff700 1 -- 172.21.15.8:0/4176158603 >> v1:172.21.15.8:6789/0 conn(0x7fd8780a5140 legacy=0x7fd87813e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:03.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.081+0000 7fd877fff700 1 -- 172.21.15.8:0/4176158603 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878133970 con 0x7fd8780a9fa0 2023-10-14T17:00:03.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.081+0000 7fd876ffd700 1 -- 172.21.15.8:0/4176158603 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293068970 0 0) 0x7fd878133740 con 0x7fd8780a5140 2023-10-14T17:00:03.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.081+0000 7fd8777fe700 1 --2- 172.21.15.8:0/4176158603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8780a47b0 0x7fd8780a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:00:03.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.081+0000 7fd877fff700 1 --2- 172.21.15.8:0/4176158603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8780a9fa0 0x7fd878133f60 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7fd8680099b0 tx=0x7fd868009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbab2665d4231fc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:03.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.081+0000 7fd876ffd700 1 -- 172.21.15.8:0/4176158603 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86800b860 con 0x7fd8780a9fa0 2023-10-14T17:00:03.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.081+0000 7fd876ffd700 1 -- 172.21.15.8:0/4176158603 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86800b9c0 con 0x7fd8780a9fa0 2023-10-14T17:00:03.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.081+0000 7fd876ffd700 1 -- 172.21.15.8:0/4176158603 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86800bd60 con 0x7fd8780a9fa0 2023-10-14T17:00:03.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.082+0000 7fd87e96a700 1 -- 172.21.15.8:0/4176158603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8780a9fa0 msgr2=0x7fd878133f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:03.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.082+0000 7fd87e96a700 1 --2- 172.21.15.8:0/4176158603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8780a9fa0 0x7fd878133f60 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7fd8680099b0 tx=0x7fd868009250 comp rx=0 tx=0).stop 2023-10-14T17:00:03.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.082+0000 7fd87e96a700 1 -- 172.21.15.8:0/4176158603 shutdown_connections 2023-10-14T17:00:03.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.082+0000 7fd87e96a700 1 --2- 172.21.15.8:0/4176158603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8780a9fa0 0x7fd878133f60 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.082+0000 7fd87e96a700 1 --2- 172.21.15.8:0/4176158603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8780a47b0 0x7fd8780a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.082+0000 7fd87e96a700 1 -- 172.21.15.8:0/4176158603 >> 172.21.15.8:0/4176158603 conn(0x7fd87806a960 msgr2=0x7fd8780701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:03.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.082+0000 7fd87e96a700 1 -- 172.21.15.8:0/4176158603 shutdown_connections 2023-10-14T17:00:03.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.082+0000 7fd87e96a700 1 -- 172.21.15.8:0/4176158603 wait complete. 2023-10-14T17:00:03.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd87e96a700 1 Processor -- start 2023-10-14T17:00:03.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd87e96a700 1 -- start start 2023-10-14T17:00:03.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd87e96a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8780a47b0 0x7fd878095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd87e96a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8780a5140 0x7fd878095fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd87e96a700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd878099b20 0x7fd8780964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd87e96a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd878098920 con 0x7fd8780a5140 2023-10-14T17:00:03.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd87e96a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780a0830 con 0x7fd8780a47b0 2023-10-14T17:00:03.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd87e96a700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd878098e30 con 0x7fd878099b20 2023-10-14T17:00:03.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd8777fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8780a5140 0x7fd878095fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd8777fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8780a5140 0x7fd878095fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60162/0 (socket says 172.21.15.8:60162) 2023-10-14T17:00:03.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd8777fe700 1 -- 172.21.15.8:0/3629485721 learned_addr learned my addr 172.21.15.8:0/3629485721 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:03.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd87cf07700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd878099b20 0x7fd8780964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.083+0000 7fd877fff700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8780a47b0 0x7fd878095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.084+0000 7fd8777fe700 1 -- 172.21.15.8:0/3629485721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd878099b20 msgr2=0x7fd8780964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:03.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.084+0000 7fd8777fe700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd878099b20 0x7fd8780964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.084+0000 7fd8777fe700 1 -- 172.21.15.8:0/3629485721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8780a47b0 msgr2=0x7fd878095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:03.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.084+0000 7fd8777fe700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8780a47b0 0x7fd878095a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.084+0000 7fd8777fe700 1 -- 172.21.15.8:0/3629485721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8680094f0 con 0x7fd8780a5140 2023-10-14T17:00:03.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.084+0000 7fd8777fe700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8780a5140 0x7fd878095fb0 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00e8d0 tx=0x7fd86c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:03.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.084+0000 7fd85ffff700 1 -- 172.21.15.8:0/3629485721 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c00ee70 con 0x7fd8780a5140 2023-10-14T17:00:03.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.084+0000 7fd85ffff700 1 -- 172.21.15.8:0/3629485721 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c00c5e0 con 0x7fd8780a5140 2023-10-14T17:00:03.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.084+0000 7fd87e96a700 1 -- 172.21.15.8:0/3629485721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd878098b50 con 0x7fd8780a5140 2023-10-14T17:00:03.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.084+0000 7fd85ffff700 1 -- 172.21.15.8:0/3629485721 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c00c980 con 0x7fd8780a5140 2023-10-14T17:00:03.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.084+0000 7fd87e96a700 1 -- 172.21.15.8:0/3629485721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd878137470 con 0x7fd8780a5140 2023-10-14T17:00:03.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.085+0000 7fd87e96a700 1 -- 172.21.15.8:0/3629485721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd878097db0 con 0x7fd8780a5140 2023-10-14T17:00:03.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.085+0000 7fd85ffff700 1 -- 172.21.15.8:0/3629485721 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd86c013410 con 0x7fd8780a5140 2023-10-14T17:00:03.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.086+0000 7fd85ffff700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fd864066f30 0x7fd8640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.086+0000 7fd85ffff700 1 -- 172.21.15.8:0/3629485721 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7fd86c083ee0 con 0x7fd8780a5140 2023-10-14T17:00:03.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.086+0000 7fd877fff700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fd864066f30 0x7fd8640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.086+0000 7fd877fff700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fd864066f30 0x7fd8640693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8680099b0 tx=0x7fd868017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:03.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.090+0000 7fd85ffff700 1 -- 172.21.15.8:0/3629485721 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd86c051670 con 0x7fd8780a5140 2023-10-14T17:00:03.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.281+0000 7fd87e96a700 1 -- 172.21.15.8:0/3629485721 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd87806ad60 con 0x7fd864066f30 2023-10-14T17:00:03.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.289+0000 7fd85ffff700 1 -- 172.21.15.8:0/3629485721 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278903 (secure 0 0 0) 0x7fd87806ad60 con 0x7fd864066f30 2023-10-14T17:00:03.293 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:00:03.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.292+0000 7fd87e96a700 1 -- 172.21.15.8:0/3629485721 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fd864066f30 msgr2=0x7fd8640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:03.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.292+0000 7fd87e96a700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fd864066f30 0x7fd8640693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8680099b0 tx=0x7fd868017000 comp rx=0 tx=0).stop 2023-10-14T17:00:03.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.292+0000 7fd87e96a700 1 -- 172.21.15.8:0/3629485721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8780a5140 msgr2=0x7fd878095fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:03.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.292+0000 7fd87e96a700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8780a5140 0x7fd878095fb0 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00e8d0 tx=0x7fd86c008040 comp rx=0 tx=0).stop 2023-10-14T17:00:03.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.292+0000 7fd87e96a700 1 -- 172.21.15.8:0/3629485721 shutdown_connections 2023-10-14T17:00:03.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.292+0000 7fd87e96a700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fd864066f30 0x7fd8640693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.292+0000 7fd87e96a700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd878099b20 0x7fd8780964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.292+0000 7fd87e96a700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8780a47b0 0x7fd878095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.292+0000 7fd87e96a700 1 --2- 172.21.15.8:0/3629485721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8780a5140 0x7fd878095fb0 unknown :-1 s=CLOSED pgs=2463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.292+0000 7fd87e96a700 1 -- 172.21.15.8:0/3629485721 >> 172.21.15.8:0/3629485721 conn(0x7fd87806a960 msgr2=0x7fd87813a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:03.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.292+0000 7fd87e96a700 1 -- 172.21.15.8:0/3629485721 shutdown_connections 2023-10-14T17:00:03.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.292+0000 7fd87e96a700 1 -- 172.21.15.8:0/3629485721 wait complete. 2023-10-14T17:00:03.298 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T17:00:03.305 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2023-10-14T17:00:02.049811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":191247906,"num_objects":152,"num_object_clones":21,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":8,"num_read":210,"num_read_kb":798,"num_write":33907,"num_write_kb":206276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75326,"ondisk_log_size":75326,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1608864,"kb_used_data":374656,"kb_used_omap":0,"kb_used_meta":1234176,"kb_avail":375878496,"statfs":{"total":386547056640,"available":384899579904,"internally_reserved":0,"allocated":383647744,"data_stored":382824603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1263796224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":559526,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":3,"num_read":7,"num_read_kb":8,"num_write":110,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002923"},"pg_stats":[{"pgid":"4.3f","version":"23'645","reported_seq":711,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939505+0000","last_change":"2023-10-14T16:59:40.048771+0000","last_active":"2023-10-14T16:59:54.939505+0000","last_peered":"2023-10-14T16:59:54.939505+0000","last_clean":"2023-10-14T16:59:54.939505+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T16:59:54.939505+0000","last_undegraded":"2023-10-14T16:59:54.939505+0000","last_fullsized":"2023-10-14T16:59:54.939505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070427155000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"23'746","reported_seq":812,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938563+0000","last_change":"2023-10-14T16:59:40.012472+0000","last_active":"2023-10-14T16:59:54.938563+0000","last_peered":"2023-10-14T16:59:54.938563+0000","last_clean":"2023-10-14T16:59:54.938563+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T16:59:54.938563+0000","last_undegraded":"2023-10-14T16:59:54.938563+0000","last_fullsized":"2023-10-14T16:59:54.938563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038749005000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'628","reported_seq":694,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933861+0000","last_change":"2023-10-14T16:59:40.031831+0000","last_active":"2023-10-14T16:59:54.933861+0000","last_peered":"2023-10-14T16:59:54.933861+0000","last_clean":"2023-10-14T16:59:54.933861+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T16:59:54.933861+0000","last_undegraded":"2023-10-14T16:59:54.933861+0000","last_fullsized":"2023-10-14T16:59:54.933861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:56.343441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152503000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"23'646","reported_seq":712,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.923219+0000","last_change":"2023-10-14T16:59:40.006348+0000","last_active":"2023-10-14T16:59:54.923219+0000","last_peered":"2023-10-14T16:59:54.923219+0000","last_clean":"2023-10-14T16:59:54.923219+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T16:59:54.923219+0000","last_undegraded":"2023-10-14T16:59:54.923219+0000","last_fullsized":"2023-10-14T16:59:54.923219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:05.483417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033834213000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"23'521","reported_seq":587,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937750+0000","last_change":"2023-10-14T16:59:40.046517+0000","last_active":"2023-10-14T16:59:54.937750+0000","last_peered":"2023-10-14T16:59:54.937750+0000","last_clean":"2023-10-14T16:59:54.937750+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T16:59:54.937750+0000","last_undegraded":"2023-10-14T16:59:54.937750+0000","last_fullsized":"2023-10-14T16:59:54.937750+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070258685000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'532","reported_seq":598,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.918042+0000","last_change":"2023-10-14T16:59:40.032103+0000","last_active":"2023-10-14T16:59:54.918042+0000","last_peered":"2023-10-14T16:59:54.918042+0000","last_clean":"2023-10-14T16:59:54.918042+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T16:59:54.918042+0000","last_undegraded":"2023-10-14T16:59:54.918042+0000","last_fullsized":"2023-10-14T16:59:54.918042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:59.572769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058053194000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'962","reported_seq":1028,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921346+0000","last_change":"2023-10-14T16:59:40.032217+0000","last_active":"2023-10-14T16:59:54.921346+0000","last_peered":"2023-10-14T16:59:54.921346+0000","last_clean":"2023-10-14T16:59:54.921346+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T16:59:54.921346+0000","last_undegraded":"2023-10-14T16:59:54.921346+0000","last_fullsized":"2023-10-14T16:59:54.921346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:15:51.621106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058433710999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'666","reported_seq":732,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.919451+0000","last_change":"2023-10-14T16:59:40.032894+0000","last_active":"2023-10-14T16:59:54.919451+0000","last_peered":"2023-10-14T16:59:54.919451+0000","last_clean":"2023-10-14T16:59:54.919451+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T16:59:54.919451+0000","last_undegraded":"2023-10-14T16:59:54.919451+0000","last_fullsized":"2023-10-14T16:59:54.919451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:40.295415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057530364000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"23'726","reported_seq":792,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939207+0000","last_change":"2023-10-14T16:59:40.048548+0000","last_active":"2023-10-14T16:59:54.939207+0000","last_peered":"2023-10-14T16:59:54.939207+0000","last_clean":"2023-10-14T16:59:54.939207+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T16:59:54.939207+0000","last_undegraded":"2023-10-14T16:59:54.939207+0000","last_fullsized":"2023-10-14T16:59:54.939207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070350251000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'591","reported_seq":657,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933559+0000","last_change":"2023-10-14T16:59:40.030928+0000","last_active":"2023-10-14T16:59:54.933559+0000","last_peered":"2023-10-14T16:59:54.933559+0000","last_clean":"2023-10-14T16:59:54.933559+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T16:59:54.933559+0000","last_undegraded":"2023-10-14T16:59:54.933559+0000","last_fullsized":"2023-10-14T16:59:54.933559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:54:37.853332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057828565999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"23'504","reported_seq":569,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.920075+0000","last_change":"2023-10-14T16:59:40.011889+0000","last_active":"2023-10-14T16:59:54.920075+0000","last_peered":"2023-10-14T16:59:54.920075+0000","last_clean":"2023-10-14T16:59:54.920075+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T16:59:54.920075+0000","last_undegraded":"2023-10-14T16:59:54.920075+0000","last_fullsized":"2023-10-14T16:59:54.920075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:18:19.208533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039012109000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"23'510","reported_seq":576,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938970+0000","last_change":"2023-10-14T16:59:40.020882+0000","last_active":"2023-10-14T16:59:54.938970+0000","last_peered":"2023-10-14T16:59:54.938970+0000","last_clean":"2023-10-14T16:59:54.938970+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T16:59:54.938970+0000","last_undegraded":"2023-10-14T16:59:54.938970+0000","last_fullsized":"2023-10-14T16:59:54.938970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047436036000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"23'512","reported_seq":578,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930357+0000","last_change":"2023-10-14T16:59:40.046901+0000","last_active":"2023-10-14T16:59:54.930357+0000","last_peered":"2023-10-14T16:59:54.930357+0000","last_clean":"2023-10-14T16:59:54.930357+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T16:59:54.930357+0000","last_undegraded":"2023-10-14T16:59:54.930357+0000","last_fullsized":"2023-10-14T16:59:54.930357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:13.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070191972000000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"23'757","reported_seq":822,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938286+0000","last_change":"2023-10-14T16:59:40.009015+0000","last_active":"2023-10-14T16:59:54.938286+0000","last_peered":"2023-10-14T16:59:54.938286+0000","last_clean":"2023-10-14T16:59:54.938286+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T16:59:54.938286+0000","last_undegraded":"2023-10-14T16:59:54.938286+0000","last_fullsized":"2023-10-14T16:59:54.938286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036605058000000003,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"23'655","reported_seq":721,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.932286+0000","last_change":"2023-10-14T16:59:40.012646+0000","last_active":"2023-10-14T16:59:54.932286+0000","last_peered":"2023-10-14T16:59:54.932286+0000","last_clean":"2023-10-14T16:59:54.932286+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T16:59:54.932286+0000","last_undegraded":"2023-10-14T16:59:54.932286+0000","last_fullsized":"2023-10-14T16:59:54.932286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038947427,"stat_sum":{"num_bytes":4105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"23'745","reported_seq":810,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933504+0000","last_change":"2023-10-14T16:59:40.032292+0000","last_active":"2023-10-14T16:59:54.933504+0000","last_peered":"2023-10-14T16:59:54.933504+0000","last_clean":"2023-10-14T16:59:54.933504+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T16:59:54.933504+0000","last_undegraded":"2023-10-14T16:59:54.933504+0000","last_fullsized":"2023-10-14T16:59:54.933504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:41:12.510526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058345898,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'595","reported_seq":661,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939581+0000","last_change":"2023-10-14T16:59:40.048812+0000","last_active":"2023-10-14T16:59:54.939581+0000","last_peered":"2023-10-14T16:59:54.939581+0000","last_clean":"2023-10-14T16:59:54.939581+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T16:59:54.939581+0000","last_undegraded":"2023-10-14T16:59:54.939581+0000","last_fullsized":"2023-10-14T16:59:54.939581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071573409000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'693","reported_seq":759,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.932562+0000","last_change":"2023-10-14T16:59:40.030743+0000","last_active":"2023-10-14T16:59:54.932562+0000","last_peered":"2023-10-14T16:59:54.932562+0000","last_clean":"2023-10-14T16:59:54.932562+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T16:59:54.932562+0000","last_undegraded":"2023-10-14T16:59:54.932562+0000","last_fullsized":"2023-10-14T16:59:54.932562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057407435999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"23'572","reported_seq":639,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.929581+0000","last_change":"2023-10-14T16:59:40.045847+0000","last_active":"2023-10-14T16:59:54.929581+0000","last_peered":"2023-10-14T16:59:54.929581+0000","last_clean":"2023-10-14T16:59:54.929581+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T16:59:54.929581+0000","last_undegraded":"2023-10-14T16:59:54.929581+0000","last_fullsized":"2023-10-14T16:59:54.929581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070060102999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"23'761","reported_seq":827,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939075+0000","last_change":"2023-10-14T16:59:40.029354+0000","last_active":"2023-10-14T16:59:54.939075+0000","last_peered":"2023-10-14T16:59:54.939075+0000","last_clean":"2023-10-14T16:59:54.939075+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T16:59:54.939075+0000","last_undegraded":"2023-10-14T16:59:54.939075+0000","last_fullsized":"2023-10-14T16:59:54.939075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056633790000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"23'810","reported_seq":876,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938705+0000","last_change":"2023-10-14T16:59:40.012817+0000","last_active":"2023-10-14T16:59:54.938705+0000","last_peered":"2023-10-14T16:59:54.938705+0000","last_clean":"2023-10-14T16:59:54.938705+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T16:59:54.938705+0000","last_undegraded":"2023-10-14T16:59:54.938705+0000","last_fullsized":"2023-10-14T16:59:54.938705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038418550000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"23'694","reported_seq":760,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938748+0000","last_change":"2023-10-14T16:59:40.041012+0000","last_active":"2023-10-14T16:59:54.938748+0000","last_peered":"2023-10-14T16:59:54.938748+0000","last_clean":"2023-10-14T16:59:54.938748+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T16:59:54.938748+0000","last_undegraded":"2023-10-14T16:59:54.938748+0000","last_fullsized":"2023-10-14T16:59:54.938748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.065688290999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'638","reported_seq":704,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935953+0000","last_change":"2023-10-14T16:59:39.983318+0000","last_active":"2023-10-14T16:59:54.935953+0000","last_peered":"2023-10-14T16:59:54.935953+0000","last_clean":"2023-10-14T16:59:54.935953+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T16:59:54.935953+0000","last_undegraded":"2023-10-14T16:59:54.935953+0000","last_fullsized":"2023-10-14T16:59:54.935953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011260075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"23'846","reported_seq":912,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934718+0000","last_change":"2023-10-14T16:59:40.031942+0000","last_active":"2023-10-14T16:59:54.934718+0000","last_peered":"2023-10-14T16:59:54.934718+0000","last_clean":"2023-10-14T16:59:54.934718+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T16:59:54.934718+0000","last_undegraded":"2023-10-14T16:59:54.934718+0000","last_fullsized":"2023-10-14T16:59:54.934718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"23'636","reported_seq":702,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938462+0000","last_change":"2023-10-14T16:59:40.023150+0000","last_active":"2023-10-14T16:59:54.938462+0000","last_peered":"2023-10-14T16:59:54.938462+0000","last_clean":"2023-10-14T16:59:54.938462+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T16:59:54.938462+0000","last_undegraded":"2023-10-14T16:59:54.938462+0000","last_fullsized":"2023-10-14T16:59:54.938462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048983802,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'679","reported_seq":745,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935906+0000","last_change":"2023-10-14T16:59:40.021577+0000","last_active":"2023-10-14T16:59:54.935906+0000","last_peered":"2023-10-14T16:59:54.935906+0000","last_clean":"2023-10-14T16:59:54.935906+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T16:59:54.935906+0000","last_undegraded":"2023-10-14T16:59:54.935906+0000","last_fullsized":"2023-10-14T16:59:54.935906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047799974000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'513","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933795+0000","last_change":"2023-10-14T16:59:40.032393+0000","last_active":"2023-10-14T16:59:54.933795+0000","last_peered":"2023-10-14T16:59:54.933795+0000","last_clean":"2023-10-14T16:59:54.933795+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T16:59:54.933795+0000","last_undegraded":"2023-10-14T16:59:54.933795+0000","last_fullsized":"2023-10-14T16:59:54.933795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:46.761206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058565578,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1532","reported_seq":1549,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972294+0000","last_change":"2023-10-14T16:54:54.101946+0000","last_active":"2023-10-14T16:59:39.972294+0000","last_peered":"2023-10-14T16:59:39.972294+0000","last_clean":"2023-10-14T16:59:39.972294+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T16:59:39.972294+0000","last_undegraded":"2023-10-14T16:59:39.972294+0000","last_fullsized":"2023-10-14T16:59:39.972294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1532,"log_dups_size":0,"ondisk_log_size":1532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1524,"num_write_kb":13073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"23'653","reported_seq":720,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936652+0000","last_change":"2023-10-14T16:59:40.043067+0000","last_active":"2023-10-14T16:59:54.936652+0000","last_peered":"2023-10-14T16:59:54.936652+0000","last_clean":"2023-10-14T16:59:54.936652+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T16:59:54.936652+0000","last_undegraded":"2023-10-14T16:59:54.936652+0000","last_fullsized":"2023-10-14T16:59:54.936652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067459389999999994,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"22'755","reported_seq":772,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.480503+0000","last_change":"2023-10-14T16:54:54.096872+0000","last_active":"2023-10-14T16:59:40.480503+0000","last_peered":"2023-10-14T16:59:40.480503+0000","last_clean":"2023-10-14T16:59:40.480503+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T16:59:40.480503+0000","last_undegraded":"2023-10-14T16:59:40.480503+0000","last_fullsized":"2023-10-14T16:59:40.480503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'585","reported_seq":651,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937438+0000","last_change":"2023-10-14T16:59:40.047218+0000","last_active":"2023-10-14T16:59:54.937438+0000","last_peered":"2023-10-14T16:59:54.937438+0000","last_clean":"2023-10-14T16:59:54.937438+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T16:59:54.937438+0000","last_undegraded":"2023-10-14T16:59:54.937438+0000","last_fullsized":"2023-10-14T16:59:54.937438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070886901000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1506","reported_seq":1523,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.115969+0000","last_change":"2023-10-14T16:54:54.094974+0000","last_active":"2023-10-14T16:59:48.115969+0000","last_peered":"2023-10-14T16:59:48.115969+0000","last_clean":"2023-10-14T16:59:48.115969+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T16:59:48.115969+0000","last_undegraded":"2023-10-14T16:59:48.115969+0000","last_fullsized":"2023-10-14T16:59:48.115969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"23'593","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936070+0000","last_change":"2023-10-14T16:59:40.031610+0000","last_active":"2023-10-14T16:59:54.936070+0000","last_peered":"2023-10-14T16:59:54.936070+0000","last_clean":"2023-10-14T16:59:54.936070+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T16:59:54.936070+0000","last_undegraded":"2023-10-14T16:59:54.936070+0000","last_fullsized":"2023-10-14T16:59:54.936070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058803686000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"22'4","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.479890+0000","last_change":"2023-10-14T16:54:54.098193+0000","last_active":"2023-10-14T16:59:40.479890+0000","last_peered":"2023-10-14T16:59:40.479890+0000","last_clean":"2023-10-14T16:59:40.479890+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T16:59:40.479890+0000","last_undegraded":"2023-10-14T16:59:40.479890+0000","last_fullsized":"2023-10-14T16:59:40.479890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:33.333473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'583","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935086+0000","last_change":"2023-10-14T16:59:39.997256+0000","last_active":"2023-10-14T16:59:54.935086+0000","last_peered":"2023-10-14T16:59:54.935086+0000","last_clean":"2023-10-14T16:59:54.935086+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T16:59:54.935086+0000","last_undegraded":"2023-10-14T16:59:54.935086+0000","last_fullsized":"2023-10-14T16:59:54.935086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024750503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'756","reported_seq":773,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971815+0000","last_change":"2023-10-14T16:54:54.100620+0000","last_active":"2023-10-14T16:59:47.971815+0000","last_peered":"2023-10-14T16:59:47.971815+0000","last_clean":"2023-10-14T16:59:47.971815+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T16:59:47.971815+0000","last_undegraded":"2023-10-14T16:59:47.971815+0000","last_fullsized":"2023-10-14T16:59:47.971815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'570","reported_seq":636,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.927022+0000","last_change":"2023-10-14T16:59:40.043286+0000","last_active":"2023-10-14T16:59:54.927022+0000","last_peered":"2023-10-14T16:59:54.927022+0000","last_clean":"2023-10-14T16:59:54.927022+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T16:59:54.927022+0000","last_undegraded":"2023-10-14T16:59:54.927022+0000","last_fullsized":"2023-10-14T16:59:54.927022+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067572238000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"23'798","reported_seq":815,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.489258+0000","last_change":"2023-10-14T16:54:54.097908+0000","last_active":"2023-10-14T16:59:55.489258+0000","last_peered":"2023-10-14T16:59:55.489258+0000","last_clean":"2023-10-14T16:59:55.489258+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T16:59:55.489258+0000","last_undegraded":"2023-10-14T16:59:55.489258+0000","last_fullsized":"2023-10-14T16:59:55.489258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"23'414","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936113+0000","last_change":"2023-10-14T16:59:39.986224+0000","last_active":"2023-10-14T16:59:54.936113+0000","last_peered":"2023-10-14T16:59:54.936113+0000","last_clean":"2023-10-14T16:59:54.936113+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T16:59:54.936113+0000","last_undegraded":"2023-10-14T16:59:54.936113+0000","last_fullsized":"2023-10-14T16:59:54.936113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013962693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'2297","reported_seq":2314,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:52.483484+0000","last_change":"2023-10-14T16:54:54.098933+0000","last_active":"2023-10-14T16:59:52.483484+0000","last_peered":"2023-10-14T16:59:52.483484+0000","last_clean":"2023-10-14T16:59:52.483484+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T16:59:52.483484+0000","last_undegraded":"2023-10-14T16:59:52.483484+0000","last_fullsized":"2023-10-14T16:59:52.483484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2297,"log_dups_size":0,"ondisk_log_size":2297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:47.391039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2289,"num_write_kb":13405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"23'485","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.922514+0000","last_change":"2023-10-14T16:59:40.013142+0000","last_active":"2023-10-14T16:59:54.922514+0000","last_peered":"2023-10-14T16:59:54.922514+0000","last_clean":"2023-10-14T16:59:54.922514+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T16:59:54.922514+0000","last_undegraded":"2023-10-14T16:59:54.922514+0000","last_fullsized":"2023-10-14T16:59:54.922514+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038441039000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"21'1506","reported_seq":1523,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972386+0000","last_change":"2023-10-14T16:54:54.103486+0000","last_active":"2023-10-14T16:59:39.972386+0000","last_peered":"2023-10-14T16:59:39.972386+0000","last_clean":"2023-10-14T16:59:39.972386+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T16:59:39.972386+0000","last_undegraded":"2023-10-14T16:59:39.972386+0000","last_fullsized":"2023-10-14T16:59:39.972386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1498,"num_write_kb":8967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"23'532","reported_seq":598,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935883+0000","last_change":"2023-10-14T16:59:40.021641+0000","last_active":"2023-10-14T16:59:54.935883+0000","last_peered":"2023-10-14T16:59:54.935883+0000","last_clean":"2023-10-14T16:59:54.935883+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T16:59:54.935883+0000","last_undegraded":"2023-10-14T16:59:54.935883+0000","last_fullsized":"2023-10-14T16:59:54.935883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047574827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"22'3","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.480173+0000","last_change":"2023-10-14T16:54:54.098087+0000","last_active":"2023-10-14T16:59:40.480173+0000","last_peered":"2023-10-14T16:59:40.480173+0000","last_clean":"2023-10-14T16:59:40.480173+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T16:59:40.480173+0000","last_undegraded":"2023-10-14T16:59:40.480173+0000","last_fullsized":"2023-10-14T16:59:40.480173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:48.428626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'545","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933734+0000","last_change":"2023-10-14T16:59:40.032678+0000","last_active":"2023-10-14T16:59:54.933734+0000","last_peered":"2023-10-14T16:59:54.933734+0000","last_clean":"2023-10-14T16:59:54.933734+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T16:59:54.933734+0000","last_undegraded":"2023-10-14T16:59:54.933734+0000","last_fullsized":"2023-10-14T16:59:54.933734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:21:19.831648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057513697000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"22'5","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:46.477708+0000","last_change":"2023-10-14T16:54:54.099046+0000","last_active":"2023-10-14T16:59:46.477708+0000","last_peered":"2023-10-14T16:59:46.477708+0000","last_clean":"2023-10-14T16:59:46.477708+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T16:59:46.477708+0000","last_undegraded":"2023-10-14T16:59:46.477708+0000","last_fullsized":"2023-10-14T16:59:46.477708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:13.092692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"23'1019","reported_seq":1085,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.940665+0000","last_change":"2023-10-14T16:59:40.049106+0000","last_active":"2023-10-14T16:59:54.940665+0000","last_peered":"2023-10-14T16:59:54.940665+0000","last_clean":"2023-10-14T16:59:54.940665+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T16:59:54.940665+0000","last_undegraded":"2023-10-14T16:59:54.940665+0000","last_fullsized":"2023-10-14T16:59:54.940665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:06.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.07026193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'1511","reported_seq":1528,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.479573+0000","last_change":"2023-10-14T16:54:54.099281+0000","last_active":"2023-10-14T16:59:40.479573+0000","last_peered":"2023-10-14T16:59:40.479573+0000","last_clean":"2023-10-14T16:59:40.479573+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T16:59:40.479573+0000","last_undegraded":"2023-10-14T16:59:40.479573+0000","last_fullsized":"2023-10-14T16:59:40.479573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1511,"log_dups_size":0,"ondisk_log_size":1511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1507,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'585","reported_seq":651,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930146+0000","last_change":"2023-10-14T16:59:40.048352+0000","last_active":"2023-10-14T16:59:54.930146+0000","last_peered":"2023-10-14T16:59:54.930146+0000","last_clean":"2023-10-14T16:59:54.930146+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T16:59:54.930146+0000","last_undegraded":"2023-10-14T16:59:54.930146+0000","last_fullsized":"2023-10-14T16:59:54.930146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071266745000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"23'755","reported_seq":772,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971355+0000","last_change":"2023-10-14T16:54:54.100726+0000","last_active":"2023-10-14T16:59:47.971355+0000","last_peered":"2023-10-14T16:59:47.971355+0000","last_clean":"2023-10-14T16:59:47.971355+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T16:59:47.971355+0000","last_undegraded":"2023-10-14T16:59:47.971355+0000","last_fullsized":"2023-10-14T16:59:47.971355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"23'813","reported_seq":879,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921098+0000","last_change":"2023-10-14T16:59:40.032754+0000","last_active":"2023-10-14T16:59:54.921098+0000","last_peered":"2023-10-14T16:59:54.921098+0000","last_clean":"2023-10-14T16:59:54.921098+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T16:59:54.921098+0000","last_undegraded":"2023-10-14T16:59:54.921098+0000","last_fullsized":"2023-10-14T16:59:54.921098+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057360406000000003,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"22'756","reported_seq":773,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481912+0000","last_change":"2023-10-14T16:54:54.097646+0000","last_active":"2023-10-14T16:59:40.481912+0000","last_peered":"2023-10-14T16:59:40.481912+0000","last_clean":"2023-10-14T16:59:40.481912+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T16:59:40.481912+0000","last_undegraded":"2023-10-14T16:59:40.481912+0000","last_fullsized":"2023-10-14T16:59:40.481912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'593","reported_seq":658,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.932091+0000","last_change":"2023-10-14T16:59:40.012812+0000","last_active":"2023-10-14T16:59:54.932091+0000","last_peered":"2023-10-14T16:59:54.932091+0000","last_clean":"2023-10-14T16:59:54.932091+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T16:59:54.932091+0000","last_undegraded":"2023-10-14T16:59:54.932091+0000","last_fullsized":"2023-10-14T16:59:54.932091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039029367000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'755","reported_seq":772,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:42.475797+0000","last_change":"2023-10-14T16:54:54.100923+0000","last_active":"2023-10-14T16:59:42.475797+0000","last_peered":"2023-10-14T16:59:42.475797+0000","last_clean":"2023-10-14T16:59:42.475797+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T16:59:42.475797+0000","last_undegraded":"2023-10-14T16:59:42.475797+0000","last_fullsized":"2023-10-14T16:59:42.475797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'442","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921947+0000","last_change":"2023-10-14T16:59:40.009237+0000","last_active":"2023-10-14T16:59:54.921947+0000","last_peered":"2023-10-14T16:59:54.921947+0000","last_clean":"2023-10-14T16:59:54.921947+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T16:59:54.921947+0000","last_undegraded":"2023-10-14T16:59:54.921947+0000","last_fullsized":"2023-10-14T16:59:54.921947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036384234000000001,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"23'10","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971383+0000","last_change":"2023-10-14T16:54:54.099363+0000","last_active":"2023-10-14T16:59:47.971383+0000","last_peered":"2023-10-14T16:59:47.971383+0000","last_clean":"2023-10-14T16:59:47.971383+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T16:59:47.971383+0000","last_undegraded":"2023-10-14T16:59:47.971383+0000","last_fullsized":"2023-10-14T16:59:47.971383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.124832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"23'731","reported_seq":797,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937679+0000","last_change":"2023-10-14T16:59:40.046588+0000","last_active":"2023-10-14T16:59:54.937679+0000","last_peered":"2023-10-14T16:59:54.937679+0000","last_clean":"2023-10-14T16:59:54.937679+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T16:59:54.937679+0000","last_undegraded":"2023-10-14T16:59:54.937679+0000","last_fullsized":"2023-10-14T16:59:54.937679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070178661000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'1498","reported_seq":1515,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.487396+0000","last_change":"2023-10-14T16:54:54.093771+0000","last_active":"2023-10-14T16:59:55.487396+0000","last_peered":"2023-10-14T16:59:55.487396+0000","last_clean":"2023-10-14T16:59:55.487396+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T16:59:55.487396+0000","last_undegraded":"2023-10-14T16:59:55.487396+0000","last_fullsized":"2023-10-14T16:59:55.487396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1498,"log_dups_size":0,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":12977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"23'732","reported_seq":798,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939415+0000","last_change":"2023-10-14T16:59:40.007122+0000","last_active":"2023-10-14T16:59:54.939415+0000","last_peered":"2023-10-14T16:59:54.939415+0000","last_clean":"2023-10-14T16:59:54.939415+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T16:59:54.939415+0000","last_undegraded":"2023-10-14T16:59:54.939415+0000","last_fullsized":"2023-10-14T16:59:54.939415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034606716000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"22'3227","reported_seq":3244,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481438+0000","last_change":"2023-10-14T16:54:54.103401+0000","last_active":"2023-10-14T16:59:40.481438+0000","last_peered":"2023-10-14T16:59:40.481438+0000","last_clean":"2023-10-14T16:59:40.481438+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T16:59:40.481438+0000","last_undegraded":"2023-10-14T16:59:40.481438+0000","last_fullsized":"2023-10-14T16:59:40.481438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:28.931284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3218,"num_write_kb":10301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'567","reported_seq":632,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930805+0000","last_change":"2023-10-14T16:59:40.032481+0000","last_active":"2023-10-14T16:59:54.930805+0000","last_peered":"2023-10-14T16:59:54.930805+0000","last_clean":"2023-10-14T16:59:54.930805+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T16:59:54.930805+0000","last_undegraded":"2023-10-14T16:59:54.930805+0000","last_fullsized":"2023-10-14T16:59:54.930805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057531643,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"21'650","reported_seq":667,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974165+0000","last_change":"2023-10-14T16:54:54.099084+0000","last_active":"2023-10-14T16:59:39.974165+0000","last_peered":"2023-10-14T16:59:39.974165+0000","last_clean":"2023-10-14T16:59:39.974165+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T16:59:39.974165+0000","last_undegraded":"2023-10-14T16:59:39.974165+0000","last_fullsized":"2023-10-14T16:59:39.974165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:27.318420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'600","reported_seq":687,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.923665+0000","last_change":"2023-10-14T16:59:40.012352+0000","last_active":"2023-10-14T16:59:54.923665+0000","last_peered":"2023-10-14T16:59:54.923665+0000","last_clean":"2023-10-14T16:59:54.923665+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T16:59:54.923665+0000","last_undegraded":"2023-10-14T16:59:54.923665+0000","last_fullsized":"2023-10-14T16:59:54.923665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:12.562614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038477224999999997,"stat_sum":{"num_bytes":16395,"num_objects":10,"num_object_clones":4,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":32,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"23'757","reported_seq":774,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.115853+0000","last_change":"2023-10-14T16:54:54.095927+0000","last_active":"2023-10-14T16:59:48.115853+0000","last_peered":"2023-10-14T16:59:48.115853+0000","last_clean":"2023-10-14T16:59:48.115853+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T16:59:48.115853+0000","last_undegraded":"2023-10-14T16:59:48.115853+0000","last_fullsized":"2023-10-14T16:59:48.115853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'595","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930450+0000","last_change":"2023-10-14T16:59:40.048170+0000","last_active":"2023-10-14T16:59:54.930450+0000","last_peered":"2023-10-14T16:59:54.930450+0000","last_clean":"2023-10-14T16:59:54.930450+0000","last_became_active":"2023-10-14T16:55:45.058862+0000","last_became_peered":"2023-10-14T16:55:45.058862+0000","last_unstale":"2023-10-14T16:59:54.930450+0000","last_undegraded":"2023-10-14T16:59:54.930450+0000","last_fullsized":"2023-10-14T16:59:54.930450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:08.172437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071388894999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'771","reported_seq":788,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.117367+0000","last_change":"2023-10-14T16:54:54.092032+0000","last_active":"2023-10-14T16:59:48.117367+0000","last_peered":"2023-10-14T16:59:48.117367+0000","last_clean":"2023-10-14T16:59:48.117367+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T16:59:48.117367+0000","last_undegraded":"2023-10-14T16:59:48.117367+0000","last_fullsized":"2023-10-14T16:59:48.117367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973059+0000","last_change":"2023-10-14T16:54:49.689264+0000","last_active":"2023-10-14T16:59:39.973059+0000","last_peered":"2023-10-14T16:59:39.973059+0000","last_clean":"2023-10-14T16:59:39.973059+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T16:59:39.973059+0000","last_undegraded":"2023-10-14T16:59:39.973059+0000","last_fullsized":"2023-10-14T16:59:39.973059+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"23'518","reported_seq":584,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.918996+0000","last_change":"2023-10-14T16:59:40.037294+0000","last_active":"2023-10-14T16:59:54.918996+0000","last_peered":"2023-10-14T16:59:54.918996+0000","last_clean":"2023-10-14T16:59:54.918996+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T16:59:54.918996+0000","last_undegraded":"2023-10-14T16:59:54.918996+0000","last_fullsized":"2023-10-14T16:59:54.918996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061999158999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973570+0000","last_change":"2023-10-14T16:54:49.063336+0000","last_active":"2023-10-14T16:59:39.973570+0000","last_peered":"2023-10-14T16:59:39.973570+0000","last_clean":"2023-10-14T16:59:39.973570+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T16:59:39.973570+0000","last_undegraded":"2023-10-14T16:59:39.973570+0000","last_fullsized":"2023-10-14T16:59:39.973570+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"23'49","reported_seq":66,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.219902+0000","last_change":"2023-10-14T16:54:54.093189+0000","last_active":"2023-10-14T16:59:54.219902+0000","last_peered":"2023-10-14T16:59:54.219902+0000","last_clean":"2023-10-14T16:59:54.219902+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T16:59:54.219902+0000","last_undegraded":"2023-10-14T16:59:54.219902+0000","last_fullsized":"2023-10-14T16:59:54.219902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:47.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'517","reported_seq":583,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.922222+0000","last_change":"2023-10-14T16:59:40.011990+0000","last_active":"2023-10-14T16:59:54.922222+0000","last_peered":"2023-10-14T16:59:54.922222+0000","last_clean":"2023-10-14T16:59:54.922222+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T16:59:54.922222+0000","last_undegraded":"2023-10-14T16:59:54.922222+0000","last_fullsized":"2023-10-14T16:59:54.922222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:48.395824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038513458,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972353+0000","last_change":"2023-10-14T16:54:49.063688+0000","last_active":"2023-10-14T16:59:39.972353+0000","last_peered":"2023-10-14T16:59:39.972353+0000","last_clean":"2023-10-14T16:59:39.972353+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T16:59:39.972353+0000","last_undegraded":"2023-10-14T16:59:39.972353+0000","last_fullsized":"2023-10-14T16:59:39.972353+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:29.004325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974149+0000","last_change":"2023-10-14T16:54:49.063307+0000","last_active":"2023-10-14T16:59:39.974149+0000","last_peered":"2023-10-14T16:59:39.974149+0000","last_clean":"2023-10-14T16:59:39.974149+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T16:59:39.974149+0000","last_undegraded":"2023-10-14T16:59:39.974149+0000","last_fullsized":"2023-10-14T16:59:39.974149+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'76","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.483585+0000","last_change":"2023-10-14T16:54:54.098588+0000","last_active":"2023-10-14T16:59:55.483585+0000","last_peered":"2023-10-14T16:59:55.483585+0000","last_clean":"2023-10-14T16:59:55.483585+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T16:59:55.483585+0000","last_undegraded":"2023-10-14T16:59:55.483585+0000","last_fullsized":"2023-10-14T16:59:55.483585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:18.107600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":646501,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":64,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'754","reported_seq":821,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.940187+0000","last_change":"2023-10-14T16:59:40.048570+0000","last_active":"2023-10-14T16:59:54.940187+0000","last_peered":"2023-10-14T16:59:54.940187+0000","last_clean":"2023-10-14T16:59:54.940187+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T16:59:54.940187+0000","last_undegraded":"2023-10-14T16:59:54.940187+0000","last_fullsized":"2023-10-14T16:59:54.940187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069884818000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972495+0000","last_change":"2023-10-14T16:54:49.689356+0000","last_active":"2023-10-14T16:59:39.972495+0000","last_peered":"2023-10-14T16:59:39.972495+0000","last_clean":"2023-10-14T16:59:39.972495+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T16:59:39.972495+0000","last_undegraded":"2023-10-14T16:59:39.972495+0000","last_fullsized":"2023-10-14T16:59:39.972495+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'2235","reported_seq":2252,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972193+0000","last_change":"2023-10-14T16:54:54.093196+0000","last_active":"2023-10-14T16:59:39.972193+0000","last_peered":"2023-10-14T16:59:39.972193+0000","last_clean":"2023-10-14T16:59:39.972193+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T16:59:39.972193+0000","last_undegraded":"2023-10-14T16:59:39.972193+0000","last_fullsized":"2023-10-14T16:59:39.972193+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2235,"log_dups_size":0,"ondisk_log_size":2235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2227,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'634","reported_seq":700,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935223+0000","last_change":"2023-10-14T16:59:40.021827+0000","last_active":"2023-10-14T16:59:54.935223+0000","last_peered":"2023-10-14T16:59:54.935223+0000","last_clean":"2023-10-14T16:59:54.935223+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T16:59:54.935223+0000","last_undegraded":"2023-10-14T16:59:54.935223+0000","last_fullsized":"2023-10-14T16:59:54.935223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047771027000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974066+0000","last_change":"2023-10-14T16:54:49.689595+0000","last_active":"2023-10-14T16:59:39.974066+0000","last_peered":"2023-10-14T16:59:39.974066+0000","last_clean":"2023-10-14T16:59:39.974066+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T16:59:39.974066+0000","last_undegraded":"2023-10-14T16:59:39.974066+0000","last_fullsized":"2023-10-14T16:59:39.974066+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:46:44.177180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1503","reported_seq":1520,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972138+0000","last_change":"2023-10-14T16:54:54.099381+0000","last_active":"2023-10-14T16:59:39.972138+0000","last_peered":"2023-10-14T16:59:39.972138+0000","last_clean":"2023-10-14T16:59:39.972138+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T16:59:39.972138+0000","last_undegraded":"2023-10-14T16:59:39.972138+0000","last_fullsized":"2023-10-14T16:59:39.972138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"23'759","reported_seq":824,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.931088+0000","last_change":"2023-10-14T16:59:40.032574+0000","last_active":"2023-10-14T16:59:54.931088+0000","last_peered":"2023-10-14T16:59:54.931088+0000","last_clean":"2023-10-14T16:59:54.931088+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T16:59:54.931088+0000","last_undegraded":"2023-10-14T16:59:54.931088+0000","last_fullsized":"2023-10-14T16:59:54.931088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057422879000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974081+0000","last_change":"2023-10-14T16:54:49.689614+0000","last_active":"2023-10-14T16:59:39.974081+0000","last_peered":"2023-10-14T16:59:39.974081+0000","last_clean":"2023-10-14T16:59:39.974081+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T16:59:39.974081+0000","last_undegraded":"2023-10-14T16:59:39.974081+0000","last_fullsized":"2023-10-14T16:59:39.974081+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:09.272835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'741","reported_seq":758,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.483744+0000","last_change":"2023-10-14T16:54:54.100656+0000","last_active":"2023-10-14T16:59:54.483744+0000","last_peered":"2023-10-14T16:59:54.483744+0000","last_clean":"2023-10-14T16:59:54.483744+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T16:59:54.483744+0000","last_undegraded":"2023-10-14T16:59:54.483744+0000","last_fullsized":"2023-10-14T16:59:54.483744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'580","reported_seq":646,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938837+0000","last_change":"2023-10-14T16:59:40.021216+0000","last_active":"2023-10-14T16:59:54.938837+0000","last_peered":"2023-10-14T16:59:54.938837+0000","last_clean":"2023-10-14T16:59:54.938837+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T16:59:54.938837+0000","last_undegraded":"2023-10-14T16:59:54.938837+0000","last_fullsized":"2023-10-14T16:59:54.938837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047665379000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973447+0000","last_change":"2023-10-14T16:54:49.689836+0000","last_active":"2023-10-14T16:59:39.973447+0000","last_peered":"2023-10-14T16:59:39.973447+0000","last_clean":"2023-10-14T16:59:39.973447+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T16:59:39.973447+0000","last_undegraded":"2023-10-14T16:59:39.973447+0000","last_fullsized":"2023-10-14T16:59:39.973447+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:24.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"21'737","reported_seq":754,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973689+0000","last_change":"2023-10-14T16:54:54.096618+0000","last_active":"2023-10-14T16:59:39.973689+0000","last_peered":"2023-10-14T16:59:39.973689+0000","last_clean":"2023-10-14T16:59:39.973689+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T16:59:39.973689+0000","last_undegraded":"2023-10-14T16:59:39.973689+0000","last_fullsized":"2023-10-14T16:59:39.973689+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'697","reported_seq":763,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930425+0000","last_change":"2023-10-14T16:59:40.044773+0000","last_active":"2023-10-14T16:59:54.930425+0000","last_peered":"2023-10-14T16:59:54.930425+0000","last_clean":"2023-10-14T16:59:54.930425+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T16:59:54.930425+0000","last_undegraded":"2023-10-14T16:59:54.930425+0000","last_fullsized":"2023-10-14T16:59:54.930425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068678344000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972989+0000","last_change":"2023-10-14T16:54:49.064767+0000","last_active":"2023-10-14T16:59:39.972989+0000","last_peered":"2023-10-14T16:59:39.972989+0000","last_clean":"2023-10-14T16:59:39.972989+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T16:59:39.972989+0000","last_undegraded":"2023-10-14T16:59:39.972989+0000","last_fullsized":"2023-10-14T16:59:39.972989+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:34:26.616500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"21'1040","reported_seq":1057,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972984+0000","last_change":"2023-10-14T16:54:54.106280+0000","last_active":"2023-10-14T16:59:39.972984+0000","last_peered":"2023-10-14T16:59:39.972984+0000","last_clean":"2023-10-14T16:59:39.972984+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T16:59:39.972984+0000","last_undegraded":"2023-10-14T16:59:39.972984+0000","last_fullsized":"2023-10-14T16:59:39.972984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1040,"log_dups_size":0,"ondisk_log_size":1040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":8695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"23'754","reported_seq":820,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936228+0000","last_change":"2023-10-14T16:59:39.988269+0000","last_active":"2023-10-14T16:59:54.936228+0000","last_peered":"2023-10-14T16:59:54.936228+0000","last_clean":"2023-10-14T16:59:54.936228+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T16:59:54.936228+0000","last_undegraded":"2023-10-14T16:59:54.936228+0000","last_fullsized":"2023-10-14T16:59:54.936228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015859669999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'740","reported_seq":757,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481350+0000","last_change":"2023-10-14T16:54:54.102987+0000","last_active":"2023-10-14T16:59:40.481350+0000","last_peered":"2023-10-14T16:59:40.481350+0000","last_clean":"2023-10-14T16:59:40.481350+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T16:59:40.481350+0000","last_undegraded":"2023-10-14T16:59:40.481350+0000","last_fullsized":"2023-10-14T16:59:40.481350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'627","reported_seq":693,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.929135+0000","last_change":"2023-10-14T16:59:40.021896+0000","last_active":"2023-10-14T16:59:54.929135+0000","last_peered":"2023-10-14T16:59:54.929135+0000","last_clean":"2023-10-14T16:59:54.929135+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T16:59:54.929135+0000","last_undegraded":"2023-10-14T16:59:54.929135+0000","last_fullsized":"2023-10-14T16:59:54.929135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048042644000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"22'754","reported_seq":771,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.480495+0000","last_change":"2023-10-14T16:54:54.095975+0000","last_active":"2023-10-14T16:59:40.480495+0000","last_peered":"2023-10-14T16:59:40.480495+0000","last_clean":"2023-10-14T16:59:40.480495+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T16:59:40.480495+0000","last_undegraded":"2023-10-14T16:59:40.480495+0000","last_fullsized":"2023-10-14T16:59:40.480495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"23'834","reported_seq":900,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938606+0000","last_change":"2023-10-14T16:59:40.012979+0000","last_active":"2023-10-14T16:59:54.938606+0000","last_peered":"2023-10-14T16:59:54.938606+0000","last_clean":"2023-10-14T16:59:54.938606+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T16:59:54.938606+0000","last_undegraded":"2023-10-14T16:59:54.938606+0000","last_fullsized":"2023-10-14T16:59:54.938606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038542571999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2256","reported_seq":2273,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481355+0000","last_change":"2023-10-14T16:54:54.103049+0000","last_active":"2023-10-14T16:59:40.481355+0000","last_peered":"2023-10-14T16:59:40.481355+0000","last_clean":"2023-10-14T16:59:40.481355+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T16:59:40.481355+0000","last_undegraded":"2023-10-14T16:59:40.481355+0000","last_fullsized":"2023-10-14T16:59:40.481355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2256,"log_dups_size":0,"ondisk_log_size":2256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:17:46.369733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2245,"num_write_kb":13441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"23'673","reported_seq":739,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.924367+0000","last_change":"2023-10-14T16:59:40.011333+0000","last_active":"2023-10-14T16:59:54.924367+0000","last_peered":"2023-10-14T16:59:54.924367+0000","last_clean":"2023-10-14T16:59:54.924367+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T16:59:54.924367+0000","last_undegraded":"2023-10-14T16:59:54.924367+0000","last_fullsized":"2023-10-14T16:59:54.924367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038619158000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3072","reported_seq":3089,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.486482+0000","last_change":"2023-10-14T16:54:54.095418+0000","last_active":"2023-10-14T16:59:55.486482+0000","last_peered":"2023-10-14T16:59:55.486482+0000","last_clean":"2023-10-14T16:59:55.486482+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T16:59:55.486482+0000","last_undegraded":"2023-10-14T16:59:55.486482+0000","last_fullsized":"2023-10-14T16:59:55.486482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3072,"log_dups_size":0,"ondisk_log_size":3072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:42.952466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5333059,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3064,"num_write_kb":7239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"23'766","reported_seq":832,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934086+0000","last_change":"2023-10-14T16:59:40.044481+0000","last_active":"2023-10-14T16:59:54.934086+0000","last_peered":"2023-10-14T16:59:54.934086+0000","last_clean":"2023-10-14T16:59:54.934086+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T16:59:54.934086+0000","last_undegraded":"2023-10-14T16:59:54.934086+0000","last_fullsized":"2023-10-14T16:59:54.934086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068737623999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"21'784","reported_seq":801,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.976916+0000","last_change":"2023-10-14T16:54:54.098491+0000","last_active":"2023-10-14T16:59:39.976916+0000","last_peered":"2023-10-14T16:59:39.976916+0000","last_clean":"2023-10-14T16:59:39.976916+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T16:59:39.976916+0000","last_undegraded":"2023-10-14T16:59:39.976916+0000","last_fullsized":"2023-10-14T16:59:39.976916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389162,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'693","reported_seq":757,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934762+0000","last_change":"2023-10-14T16:59:39.998765+0000","last_active":"2023-10-14T16:59:54.934762+0000","last_peered":"2023-10-14T16:59:54.934762+0000","last_clean":"2023-10-14T16:59:54.934762+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T16:59:54.934762+0000","last_undegraded":"2023-10-14T16:59:54.934762+0000","last_fullsized":"2023-10-14T16:59:54.934762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026701018,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"23'669","reported_seq":734,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935703+0000","last_change":"2023-10-14T16:59:39.991721+0000","last_active":"2023-10-14T16:59:54.935703+0000","last_peered":"2023-10-14T16:59:54.935703+0000","last_clean":"2023-10-14T16:59:54.935703+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T16:59:54.935703+0000","last_undegraded":"2023-10-14T16:59:54.935703+0000","last_fullsized":"2023-10-14T16:59:54.935703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01972498,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"23'706","reported_seq":771,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935578+0000","last_change":"2023-10-14T16:59:39.984241+0000","last_active":"2023-10-14T16:59:54.935578+0000","last_peered":"2023-10-14T16:59:54.935578+0000","last_clean":"2023-10-14T16:59:54.935578+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T16:59:54.935578+0000","last_undegraded":"2023-10-14T16:59:54.935578+0000","last_fullsized":"2023-10-14T16:59:54.935578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012044934,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"23'775","reported_seq":840,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938669+0000","last_change":"2023-10-14T16:59:40.032026+0000","last_active":"2023-10-14T16:59:54.938669+0000","last_peered":"2023-10-14T16:59:54.938669+0000","last_clean":"2023-10-14T16:59:54.938669+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T16:59:54.938669+0000","last_undegraded":"2023-10-14T16:59:54.938669+0000","last_fullsized":"2023-10-14T16:59:54.938669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058085603999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"23'600","reported_seq":665,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937844+0000","last_change":"2023-10-14T16:59:40.046985+0000","last_active":"2023-10-14T16:59:54.937844+0000","last_peered":"2023-10-14T16:59:54.937844+0000","last_clean":"2023-10-14T16:59:54.937844+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T16:59:54.937844+0000","last_undegraded":"2023-10-14T16:59:54.937844+0000","last_fullsized":"2023-10-14T16:59:54.937844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070423702000000005,"stat_sum":{"num_bytes":8224,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"23'394","reported_seq":459,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938679+0000","last_change":"2023-10-14T16:59:40.023267+0000","last_active":"2023-10-14T16:59:54.938679+0000","last_peered":"2023-10-14T16:59:54.938679+0000","last_clean":"2023-10-14T16:59:54.938679+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T16:59:54.938679+0000","last_undegraded":"2023-10-14T16:59:54.938679+0000","last_fullsized":"2023-10-14T16:59:54.938679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048708460000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":30,"num_read_kb":20,"num_write":108,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41370,"ondisk_log_size":41370,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":190530350,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":33640,"num_write_kb":203671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381116416,"data_stored":381054111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33839,"ondisk_log_size":33839,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705730,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396524,"kb_used_data":86948,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93975316,"statfs":{"total":96636764160,"available":96230723584,"internally_reserved":0,"allocated":89034752,"data_stored":88829719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39000000000000001,"15min":0.41599999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.55100000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.372},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39900000000000002,"15min":0.42699999999999999},"min":{"1min":0.246,"5min":0.217,"15min":0.217},"max":{"1min":0.60399999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.40300000000000002}]},{"osd":1,"last update":"Sat Oct 14 16:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.437,"15min":0.46700000000000003},"min":{"1min":0.27700000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.64900000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.439},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.437,"15min":0.46700000000000003},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.66100000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Oct 14 16:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.315,"15min":0.34499999999999997},"min":{"1min":0.19800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.437,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.308,"5min":0.32000000000000001,"15min":0.34899999999999998},"min":{"1min":0.20399999999999999,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.45400000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.38400000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705730,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426360,"kb_used_data":116784,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93945480,"statfs":{"total":96636764160,"available":96200171520,"internally_reserved":0,"allocated":119586816,"data_stored":119357205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.46300000000000002,"15min":0.44900000000000001},"min":{"1min":0.22,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.57299999999999995,"5min":5.992,"15min":5.992},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.503,"15min":0.46200000000000002},"min":{"1min":0.218,"5min":0.215,"15min":0.215},"max":{"1min":0.59599999999999997,"5min":9.2620000000000005,"15min":9.2620000000000005},"last":0.56499999999999995}]},{"osd":1,"last update":"Sat Oct 14 16:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55800000000000005,"5min":6.266,"15min":6.266},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.54300000000000004,"15min":0.49299999999999999},"min":{"1min":0.25600000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.61499999999999999,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":0.503}]},{"osd":3,"last update":"Sat Oct 14 16:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.317,"15min":0.31900000000000001},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.45900000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.316},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.38100000000000001,"15min":0.35799999999999998},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.503,"5min":6.3170000000000002,"15min":6.3170000000000002},"last":0.34699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705729,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397668,"kb_used_data":92188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":93974172,"statfs":{"total":96636764160,"available":96229552128,"internally_reserved":0,"allocated":94400512,"data_stored":94210119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.27200000000000002,"15min":0.29599999999999999},"min":{"1min":0.20799999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.318},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.50800000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.45700000000000002},"min":{"1min":0.24099999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56299999999999994,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.46500000000000002},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61399999999999999,"5min":0.629,"15min":0.629},"last":0.432}]},{"osd":3,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29299999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.63300000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.45100000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705730,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388312,"kb_used_data":78736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93983528,"statfs":{"total":96636764160,"available":96239132672,"internally_reserved":0,"allocated":80625664,"data_stored":80427560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.27400000000000002},"min":{"1min":0.21099999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.28699999999999998,"15min":0.29899999999999999},"min":{"1min":0.24099999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42599999999999999,"15min":0.45700000000000002},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42199999999999999,"15min":0.46100000000000002},"min":{"1min":0.28399999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63900000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.67100000000000004}]},{"osd":3,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.45300000000000001},"min":{"1min":0.29699999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.59699999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.48599999999999999},"min":{"1min":0.33500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94076928,"data_stored":94060658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":79691776,"data_stored":79691776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":119242752,"data_stored":119219969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88104960,"data_stored":88081708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":53391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":73798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T17:00:03.310 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T17:00:03.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.461+0000 7f9f65e52700 1 Processor -- start 2023-10-14T17:00:03.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.461+0000 7f9f65e52700 1 -- start start 2023-10-14T17:00:03.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.462+0000 7f9f65e52700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9f600a6550 0x7f9f60133e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.462+0000 7f9f65e52700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f600a6920 0x7f9f60136d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.462+0000 7f9f65e52700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f60133940 con 0x7f9f60111f90 2023-10-14T17:00:03.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.462+0000 7f9f65e52700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f60133750 con 0x7f9f600a6550 2023-10-14T17:00:03.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.462+0000 7f9f65e52700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f60133be0 con 0x7f9f600a6920 2023-10-14T17:00:03.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.462+0000 7f9f5ffff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9f60111f90 0x7f9f60137290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40402/0 (socket says 172.21.15.8:40402) 2023-10-14T17:00:03.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.462+0000 7f9f5ffff700 1 -- 172.21.15.8:0/2786933759 learned_addr learned my addr 172.21.15.8:0/2786933759 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:00:03.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.462+0000 7f9f5f7fe700 1 --2- 172.21.15.8:0/2786933759 >> v2:172.21.15.155:3300/0 conn(0x7f9f600a6550 0x7f9f60133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.462+0000 7f9f5effd700 1 --2- 172.21.15.8:0/2786933759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f600a6920 0x7f9f60136d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.462+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699597365 0 0) 0x7f9f60133940 con 0x7f9f60111f90 2023-10-14T17:00:03.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.462+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f48003570 con 0x7f9f60111f90 2023-10-14T17:00:03.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1965763842 0 0) 0x7f9f48003570 con 0x7f9f60111f90 2023-10-14T17:00:03.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f600a6920 msgr2=0x7f9f60136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:03.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 --2- 172.21.15.8:0/2786933759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f600a6920 0x7f9f60136d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 >> v2:172.21.15.155:3300/0 conn(0x7f9f600a6550 msgr2=0x7f9f60133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:03.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 --2- 172.21.15.8:0/2786933759 >> v2:172.21.15.155:3300/0 conn(0x7f9f600a6550 0x7f9f60133e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60112780 con 0x7f9f60111f90 2023-10-14T17:00:03.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f9f580017f0 con 0x7f9f60111f90 2023-10-14T17:00:03.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 >> v1:172.21.15.8:6789/0 conn(0x7f9f60111f90 legacy=0x7f9f60137290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:03.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 --2- 172.21.15.8:0/2786933759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f48003a60 0x7f9f48003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 --2- 172.21.15.8:0/2786933759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f600a6920 0x7f9f48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 --2- 172.21.15.8:0/2786933759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f48004d50 0x7f9f480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f60133be0 con 0x7f9f48003a60 2023-10-14T17:00:03.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4800ba90 con 0x7f9f48004d50 2023-10-14T17:00:03.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4800bc50 con 0x7f9f600a6920 2023-10-14T17:00:03.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5f7fe700 1 --2- 172.21.15.8:0/2786933759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f48003a60 0x7f9f48003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5effd700 1 --2- 172.21.15.8:0/2786933759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f600a6920 0x7f9f48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5ffff700 1 --2- 172.21.15.8:0/2786933759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f48004d50 0x7f9f480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5f7fe700 1 -- 172.21.15.8:0/2786933759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f600a6920 msgr2=0x7f9f48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:03.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5f7fe700 1 --2- 172.21.15.8:0/2786933759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f600a6920 0x7f9f48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5f7fe700 1 -- 172.21.15.8:0/2786933759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f48004d50 msgr2=0x7f9f480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5f7fe700 1 --2- 172.21.15.8:0/2786933759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f48004d50 0x7f9f480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5f7fe700 1 -- 172.21.15.8:0/2786933759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f48003570 con 0x7f9f48003a60 2023-10-14T17:00:03.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5f7fe700 1 --2- 172.21.15.8:0/2786933759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f48003a60 0x7f9f48003e70 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f9f50009c00 tx=0x7f9f500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2246efa239251d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:03.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5000e710 con 0x7f9f48003a60 2023-10-14T17:00:03.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5000e870 con 0x7f9f48003a60 2023-10-14T17:00:03.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.463+0000 7f9f5e7fc700 1 -- 172.21.15.8:0/2786933759 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5000ec30 con 0x7f9f48003a60 2023-10-14T17:00:03.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.464+0000 7f9f65e52700 1 -- 172.21.15.8:0/2786933759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f48003a60 msgr2=0x7f9f48003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:03.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.464+0000 7f9f65e52700 1 --2- 172.21.15.8:0/2786933759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f48003a60 0x7f9f48003e70 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f9f50009c00 tx=0x7f9f500091a0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.464+0000 7f9f5ffff700 1 -- 172.21.15.8:0/2786933759 reap_dead start 2023-10-14T17:00:03.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.464+0000 7f9f65e52700 1 -- 172.21.15.8:0/2786933759 shutdown_connections 2023-10-14T17:00:03.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.464+0000 7f9f65e52700 1 -- 172.21.15.8:0/2786933759 >> 172.21.15.8:0/2786933759 conn(0x7f9f6006ac40 msgr2=0x7f9f600701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:03.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.464+0000 7f9f65e52700 1 -- 172.21.15.8:0/2786933759 shutdown_connections 2023-10-14T17:00:03.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.464+0000 7f9f65e52700 1 -- 172.21.15.8:0/2786933759 wait complete. 2023-10-14T17:00:03.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.465+0000 7f9f65e52700 1 Processor -- start 2023-10-14T17:00:03.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.465+0000 7f9f65e52700 1 -- start start 2023-10-14T17:00:03.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.465+0000 7f9f65e52700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f48003a60 0x7f9f60134ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f65e52700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f60135530 0x7f9f60135940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f65e52700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f60146510 0x7f9f60146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f65e52700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f60115c70 con 0x7f9f60146510 2023-10-14T17:00:03.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f65e52700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f60135e80 con 0x7f9f60135530 2023-10-14T17:00:03.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f65e52700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f60136cd0 con 0x7f9f48003a60 2023-10-14T17:00:03.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f5ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f60146510 0x7f9f60146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f5ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f60146510 0x7f9f60146990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60178/0 (socket says 172.21.15.8:60178) 2023-10-14T17:00:03.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f5ffff700 1 -- 172.21.15.8:0/3899239606 learned_addr learned my addr 172.21.15.8:0/3899239606 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:03.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f5effd700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f60135530 0x7f9f60135940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f5f7fe700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f48003a60 0x7f9f60134ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f5ffff700 1 -- 172.21.15.8:0/3899239606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f48003a60 msgr2=0x7f9f60134ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:03.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f5ffff700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f48003a60 0x7f9f60134ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f5ffff700 1 -- 172.21.15.8:0/3899239606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f60135530 msgr2=0x7f9f60135940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:03.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f5ffff700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f60135530 0x7f9f60135940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f5ffff700 1 -- 172.21.15.8:0/3899239606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60114a40 con 0x7f9f60146510 2023-10-14T17:00:03.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f5effd700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f60135530 0x7f9f60135940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:00:03.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f5ffff700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f60146510 0x7f9f60146990 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f9f601123f0 tx=0x7f9f580021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:03.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f477fe700 1 -- 172.21.15.8:0/3899239606 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5800adb0 con 0x7f9f60146510 2023-10-14T17:00:03.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f477fe700 1 -- 172.21.15.8:0/3899239606 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f580133f0 con 0x7f9f60146510 2023-10-14T17:00:03.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f65e52700 1 -- 172.21.15.8:0/3899239606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f60115730 con 0x7f9f60146510 2023-10-14T17:00:03.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f477fe700 1 -- 172.21.15.8:0/3899239606 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f580137f0 con 0x7f9f60146510 2023-10-14T17:00:03.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.466+0000 7f9f65e52700 1 -- 172.21.15.8:0/3899239606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f601379b0 con 0x7f9f60146510 2023-10-14T17:00:03.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.467+0000 7f9f65e52700 1 -- 172.21.15.8:0/3899239606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6012edf0 con 0x7f9f60146510 2023-10-14T17:00:03.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.468+0000 7f9f477fe700 1 -- 172.21.15.8:0/3899239606 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f58013c20 con 0x7f9f60146510 2023-10-14T17:00:03.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.468+0000 7f9f477fe700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9f4c066f30 0x7f9f4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:03.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.468+0000 7f9f477fe700 1 -- 172.21.15.8:0/3899239606 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f9f580846e0 con 0x7f9f60146510 2023-10-14T17:00:03.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.468+0000 7f9f5f7fe700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9f4c066f30 0x7f9f4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:03.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.468+0000 7f9f5f7fe700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9f4c066f30 0x7f9f4c0693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f500091e0 tx=0x7f9f5001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:03.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.472+0000 7f9f477fe700 1 -- 172.21.15.8:0/3899239606 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f58051e70 con 0x7f9f60146510 2023-10-14T17:00:03.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.666+0000 7f9f65e52700 1 -- 172.21.15.8:0/3899239606 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f600708d0 con 0x7f9f60146510 2023-10-14T17:00:03.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.667+0000 7f9f477fe700 1 -- 172.21.15.8:0/3899239606 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12273 (secure 0 0 0) 0x7f9f58055490 con 0x7f9f60146510 2023-10-14T17:00:03.668 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:00:03.669 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:59:47.965865+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-14T16:54:52.330193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-14T16:54:53.459270+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":14,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T17:00:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.669+0000 7f9f65e52700 1 -- 172.21.15.8:0/3899239606 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9f4c066f30 msgr2=0x7f9f4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.669+0000 7f9f65e52700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9f4c066f30 0x7f9f4c0693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f500091e0 tx=0x7f9f5001a000 comp rx=0 tx=0).stop 2023-10-14T17:00:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.669+0000 7f9f65e52700 1 -- 172.21.15.8:0/3899239606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f60146510 msgr2=0x7f9f60146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.669+0000 7f9f65e52700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f60146510 0x7f9f60146990 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f9f601123f0 tx=0x7f9f580021d0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.669+0000 7f9f65e52700 1 -- 172.21.15.8:0/3899239606 shutdown_connections 2023-10-14T17:00:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.669+0000 7f9f65e52700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9f4c066f30 0x7f9f4c0693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.669+0000 7f9f65e52700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f60146510 0x7f9f60146990 unknown :-1 s=CLOSED pgs=2466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.669+0000 7f9f65e52700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f48003a60 0x7f9f60134ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.669+0000 7f9f65e52700 1 --2- 172.21.15.8:0/3899239606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f60135530 0x7f9f60135940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:03.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.669+0000 7f9f65e52700 1 -- 172.21.15.8:0/3899239606 >> 172.21.15.8:0/3899239606 conn(0x7f9f6006ac40 msgr2=0x7f9f6013a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:03.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.669+0000 7f9f65e52700 1 -- 172.21.15.8:0/3899239606 shutdown_connections 2023-10-14T17:00:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:03.669+0000 7f9f65e52700 1 -- 172.21.15.8:0/3899239606 wait complete. 2023-10-14T17:00:04.682 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T17:00:04.683 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T17:00:04.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.810+0000 7fada8b41700 1 Processor -- start 2023-10-14T17:00:04.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.810+0000 7fada8b41700 1 -- start start 2023-10-14T17:00:04.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.811+0000 7fada8b41700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fada40a14f0 0x7fada4136f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.811+0000 7fada8b41700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada40a2b80 con 0x7fada41374c0 2023-10-14T17:00:04.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.811+0000 7fada8b41700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada40a1a00 con 0x7fada40a4ec0 2023-10-14T17:00:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.811+0000 7fada8b41700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada4136b70 con 0x7fada40a14f0 2023-10-14T17:00:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.811+0000 7fada1d9b700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fada41374c0 0x7fada40a47b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40412/0 (socket says 172.21.15.8:40412) 2023-10-14T17:00:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.811+0000 7fada1d9b700 1 -- 172.21.15.8:0/205004647 learned_addr learned my addr 172.21.15.8:0/205004647 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:00:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.811+0000 7fada259c700 1 --2- 172.21.15.8:0/205004647 >> v2:172.21.15.155:3300/0 conn(0x7fada40a14f0 0x7fada4136f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598745588 0 0) 0x7fada40a2b80 con 0x7fada41374c0 2023-10-14T17:00:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad90003570 con 0x7fada41374c0 2023-10-14T17:00:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221059820 0 0) 0x7fada40a1a00 con 0x7fada40a4ec0 2023-10-14T17:00:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fada40a2b80 con 0x7fada40a4ec0 2023-10-14T17:00:04.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3951948578 0 0) 0x7fad90003570 con 0x7fada41374c0 2023-10-14T17:00:04.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 >> v2:172.21.15.155:3300/0 conn(0x7fada40a14f0 msgr2=0x7fada4136f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:04.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 --2- 172.21.15.8:0/205004647 >> v2:172.21.15.155:3300/0 conn(0x7fada40a14f0 0x7fada4136f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:04.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 >> v1:172.21.15.155:6789/0 conn(0x7fada40a4ec0 legacy=0x7fada413ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:04.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada40aa090 con 0x7fada41374c0 2023-10-14T17:00:04.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7fad8c001470 con 0x7fada41374c0 2023-10-14T17:00:04.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada259c700 1 --2- 172.21.15.8:0/205004647 >> v2:172.21.15.155:3300/0 conn(0x7fada40a14f0 0x7fada4136f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T17:00:04.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 >> v1:172.21.15.8:6789/0 conn(0x7fada41374c0 legacy=0x7fada40a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:04.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 --2- 172.21.15.8:0/205004647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad90003c40 0x7fad90004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 --2- 172.21.15.8:0/205004647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad90004810 0x7fad90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 --2- 172.21.15.8:0/205004647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad90005210 0x7fad9000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada4136b70 con 0x7fad90005210 2023-10-14T17:00:04.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9000c1b0 con 0x7fad90004810 2023-10-14T17:00:04.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9000c370 con 0x7fad90003c40 2023-10-14T17:00:04.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada2d9d700 1 --2- 172.21.15.8:0/205004647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad90005210 0x7fad9000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada1d9b700 1 --2- 172.21.15.8:0/205004647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad90004810 0x7fad90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada259c700 1 --2- 172.21.15.8:0/205004647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad90003c40 0x7fad90004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada2d9d700 1 -- 172.21.15.8:0/205004647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad90003c40 msgr2=0x7fad90004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada2d9d700 1 --2- 172.21.15.8:0/205004647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad90003c40 0x7fad90004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada2d9d700 1 -- 172.21.15.8:0/205004647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad90004810 msgr2=0x7fad90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada2d9d700 1 --2- 172.21.15.8:0/205004647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad90004810 0x7fad90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada2d9d700 1 -- 172.21.15.8:0/205004647 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90003570 con 0x7fad90005210 2023-10-14T17:00:04.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada259c700 1 --2- 172.21.15.8:0/205004647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad90003c40 0x7fad90004050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:00:04.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.812+0000 7fada2d9d700 1 -- 172.21.15.8:0/205004647 reap_dead start 2023-10-14T17:00:04.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.813+0000 7fada2d9d700 1 --2- 172.21.15.8:0/205004647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad90005210 0x7fad9000ba60 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7fad9c001a10 tx=0x7fad9c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf309eb325468bb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:04.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.813+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c00c5d0 con 0x7fad90005210 2023-10-14T17:00:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.813+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c00c730 con 0x7fad90005210 2023-10-14T17:00:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.813+0000 7fada159a700 1 -- 172.21.15.8:0/205004647 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c00cad0 con 0x7fad90005210 2023-10-14T17:00:04.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.813+0000 7fada8b41700 1 -- 172.21.15.8:0/205004647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad90005210 msgr2=0x7fad9000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:04.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.813+0000 7fada8b41700 1 --2- 172.21.15.8:0/205004647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad90005210 0x7fad9000ba60 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7fad9c001a10 tx=0x7fad9c007d30 comp rx=0 tx=0).stop 2023-10-14T17:00:04.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.813+0000 7fada8b41700 1 -- 172.21.15.8:0/205004647 shutdown_connections 2023-10-14T17:00:04.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.813+0000 7fada8b41700 1 --2- 172.21.15.8:0/205004647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad90005210 0x7fad9000ba60 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.813+0000 7fada8b41700 1 -- 172.21.15.8:0/205004647 >> 172.21.15.8:0/205004647 conn(0x7fada406a980 msgr2=0x7fada40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.813+0000 7fada8b41700 1 -- 172.21.15.8:0/205004647 shutdown_connections 2023-10-14T17:00:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.813+0000 7fada8b41700 1 -- 172.21.15.8:0/205004647 wait complete. 2023-10-14T17:00:04.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.814+0000 7fada8b41700 1 Processor -- start 2023-10-14T17:00:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.814+0000 7fada8b41700 1 -- start start 2023-10-14T17:00:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada8b41700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad90005210 0x7fada4132810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada8b41700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fada4132d50 0x7fada409ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada8b41700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fada41331a0 0x7fada409b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada8b41700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada409edc0 con 0x7fad90005210 2023-10-14T17:00:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada8b41700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada40a0400 con 0x7fada41331a0 2023-10-14T17:00:04.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada8b41700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada409fc80 con 0x7fada4132d50 2023-10-14T17:00:04.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad90005210 0x7fada4132810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad90005210 0x7fada4132810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60198/0 (socket says 172.21.15.8:60198) 2023-10-14T17:00:04.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada259c700 1 -- 172.21.15.8:0/3275008920 learned_addr learned my addr 172.21.15.8:0/3275008920 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:04.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada1d9b700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fada4132d50 0x7fada409ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada2d9d700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fada41331a0 0x7fada409b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada259c700 1 -- 172.21.15.8:0/3275008920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fada4132d50 msgr2=0x7fada409ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:04.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada259c700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fada4132d50 0x7fada409ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:04.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada259c700 1 -- 172.21.15.8:0/3275008920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fada41331a0 msgr2=0x7fada409b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:04.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada259c700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fada41331a0 0x7fada409b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:04.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada259c700 1 -- 172.21.15.8:0/3275008920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada409eb00 con 0x7fad90005210 2023-10-14T17:00:04.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada2d9d700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fada41331a0 0x7fada409b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:00:04.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada1d9b700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fada4132d50 0x7fada409ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:00:04.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada259c700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad90005210 0x7fada4132810 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7fad94009750 tx=0x7fad9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:04.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fad9a7fc700 1 -- 172.21.15.8:0/3275008920 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9400e030 con 0x7fad90005210 2023-10-14T17:00:04.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fad9a7fc700 1 -- 172.21.15.8:0/3275008920 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad94016470 con 0x7fad90005210 2023-10-14T17:00:04.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada8b41700 1 -- 172.21.15.8:0/3275008920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada40a0930 con 0x7fad90005210 2023-10-14T17:00:04.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fad9a7fc700 1 -- 172.21.15.8:0/3275008920 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad940167f0 con 0x7fad90005210 2023-10-14T17:00:04.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.815+0000 7fada8b41700 1 -- 172.21.15.8:0/3275008920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada40a0630 con 0x7fad90005210 2023-10-14T17:00:04.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.816+0000 7fada8b41700 1 -- 172.21.15.8:0/3275008920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fada406ad80 con 0x7fad90005210 2023-10-14T17:00:04.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.817+0000 7fad9a7fc700 1 -- 172.21.15.8:0/3275008920 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad94016b60 con 0x7fad90005210 2023-10-14T17:00:04.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.817+0000 7fad9a7fc700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fad84066f60 0x7fad84069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.817+0000 7fad9a7fc700 1 -- 172.21.15.8:0/3275008920 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7fad9400f070 con 0x7fad90005210 2023-10-14T17:00:04.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.817+0000 7fada1d9b700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fad84066f60 0x7fad84069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.817+0000 7fad9a7fc700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] conn(0x7fad8406ec80 0x7fad840710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.817+0000 7fad9a7fc700 1 -- 172.21.15.8:0/3275008920 --> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad840717c0 con 0x7fad8406ec80 2023-10-14T17:00:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.817+0000 7fad9a7fc700 1 -- 172.21.15.8:0/3275008920 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad94085be0 con 0x7fad90005210 2023-10-14T17:00:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.818+0000 7fada2d9d700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] conn(0x7fad8406ec80 0x7fad840710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.818+0000 7fada1d9b700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fad84066f60 0x7fad84069410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fad8c001bb0 tx=0x7fad8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:04.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.818+0000 7fada2d9d700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] conn(0x7fad8406ec80 0x7fad840710f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:04.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.818+0000 7fad9a7fc700 1 -- 172.21.15.8:0/3275008920 <== osd.0 v2:172.21.15.8:6800/86152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fad840717c0 con 0x7fad8406ec80 2023-10-14T17:00:04.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.832+0000 7fada8b41700 1 -- 172.21.15.8:0/3275008920 --> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fada409ef80 con 0x7fad8406ec80 2023-10-14T17:00:04.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.833+0000 7fad9a7fc700 1 -- 172.21.15.8:0/3275008920 <== osd.0 v2:172.21.15.8:6800/86152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fada409ef80 con 0x7fad8406ec80 2023-10-14T17:00:04.843 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T17:00:04.844 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T17:00:04.844 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T17:00:04.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.833+0000 7fada8b41700 1 -- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] conn(0x7fad8406ec80 msgr2=0x7fad840710f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:04.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.833+0000 7fada8b41700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:6800/86152,v1:172.21.15.8:6801/86152] conn(0x7fad8406ec80 0x7fad840710f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:04.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.833+0000 7fada8b41700 1 -- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fad84066f60 msgr2=0x7fad84069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:04.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.833+0000 7fada8b41700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fad84066f60 0x7fad84069410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fad8c001bb0 tx=0x7fad8c009040 comp rx=0 tx=0).stop 2023-10-14T17:00:04.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.833+0000 7fada8b41700 1 -- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad90005210 msgr2=0x7fada4132810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:04.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.833+0000 7fada8b41700 1 --2- 172.21.15.8:0/3275008920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad90005210 0x7fada4132810 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7fad94009750 tx=0x7fad9400b040 comp rx=0 tx=0).stop 2023-10-14T17:00:04.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.833+0000 7fada2d9d700 1 -- 172.21.15.8:0/3275008920 reap_dead start 2023-10-14T17:00:04.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.833+0000 7fada8b41700 1 -- 172.21.15.8:0/3275008920 shutdown_connections 2023-10-14T17:00:04.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.833+0000 7fada8b41700 1 -- 172.21.15.8:0/3275008920 >> 172.21.15.8:0/3275008920 conn(0x7fada406a980 msgr2=0x7fada40a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:04.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.833+0000 7fada8b41700 1 -- 172.21.15.8:0/3275008920 shutdown_connections 2023-10-14T17:00:04.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.833+0000 7fada8b41700 1 -- 172.21.15.8:0/3275008920 wait complete. 2023-10-14T17:00:04.849 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-14T17:00:04.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.967+0000 7f0ed2e45700 1 Processor -- start 2023-10-14T17:00:04.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.967+0000 7f0ed2e45700 1 -- start start 2023-10-14T17:00:04.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed2e45700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ecc0a6940 0x7f0ecc0a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed2e45700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0ecc13c1a0 0x7f0ecc13e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed2e45700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ecc0a2df0 con 0x7f0ecc0a25c0 2023-10-14T17:00:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed2e45700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ecc1338f0 con 0x7f0ecc0a6940 2023-10-14T17:00:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed2e45700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ecc133ae0 con 0x7f0ecc13c1a0 2023-10-14T17:00:04.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed0be1700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ecc0a6940 0x7f0ecc0a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed0be1700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ecc0a6940 0x7f0ecc0a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60212/0 (socket says 172.21.15.8:60212) 2023-10-14T17:00:04.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed0be1700 1 -- 172.21.15.8:0/1570451804 learned_addr learned my addr 172.21.15.8:0/1570451804 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:04.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed13e2700 1 --2- 172.21.15.8:0/1570451804 >> v2:172.21.15.155:3300/0 conn(0x7f0ecc13c1a0 0x7f0ecc13e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed0be1700 1 -- 172.21.15.8:0/1570451804 >> v2:172.21.15.155:3300/0 conn(0x7f0ecc13c1a0 msgr2=0x7f0ecc13e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:04.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed0be1700 1 --2- 172.21.15.8:0/1570451804 >> v2:172.21.15.155:3300/0 conn(0x7f0ecc13c1a0 0x7f0ecc13e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:04.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed0be1700 1 -- 172.21.15.8:0/1570451804 >> v1:172.21.15.155:6789/0 conn(0x7f0ecc0a25c0 legacy=0x7f0ecc133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:04.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed0be1700 1 -- 172.21.15.8:0/1570451804 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc0a1b90 con 0x7f0ecc0a6940 2023-10-14T17:00:04.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.968+0000 7f0ed0be1700 1 --2- 172.21.15.8:0/1570451804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0a6940 0x7f0ecc0a1310 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0a7450 tx=0x7f0ebc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593dd4bdefbe1b0f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:04.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.969+0000 7f0ecb7fe700 1 -- 172.21.15.8:0/1570451804 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc009e70 con 0x7f0ecc0a6940 2023-10-14T17:00:04.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.969+0000 7f0ecb7fe700 1 -- 172.21.15.8:0/1570451804 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc00b860 con 0x7f0ecc0a6940 2023-10-14T17:00:04.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.969+0000 7f0ecb7fe700 1 -- 172.21.15.8:0/1570451804 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc00bc20 con 0x7f0ecc0a6940 2023-10-14T17:00:04.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.969+0000 7f0ed2e45700 1 -- 172.21.15.8:0/1570451804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0a6940 msgr2=0x7f0ecc0a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:04.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.969+0000 7f0ed2e45700 1 --2- 172.21.15.8:0/1570451804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0a6940 0x7f0ecc0a1310 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0a7450 tx=0x7f0ebc009250 comp rx=0 tx=0).stop 2023-10-14T17:00:04.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.969+0000 7f0ed2e45700 1 -- 172.21.15.8:0/1570451804 shutdown_connections 2023-10-14T17:00:04.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.969+0000 7f0ed2e45700 1 --2- 172.21.15.8:0/1570451804 >> v2:172.21.15.155:3300/0 conn(0x7f0ecc13c1a0 0x7f0ecc13e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:04.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.969+0000 7f0ed2e45700 1 --2- 172.21.15.8:0/1570451804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc0a6940 0x7f0ecc0a1310 unknown :-1 s=CLOSED pgs=2470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:04.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.969+0000 7f0ed2e45700 1 -- 172.21.15.8:0/1570451804 >> 172.21.15.8:0/1570451804 conn(0x7f0ecc06acd0 msgr2=0x7f0ecc0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:04.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.969+0000 7f0ed2e45700 1 -- 172.21.15.8:0/1570451804 shutdown_connections 2023-10-14T17:00:04.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.969+0000 7f0ed2e45700 1 -- 172.21.15.8:0/1570451804 wait complete. 2023-10-14T17:00:04.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.970+0000 7f0ed2e45700 1 Processor -- start 2023-10-14T17:00:04.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.970+0000 7f0ed2e45700 1 -- start start 2023-10-14T17:00:04.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ed2e45700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ecc0a25c0 0x7f0ecc138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ed2e45700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc13c1a0 0x7f0ecc1437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ed2e45700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ecc143d30 0x7f0ecc144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ed2e45700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc139df0 con 0x7f0ecc13c1a0 2023-10-14T17:00:04.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ed2e45700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc137bb0 con 0x7f0ecc143d30 2023-10-14T17:00:04.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ed2e45700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc13a310 con 0x7f0ecc0a25c0 2023-10-14T17:00:04.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ecbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc13c1a0 0x7f0ecc1437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ecbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc13c1a0 0x7f0ecc1437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60222/0 (socket says 172.21.15.8:60222) 2023-10-14T17:00:04.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ecbfff700 1 -- 172.21.15.8:0/137339994 learned_addr learned my addr 172.21.15.8:0/137339994 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:04.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ed13e2700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ecc143d30 0x7f0ecc144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ed0be1700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ecc0a25c0 0x7f0ecc138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ecbfff700 1 -- 172.21.15.8:0/137339994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ecc0a25c0 msgr2=0x7f0ecc138ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:04.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ecbfff700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ecc0a25c0 0x7f0ecc138ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:04.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ecbfff700 1 -- 172.21.15.8:0/137339994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ecc143d30 msgr2=0x7f0ecc144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:04.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ecbfff700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ecc143d30 0x7f0ecc144190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:04.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ecbfff700 1 -- 172.21.15.8:0/137339994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc0094f0 con 0x7f0ecc13c1a0 2023-10-14T17:00:04.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ecbfff700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc13c1a0 0x7f0ecc1437f0 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000c590 tx=0x7f0ec000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:04.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.971+0000 7f0ec8ff9700 1 -- 172.21.15.8:0/137339994 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0011590 con 0x7f0ecc13c1a0 2023-10-14T17:00:04.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.972+0000 7f0ec8ff9700 1 -- 172.21.15.8:0/137339994 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec0011710 con 0x7f0ecc13c1a0 2023-10-14T17:00:04.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.972+0000 7f0ed2e45700 1 -- 172.21.15.8:0/137339994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc13a020 con 0x7f0ecc13c1a0 2023-10-14T17:00:04.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.972+0000 7f0ec8ff9700 1 -- 172.21.15.8:0/137339994 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0011ad0 con 0x7f0ecc13c1a0 2023-10-14T17:00:04.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.972+0000 7f0ed2e45700 1 -- 172.21.15.8:0/137339994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ecc139530 con 0x7f0ecc13c1a0 2023-10-14T17:00:04.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.973+0000 7f0ed2e45700 1 -- 172.21.15.8:0/137339994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ecc13a710 con 0x7f0ecc13c1a0 2023-10-14T17:00:04.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.973+0000 7f0ec8ff9700 1 -- 172.21.15.8:0/137339994 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ec001b3b0 con 0x7f0ecc13c1a0 2023-10-14T17:00:04.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.973+0000 7f0ec8ff9700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0eb8066f30 0x7f0eb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:04.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.974+0000 7f0ec8ff9700 1 -- 172.21.15.8:0/137339994 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f0ec0083440 con 0x7f0ecc13c1a0 2023-10-14T17:00:04.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.974+0000 7f0ed0be1700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0eb8066f30 0x7f0eb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:04.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.974+0000 7f0ed0be1700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0eb8066f30 0x7f0eb80693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0a7450 tx=0x7f0ebc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:04.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:04.978+0000 7f0ec8ff9700 1 -- 172.21.15.8:0/137339994 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ecc13a710 con 0x7f0ecc13c1a0 2023-10-14T17:00:05.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.170+0000 7f0ed2e45700 1 -- 172.21.15.8:0/137339994 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ecc13a710 con 0x7f0eb8066f30 2023-10-14T17:00:05.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.170+0000 7f0ec8ff9700 1 -- 172.21.15.8:0/137339994 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0ecc13a710 con 0x7f0eb8066f30 2023-10-14T17:00:05.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.172+0000 7f0ed2e45700 1 -- 172.21.15.8:0/137339994 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0eb8066f30 msgr2=0x7f0eb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.172+0000 7f0ed2e45700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0eb8066f30 0x7f0eb80693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0a7450 tx=0x7f0ebc017000 comp rx=0 tx=0).stop 2023-10-14T17:00:05.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.172+0000 7f0ed2e45700 1 -- 172.21.15.8:0/137339994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc13c1a0 msgr2=0x7f0ecc1437f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.172+0000 7f0ed2e45700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc13c1a0 0x7f0ecc1437f0 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000c590 tx=0x7f0ec000c8a0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.172+0000 7f0ed2e45700 1 -- 172.21.15.8:0/137339994 shutdown_connections 2023-10-14T17:00:05.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.172+0000 7f0ed2e45700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0eb8066f30 0x7f0eb80693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.172+0000 7f0ed2e45700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ecc143d30 0x7f0ecc144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.172+0000 7f0ed2e45700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ecc0a25c0 0x7f0ecc138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.172+0000 7f0ed2e45700 1 --2- 172.21.15.8:0/137339994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ecc13c1a0 0x7f0ecc1437f0 unknown :-1 s=CLOSED pgs=2471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.172+0000 7f0ed2e45700 1 -- 172.21.15.8:0/137339994 >> 172.21.15.8:0/137339994 conn(0x7f0ecc06acd0 msgr2=0x7f0ecc130af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:05.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.173+0000 7f0ed2e45700 1 -- 172.21.15.8:0/137339994 shutdown_connections 2023-10-14T17:00:05.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.173+0000 7f0ed2e45700 1 -- 172.21.15.8:0/137339994 wait complete. 2023-10-14T17:00:05.178 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 0 to deep-scrub 2023-10-14T17:00:05.185 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T17:00:05.186 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T17:00:05.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.307+0000 7f24385cc700 1 Processor -- start 2023-10-14T17:00:05.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.307+0000 7f24385cc700 1 -- start start 2023-10-14T17:00:05.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f24385cc700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f243006e3f0 0x7f24301318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f24385cc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f243006d210 0x7f2430131e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f24385cc700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f24300a2620 0x7f24300a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f24385cc700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2430132350 con 0x7f24300a2620 2023-10-14T17:00:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f24385cc700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243006dca0 con 0x7f243006e3f0 2023-10-14T17:00:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f24385cc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24300a7d20 con 0x7f243006d210 2023-10-14T17:00:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f2436b69700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f24300a2620 0x7f24300a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f2436b69700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f24300a2620 0x7f24300a2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60238/0 (socket says 172.21.15.8:60238) 2023-10-14T17:00:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f2436b69700 1 -- 172.21.15.8:0/231297236 learned_addr learned my addr 172.21.15.8:0/231297236 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f2436368700 1 --2- 172.21.15.8:0/231297236 >> v2:172.21.15.155:3300/0 conn(0x7f243006e3f0 0x7f24301318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f2435b67700 1 --2- 172.21.15.8:0/231297236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f243006d210 0x7f2430131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f2436b69700 1 -- 172.21.15.8:0/231297236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f243006d210 msgr2=0x7f2430131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f2436b69700 1 --2- 172.21.15.8:0/231297236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f243006d210 0x7f2430131e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f2436b69700 1 -- 172.21.15.8:0/231297236 >> v2:172.21.15.155:3300/0 conn(0x7f243006e3f0 msgr2=0x7f24301318d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f2436b69700 1 --2- 172.21.15.8:0/231297236 >> v2:172.21.15.155:3300/0 conn(0x7f243006e3f0 0x7f24301318d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f2436b69700 1 -- 172.21.15.8:0/231297236 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24300a7fc0 con 0x7f24300a2620 2023-10-14T17:00:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f2436368700 1 --2- 172.21.15.8:0/231297236 >> v2:172.21.15.155:3300/0 conn(0x7f243006e3f0 0x7f24301318d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T17:00:05.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.308+0000 7f2435b67700 1 --2- 172.21.15.8:0/231297236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f243006d210 0x7f2430131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T17:00:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f2436b69700 1 --2- 172.21.15.8:0/231297236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24300a2620 0x7f24300a2a60 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 crypto rx=0x7f24300a8a30 tx=0x7f2420009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa67e28f0afa7d53 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f2435366700 1 -- 172.21.15.8:0/231297236 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000e070 con 0x7f24300a2620 2023-10-14T17:00:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f2435366700 1 -- 172.21.15.8:0/231297236 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242000ba50 con 0x7f24300a2620 2023-10-14T17:00:05.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f2435366700 1 -- 172.21.15.8:0/231297236 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200092e0 con 0x7f24300a2620 2023-10-14T17:00:05.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f24385cc700 1 -- 172.21.15.8:0/231297236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24300a2620 msgr2=0x7f24300a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f24385cc700 1 --2- 172.21.15.8:0/231297236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24300a2620 0x7f24300a2a60 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 crypto rx=0x7f24300a8a30 tx=0x7f2420009840 comp rx=0 tx=0).stop 2023-10-14T17:00:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f24385cc700 1 -- 172.21.15.8:0/231297236 shutdown_connections 2023-10-14T17:00:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f24385cc700 1 --2- 172.21.15.8:0/231297236 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24300a2620 0x7f24300a2a60 unknown :-1 s=CLOSED pgs=2472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f24385cc700 1 --2- 172.21.15.8:0/231297236 >> v2:172.21.15.155:3300/0 conn(0x7f243006e3f0 0x7f24301318d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f24385cc700 1 --2- 172.21.15.8:0/231297236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f243006d210 0x7f2430131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f24385cc700 1 -- 172.21.15.8:0/231297236 >> 172.21.15.8:0/231297236 conn(0x7f243006f740 msgr2=0x7f24300701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:05.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f24385cc700 1 -- 172.21.15.8:0/231297236 shutdown_connections 2023-10-14T17:00:05.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.309+0000 7f24385cc700 1 -- 172.21.15.8:0/231297236 wait complete. 2023-10-14T17:00:05.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.310+0000 7f24385cc700 1 Processor -- start 2023-10-14T17:00:05.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.310+0000 7f24385cc700 1 -- start start 2023-10-14T17:00:05.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f24385cc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243006d210 0x7f2430144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f24385cc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f243006e3f0 0x7f2430144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f24385cc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24300a2620 0x7f2430144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f24385cc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24300a17c0 con 0x7f243006e3f0 2023-10-14T17:00:05.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f24385cc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2430099990 con 0x7f243006d210 2023-10-14T17:00:05.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f24385cc700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2430099bc0 con 0x7f24300a2620 2023-10-14T17:00:05.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f2435b67700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f243006e3f0 0x7f2430144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f2435b67700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f243006e3f0 0x7f2430144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60250/0 (socket says 172.21.15.8:60250) 2023-10-14T17:00:05.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f2435b67700 1 -- 172.21.15.8:0/2044675303 learned_addr learned my addr 172.21.15.8:0/2044675303 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:05.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f2436368700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243006d210 0x7f2430144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f2436b69700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24300a2620 0x7f2430144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f2435b67700 1 -- 172.21.15.8:0/2044675303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24300a2620 msgr2=0x7f2430144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f2435b67700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24300a2620 0x7f2430144bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f2435b67700 1 -- 172.21.15.8:0/2044675303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243006d210 msgr2=0x7f2430144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f2435b67700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243006d210 0x7f2430144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f2435b67700 1 -- 172.21.15.8:0/2044675303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420009ae0 con 0x7f243006e3f0 2023-10-14T17:00:05.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f2435b67700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f243006e3f0 0x7f2430144670 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7f242400c880 tx=0x7f2424008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f242e7fc700 1 -- 172.21.15.8:0/2044675303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2424011600 con 0x7f243006e3f0 2023-10-14T17:00:05.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f242e7fc700 1 -- 172.21.15.8:0/2044675303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2424011760 con 0x7f243006e3f0 2023-10-14T17:00:05.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f242e7fc700 1 -- 172.21.15.8:0/2044675303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2424011ae0 con 0x7f243006e3f0 2023-10-14T17:00:05.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f24385cc700 1 -- 172.21.15.8:0/2044675303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2430099e60 con 0x7f243006e3f0 2023-10-14T17:00:05.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.311+0000 7f24385cc700 1 -- 172.21.15.8:0/2044675303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243009afe0 con 0x7f243006e3f0 2023-10-14T17:00:05.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.312+0000 7f24385cc700 1 -- 172.21.15.8:0/2044675303 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f243006ef10 con 0x7f243006e3f0 2023-10-14T17:00:05.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.313+0000 7f242e7fc700 1 -- 172.21.15.8:0/2044675303 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24240223e0 con 0x7f243006e3f0 2023-10-14T17:00:05.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.313+0000 7f242e7fc700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f241c066f30 0x7f241c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.313+0000 7f242e7fc700 1 -- 172.21.15.8:0/2044675303 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f24240845b0 con 0x7f243006e3f0 2023-10-14T17:00:05.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.313+0000 7f2436368700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f241c066f30 0x7f241c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.313+0000 7f242e7fc700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] conn(0x7f241c06ec50 0x7f241c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.313+0000 7f242e7fc700 1 -- 172.21.15.8:0/2044675303 --> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f241c071790 con 0x7f241c06ec50 2023-10-14T17:00:05.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.313+0000 7f242e7fc700 1 -- 172.21.15.8:0/2044675303 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2424084980 con 0x7f243006e3f0 2023-10-14T17:00:05.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.314+0000 7f2436b69700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] conn(0x7f241c06ec50 0x7f241c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.314+0000 7f2436368700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f241c066f30 0x7f241c0693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f242800ac00 tx=0x7f2428006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.314+0000 7f2436b69700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] conn(0x7f241c06ec50 0x7f241c0710c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.314+0000 7f242e7fc700 1 -- 172.21.15.8:0/2044675303 <== osd.1 v2:172.21.15.8:6802/86153 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f241c071790 con 0x7f241c06ec50 2023-10-14T17:00:05.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.328+0000 7f24385cc700 1 -- 172.21.15.8:0/2044675303 --> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f243009a080 con 0x7f241c06ec50 2023-10-14T17:00:05.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.328+0000 7f242e7fc700 1 -- 172.21.15.8:0/2044675303 <== osd.1 v2:172.21.15.8:6802/86153 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f242000bbc0 con 0x7f241c06ec50 2023-10-14T17:00:05.338 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T17:00:05.338 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T17:00:05.338 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T17:00:05.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.329+0000 7f24385cc700 1 -- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] conn(0x7f241c06ec50 msgr2=0x7f241c0710c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.329+0000 7f24385cc700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:6802/86153,v1:172.21.15.8:6804/86153] conn(0x7f241c06ec50 0x7f241c0710c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.329+0000 7f24385cc700 1 -- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f241c066f30 msgr2=0x7f241c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.329+0000 7f24385cc700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f241c066f30 0x7f241c0693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f242800ac00 tx=0x7f2428006f90 comp rx=0 tx=0).stop 2023-10-14T17:00:05.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.329+0000 7f24385cc700 1 -- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f243006e3f0 msgr2=0x7f2430144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.329+0000 7f24385cc700 1 --2- 172.21.15.8:0/2044675303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f243006e3f0 0x7f2430144670 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7f242400c880 tx=0x7f2424008040 comp rx=0 tx=0).stop 2023-10-14T17:00:05.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.329+0000 7f2436b69700 1 -- 172.21.15.8:0/2044675303 reap_dead start 2023-10-14T17:00:05.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.329+0000 7f24385cc700 1 -- 172.21.15.8:0/2044675303 shutdown_connections 2023-10-14T17:00:05.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.329+0000 7f24385cc700 1 -- 172.21.15.8:0/2044675303 >> 172.21.15.8:0/2044675303 conn(0x7f243006f740 msgr2=0x7f2430137ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:05.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.329+0000 7f24385cc700 1 -- 172.21.15.8:0/2044675303 shutdown_connections 2023-10-14T17:00:05.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.329+0000 7f24385cc700 1 -- 172.21.15.8:0/2044675303 wait complete. 2023-10-14T17:00:05.343 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-14T17:00:05.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.462+0000 7f713957b700 1 Processor -- start 2023-10-14T17:00:05.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.462+0000 7f713957b700 1 -- start start 2023-10-14T17:00:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.462+0000 7f713957b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f71340a6940 0x7f71340a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.462+0000 7f713957b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71340a25c0 0x7f7134133f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.462+0000 7f713957b700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71340a2df0 con 0x7f7134134450 2023-10-14T17:00:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.462+0000 7f713957b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71341338f0 con 0x7f71340a6940 2023-10-14T17:00:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.462+0000 7f713957b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7134134890 con 0x7f71340a25c0 2023-10-14T17:00:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f7132ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f71340a6940 0x7f71340a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f71327fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71340a25c0 0x7f7134133f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f7132ffd700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f71340a6940 0x7f71340a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.8:39296/0 (socket says 172.21.15.8:39296) 2023-10-14T17:00:05.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f71327fc700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71340a25c0 0x7f7134133f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.8:55120/0 (socket says 172.21.15.8:55120) 2023-10-14T17:00:05.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f7132ffd700 1 -- 172.21.15.8:0/2451562743 learned_addr learned my addr 172.21.15.8:0/2451562743 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f71337fe700 1 --1- 172.21.15.8:0/2451562743 >> v1:172.21.15.155:6789/0 conn(0x7f7134134450 0x7f7134136e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.8:34098/0 (socket says 172.21.15.8:34098) 2023-10-14T17:00:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f7132ffd700 1 -- 172.21.15.8:0/2451562743 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71340a25c0 msgr2=0x7f7134133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f7132ffd700 1 --2- 172.21.15.8:0/2451562743 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71340a25c0 0x7f7134133f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f7132ffd700 1 -- 172.21.15.8:0/2451562743 >> v1:172.21.15.155:6789/0 conn(0x7f7134134450 legacy=0x7f7134136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f7132ffd700 1 -- 172.21.15.8:0/2451562743 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134133ae0 con 0x7f71340a6940 2023-10-14T17:00:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f71327fc700 1 --2- 172.21.15.8:0/2451562743 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71340a25c0 0x7f7134133f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T17:00:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f7132ffd700 1 --2- 172.21.15.8:0/2451562743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71340a6940 0x7f71340a1310 secure :-1 s=READY pgs=3213 cs=0 l=1 rev1=1 crypto rx=0x7f712c0099b0 tx=0x7f712c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a829a021e914013 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f7131ffb700 1 -- 172.21.15.8:0/2451562743 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c009ea0 con 0x7f71340a6940 2023-10-14T17:00:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f7131ffb700 1 -- 172.21.15.8:0/2451562743 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712c00b860 con 0x7f71340a6940 2023-10-14T17:00:05.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.463+0000 7f7131ffb700 1 -- 172.21.15.8:0/2451562743 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c00bc00 con 0x7f71340a6940 2023-10-14T17:00:05.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.464+0000 7f713957b700 1 -- 172.21.15.8:0/2451562743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71340a6940 msgr2=0x7f71340a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.464+0000 7f713957b700 1 --2- 172.21.15.8:0/2451562743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71340a6940 0x7f71340a1310 secure :-1 s=READY pgs=3213 cs=0 l=1 rev1=1 crypto rx=0x7f712c0099b0 tx=0x7f712c009250 comp rx=0 tx=0).stop 2023-10-14T17:00:05.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.464+0000 7f713957b700 1 -- 172.21.15.8:0/2451562743 shutdown_connections 2023-10-14T17:00:05.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.464+0000 7f713957b700 1 --2- 172.21.15.8:0/2451562743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71340a6940 0x7f71340a1310 unknown :-1 s=CLOSED pgs=3213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.464+0000 7f713957b700 1 --2- 172.21.15.8:0/2451562743 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71340a25c0 0x7f7134133f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.464+0000 7f713957b700 1 -- 172.21.15.8:0/2451562743 >> 172.21.15.8:0/2451562743 conn(0x7f713406acd0 msgr2=0x7f71340701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:05.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.464+0000 7f713957b700 1 -- 172.21.15.8:0/2451562743 shutdown_connections 2023-10-14T17:00:05.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.464+0000 7f713957b700 1 -- 172.21.15.8:0/2451562743 wait complete. 2023-10-14T17:00:05.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.465+0000 7f713957b700 1 Processor -- start 2023-10-14T17:00:05.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.465+0000 7f713957b700 1 -- start start 2023-10-14T17:00:05.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.465+0000 7f713957b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71340a25c0 0x7f7134095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.465+0000 7f713957b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7134134450 0x7f7134095fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.465+0000 7f713957b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340996a0 0x7f71340964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.465+0000 7f713957b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7134098c70 con 0x7f71340996a0 2023-10-14T17:00:05.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.465+0000 7f713957b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71340a05b0 con 0x7f7134134450 2023-10-14T17:00:05.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.465+0000 7f713957b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7134133f10 con 0x7f71340a25c0 2023-10-14T17:00:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.465+0000 7f71337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340996a0 0x7f71340964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f71337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340996a0 0x7f71340964f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60256/0 (socket says 172.21.15.8:60256) 2023-10-14T17:00:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f71337fe700 1 -- 172.21.15.8:0/3805818858 learned_addr learned my addr 172.21.15.8:0/3805818858 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:05.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f71327fc700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7134134450 0x7f7134095fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f7132ffd700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71340a25c0 0x7f7134095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f71337fe700 1 -- 172.21.15.8:0/3805818858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71340a25c0 msgr2=0x7f7134095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f71337fe700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71340a25c0 0x7f7134095a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f71337fe700 1 -- 172.21.15.8:0/3805818858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7134134450 msgr2=0x7f7134095fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f71337fe700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7134134450 0x7f7134095fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f71337fe700 1 -- 172.21.15.8:0/3805818858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c009420 con 0x7f71340996a0 2023-10-14T17:00:05.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f71337fe700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340996a0 0x7f71340964f0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f712400cc70 tx=0x7f7124001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f712affd700 1 -- 172.21.15.8:0/3805818858 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712400a960 con 0x7f71340996a0 2023-10-14T17:00:05.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f712affd700 1 -- 172.21.15.8:0/3805818858 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712400aac0 con 0x7f71340996a0 2023-10-14T17:00:05.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f713957b700 1 -- 172.21.15.8:0/3805818858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c0094f0 con 0x7f71340996a0 2023-10-14T17:00:05.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f712affd700 1 -- 172.21.15.8:0/3805818858 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712400ae80 con 0x7f71340996a0 2023-10-14T17:00:05.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.466+0000 7f713957b700 1 -- 172.21.15.8:0/3805818858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7134099b30 con 0x7f71340996a0 2023-10-14T17:00:05.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.467+0000 7f713957b700 1 -- 172.21.15.8:0/3805818858 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7134070350 con 0x7f71340996a0 2023-10-14T17:00:05.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.467+0000 7f712affd700 1 -- 172.21.15.8:0/3805818858 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7124007300 con 0x7f71340996a0 2023-10-14T17:00:05.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.468+0000 7f712affd700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7114066f30 0x7f71140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.468+0000 7f7132ffd700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7114066f30 0x7f71140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.468+0000 7f712affd700 1 -- 172.21.15.8:0/3805818858 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f7124084520 con 0x7f71340996a0 2023-10-14T17:00:05.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.468+0000 7f7132ffd700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7114066f30 0x7f71140693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f712c0099b0 tx=0x7f712c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.472+0000 7f712affd700 1 -- 172.21.15.8:0/3805818858 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7124051cb0 con 0x7f71340996a0 2023-10-14T17:00:05.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.664+0000 7f713957b700 1 -- 172.21.15.8:0/3805818858 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7134098eb0 con 0x7f7114066f30 2023-10-14T17:00:05.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.665+0000 7f712affd700 1 -- 172.21.15.8:0/3805818858 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7134098eb0 con 0x7f7114066f30 2023-10-14T17:00:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.667+0000 7f713957b700 1 -- 172.21.15.8:0/3805818858 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7114066f30 msgr2=0x7f71140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.667+0000 7f713957b700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7114066f30 0x7f71140693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f712c0099b0 tx=0x7f712c017000 comp rx=0 tx=0).stop 2023-10-14T17:00:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.667+0000 7f713957b700 1 -- 172.21.15.8:0/3805818858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340996a0 msgr2=0x7f71340964f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.667+0000 7f713957b700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340996a0 0x7f71340964f0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f712400cc70 tx=0x7f7124001ac0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.667+0000 7f713957b700 1 -- 172.21.15.8:0/3805818858 shutdown_connections 2023-10-14T17:00:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.667+0000 7f713957b700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f7114066f30 0x7f71140693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.667+0000 7f713957b700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71340996a0 0x7f71340964f0 unknown :-1 s=CLOSED pgs=2474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.667+0000 7f713957b700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71340a25c0 0x7f7134095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.667+0000 7f713957b700 1 --2- 172.21.15.8:0/3805818858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7134134450 0x7f7134095fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.667+0000 7f713957b700 1 -- 172.21.15.8:0/3805818858 >> 172.21.15.8:0/3805818858 conn(0x7f713406acd0 msgr2=0x7f71341318d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:05.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.667+0000 7f713957b700 1 -- 172.21.15.8:0/3805818858 shutdown_connections 2023-10-14T17:00:05.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.667+0000 7f713957b700 1 -- 172.21.15.8:0/3805818858 wait complete. 2023-10-14T17:00:05.671 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 1 to deep-scrub 2023-10-14T17:00:05.680 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T17:00:05.680 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T17:00:05.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.801+0000 7fa2742e7700 1 Processor -- start 2023-10-14T17:00:05.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.801+0000 7fa2742e7700 1 -- start start 2023-10-14T17:00:05.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.802+0000 7fa2742e7700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa26c0a6690 0x7fa26c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.802+0000 7fa2742e7700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26c095f40 con 0x7fa26c1342e0 2023-10-14T17:00:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.802+0000 7fa2742e7700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26c1346e0 con 0x7fa26c096f20 2023-10-14T17:00:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.802+0000 7fa2742e7700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c133780 con 0x7fa26c0a6690 2023-10-14T17:00:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.802+0000 7fa272083700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa26c0a6690 0x7fa26c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.802+0000 7fa272884700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa26c1342e0 0x7fa26c0a4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40414/0 (socket says 172.21.15.8:40414) 2023-10-14T17:00:05.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.802+0000 7fa272083700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa26c0a6690 0x7fa26c133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60266/0 (socket says 172.21.15.8:60266) 2023-10-14T17:00:05.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.802+0000 7fa272884700 1 -- 172.21.15.8:0/2295691001 learned_addr learned my addr 172.21.15.8:0/2295691001 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:00:05.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.802+0000 7fa272083700 1 -- 172.21.15.8:0/2295691001 >> v1:172.21.15.155:6789/0 conn(0x7fa26c096f20 legacy=0x7fa26c0a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:05.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.802+0000 7fa272083700 1 -- 172.21.15.8:0/2295691001 >> v1:172.21.15.8:6789/0 conn(0x7fa26c1342e0 legacy=0x7fa26c0a4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.802+0000 7fa272083700 1 -- 172.21.15.8:0/2295691001 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c097750 con 0x7fa26c0a6690 2023-10-14T17:00:05.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.803+0000 7fa272083700 1 --2- 172.21.15.8:0/2295691001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa26c0a6690 0x7fa26c133da0 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7fa264009e60 tx=0x7fa264009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5f6d4768848f4b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.803+0000 7fa271081700 1 -- 172.21.15.8:0/2295691001 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26400e070 con 0x7fa26c0a6690 2023-10-14T17:00:05.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.803+0000 7fa271081700 1 -- 172.21.15.8:0/2295691001 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26400bbf0 con 0x7fa26c0a6690 2023-10-14T17:00:05.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.803+0000 7fa271081700 1 -- 172.21.15.8:0/2295691001 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264012430 con 0x7fa26c0a6690 2023-10-14T17:00:05.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.803+0000 7fa2742e7700 1 -- 172.21.15.8:0/2295691001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa26c0a6690 msgr2=0x7fa26c133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.803+0000 7fa2742e7700 1 --2- 172.21.15.8:0/2295691001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa26c0a6690 0x7fa26c133da0 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7fa264009e60 tx=0x7fa264009780 comp rx=0 tx=0).stop 2023-10-14T17:00:05.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.803+0000 7fa2742e7700 1 -- 172.21.15.8:0/2295691001 shutdown_connections 2023-10-14T17:00:05.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.803+0000 7fa2742e7700 1 --2- 172.21.15.8:0/2295691001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa26c0a6690 0x7fa26c133da0 unknown :-1 s=CLOSED pgs=2476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.803+0000 7fa2742e7700 1 -- 172.21.15.8:0/2295691001 >> 172.21.15.8:0/2295691001 conn(0x7fa26c06abb0 msgr2=0x7fa26c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:05.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.803+0000 7fa2742e7700 1 -- 172.21.15.8:0/2295691001 shutdown_connections 2023-10-14T17:00:05.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.803+0000 7fa2742e7700 1 -- 172.21.15.8:0/2295691001 wait complete. 2023-10-14T17:00:05.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.804+0000 7fa2742e7700 1 Processor -- start 2023-10-14T17:00:05.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.804+0000 7fa2742e7700 1 -- start start 2023-10-14T17:00:05.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa2742e7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa26c096f20 0x7fa26c1471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa2742e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa26c1342e0 0x7fa26c1476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa2742e7700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa26c09a820 0x7fa26c09ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa2742e7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c09e920 con 0x7fa26c1342e0 2023-10-14T17:00:05.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa2742e7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c09eb70 con 0x7fa26c096f20 2023-10-14T17:00:05.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa2742e7700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0a4290 con 0x7fa26c09a820 2023-10-14T17:00:05.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa271882700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa26c1342e0 0x7fa26c1476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa271882700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa26c1342e0 0x7fa26c1476e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60276/0 (socket says 172.21.15.8:60276) 2023-10-14T17:00:05.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa271882700 1 -- 172.21.15.8:0/2489330410 learned_addr learned my addr 172.21.15.8:0/2489330410 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:05.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa272083700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa26c096f20 0x7fa26c1471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa272884700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa26c09a820 0x7fa26c09ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa271882700 1 -- 172.21.15.8:0/2489330410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa26c09a820 msgr2=0x7fa26c09ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa271882700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa26c09a820 0x7fa26c09ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa271882700 1 -- 172.21.15.8:0/2489330410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa26c096f20 msgr2=0x7fa26c1471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa271882700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa26c096f20 0x7fa26c1471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa271882700 1 -- 172.21.15.8:0/2489330410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa264009a20 con 0x7fa26c1342e0 2023-10-14T17:00:05.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa272083700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa26c096f20 0x7fa26c1471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:00:05.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa271882700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa26c1342e0 0x7fa26c1476e0 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7fa26000b600 tx=0x7fa2600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa26a7fc700 1 -- 172.21.15.8:0/2489330410 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26000f510 con 0x7fa26c1342e0 2023-10-14T17:00:05.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa26a7fc700 1 -- 172.21.15.8:0/2489330410 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26000f690 con 0x7fa26c1342e0 2023-10-14T17:00:05.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa2742e7700 1 -- 172.21.15.8:0/2489330410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26c09e5d0 con 0x7fa26c1342e0 2023-10-14T17:00:05.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa26a7fc700 1 -- 172.21.15.8:0/2489330410 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26000fa50 con 0x7fa26c1342e0 2023-10-14T17:00:05.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.805+0000 7fa2742e7700 1 -- 172.21.15.8:0/2489330410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26c09da70 con 0x7fa26c1342e0 2023-10-14T17:00:05.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.806+0000 7fa2742e7700 1 -- 172.21.15.8:0/2489330410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa26c0708d0 con 0x7fa26c1342e0 2023-10-14T17:00:05.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.807+0000 7fa26a7fc700 1 -- 172.21.15.8:0/2489330410 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa26001a400 con 0x7fa26c1342e0 2023-10-14T17:00:05.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.807+0000 7fa26a7fc700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fa258066f30 0x7fa2580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.807+0000 7fa26a7fc700 1 -- 172.21.15.8:0/2489330410 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7fa260083a30 con 0x7fa26c1342e0 2023-10-14T17:00:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.807+0000 7fa272083700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fa258066f30 0x7fa2580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.807+0000 7fa26a7fc700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] conn(0x7fa25806ec50 0x7fa2580710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.807+0000 7fa26a7fc700 1 -- 172.21.15.8:0/2489330410 --> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa258071790 con 0x7fa25806ec50 2023-10-14T17:00:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.807+0000 7fa26a7fc700 1 -- 172.21.15.8:0/2489330410 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa260088240 con 0x7fa26c1342e0 2023-10-14T17:00:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.808+0000 7fa272884700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] conn(0x7fa25806ec50 0x7fa2580710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.808+0000 7fa272083700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fa258066f30 0x7fa2580693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa2640097c0 tx=0x7fa264018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.808+0000 7fa272884700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] conn(0x7fa25806ec50 0x7fa2580710c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.809+0000 7fa26a7fc700 1 -- 172.21.15.8:0/2489330410 <== osd.2 v2:172.21.15.155:6800/86169 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa258071790 con 0x7fa25806ec50 2023-10-14T17:00:05.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.822+0000 7fa2742e7700 1 -- 172.21.15.8:0/2489330410 --> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa26c09ecb0 con 0x7fa25806ec50 2023-10-14T17:00:05.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.823+0000 7fa26a7fc700 1 -- 172.21.15.8:0/2489330410 <== osd.2 v2:172.21.15.155:6800/86169 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa26c09ecb0 con 0x7fa25806ec50 2023-10-14T17:00:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T17:00:05.828 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T17:00:05.829 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T17:00:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.823+0000 7fa2742e7700 1 -- 172.21.15.8:0/2489330410 >> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] conn(0x7fa25806ec50 msgr2=0x7fa2580710c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.823+0000 7fa2742e7700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.155:6800/86169,v1:172.21.15.155:6801/86169] conn(0x7fa25806ec50 0x7fa2580710c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.824+0000 7fa2742e7700 1 -- 172.21.15.8:0/2489330410 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fa258066f30 msgr2=0x7fa2580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.824+0000 7fa2742e7700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fa258066f30 0x7fa2580693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa2640097c0 tx=0x7fa264018000 comp rx=0 tx=0).stop 2023-10-14T17:00:05.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.824+0000 7fa2742e7700 1 -- 172.21.15.8:0/2489330410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa26c1342e0 msgr2=0x7fa26c1476e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.824+0000 7fa2742e7700 1 --2- 172.21.15.8:0/2489330410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa26c1342e0 0x7fa26c1476e0 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7fa26000b600 tx=0x7fa2600091a0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.824+0000 7fa272884700 1 -- 172.21.15.8:0/2489330410 reap_dead start 2023-10-14T17:00:05.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.824+0000 7fa2742e7700 1 -- 172.21.15.8:0/2489330410 shutdown_connections 2023-10-14T17:00:05.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.824+0000 7fa2742e7700 1 -- 172.21.15.8:0/2489330410 >> 172.21.15.8:0/2489330410 conn(0x7fa26c06abb0 msgr2=0x7fa26c130e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:05.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.824+0000 7fa2742e7700 1 -- 172.21.15.8:0/2489330410 shutdown_connections 2023-10-14T17:00:05.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.824+0000 7fa2742e7700 1 -- 172.21.15.8:0/2489330410 wait complete. 2023-10-14T17:00:05.835 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T17:00:05.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.954+0000 7f84bd141700 1 Processor -- start 2023-10-14T17:00:05.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.954+0000 7f84bd141700 1 -- start start 2023-10-14T17:00:05.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.954+0000 7f84bd141700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f84b8095bc0 0x7f84b813bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.954+0000 7f84bd141700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f84b80a5330 0x7f84b813e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.954+0000 7f84bd141700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b80a3eb0 con 0x7f84b80a6880 2023-10-14T17:00:05.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.954+0000 7f84bd141700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b80a5a90 con 0x7f84b8095bc0 2023-10-14T17:00:05.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.954+0000 7f84bd141700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b80a4750 con 0x7f84b80a5330 2023-10-14T17:00:05.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.955+0000 7f84b77fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f84b8095bc0 0x7f84b813bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.955+0000 7f84b77fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f84b8095bc0 0x7f84b813bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60280/0 (socket says 172.21.15.8:60280) 2023-10-14T17:00:05.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.955+0000 7f84b77fe700 1 -- 172.21.15.8:0/1126778110 learned_addr learned my addr 172.21.15.8:0/1126778110 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:05.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.955+0000 7f84bc940700 1 --2- 172.21.15.8:0/1126778110 >> v2:172.21.15.155:3300/0 conn(0x7f84b80a5330 0x7f84b813e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.955+0000 7f84b77fe700 1 -- 172.21.15.8:0/1126778110 >> v2:172.21.15.155:3300/0 conn(0x7f84b80a5330 msgr2=0x7f84b813e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:05.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.955+0000 7f84b77fe700 1 --2- 172.21.15.8:0/1126778110 >> v2:172.21.15.155:3300/0 conn(0x7f84b80a5330 0x7f84b813e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.955+0000 7f84b77fe700 1 -- 172.21.15.8:0/1126778110 >> v1:172.21.15.155:6789/0 conn(0x7f84b80a6880 legacy=0x7f84b80a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:05.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.955+0000 7f84b77fe700 1 -- 172.21.15.8:0/1126778110 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b8096090 con 0x7f84b8095bc0 2023-10-14T17:00:05.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.955+0000 7f84b77fe700 1 --2- 172.21.15.8:0/1126778110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b8095bc0 0x7f84b813bc10 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7f84b80a4640 tx=0x7f84a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92178c32c78f0124 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.955+0000 7f84b6ffd700 1 -- 172.21.15.8:0/1126778110 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a000b820 con 0x7f84b8095bc0 2023-10-14T17:00:05.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.955+0000 7f84b6ffd700 1 -- 172.21.15.8:0/1126778110 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a000b980 con 0x7f84b8095bc0 2023-10-14T17:00:05.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.955+0000 7f84b6ffd700 1 -- 172.21.15.8:0/1126778110 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a000bd20 con 0x7f84b8095bc0 2023-10-14T17:00:05.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.956+0000 7f84bd141700 1 -- 172.21.15.8:0/1126778110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b8095bc0 msgr2=0x7f84b813bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.956+0000 7f84bd141700 1 --2- 172.21.15.8:0/1126778110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b8095bc0 0x7f84b813bc10 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7f84b80a4640 tx=0x7f84a0009250 comp rx=0 tx=0).stop 2023-10-14T17:00:05.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.956+0000 7f84bd141700 1 -- 172.21.15.8:0/1126778110 shutdown_connections 2023-10-14T17:00:05.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.956+0000 7f84bd141700 1 --2- 172.21.15.8:0/1126778110 >> v2:172.21.15.155:3300/0 conn(0x7f84b80a5330 0x7f84b813e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.956+0000 7f84bd141700 1 --2- 172.21.15.8:0/1126778110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b8095bc0 0x7f84b813bc10 unknown :-1 s=CLOSED pgs=2478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.956+0000 7f84bd141700 1 -- 172.21.15.8:0/1126778110 >> 172.21.15.8:0/1126778110 conn(0x7f84b806a7f0 msgr2=0x7f84b80701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:05.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.956+0000 7f84bd141700 1 -- 172.21.15.8:0/1126778110 shutdown_connections 2023-10-14T17:00:05.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.956+0000 7f84bd141700 1 -- 172.21.15.8:0/1126778110 wait complete. 2023-10-14T17:00:05.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.957+0000 7f84bd141700 1 Processor -- start 2023-10-14T17:00:05.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.957+0000 7f84bd141700 1 -- start start 2023-10-14T17:00:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.957+0000 7f84bd141700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84b80a5330 0x7f84b8146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.957+0000 7f84bd141700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b8147260 0x7f84b809d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.957+0000 7f84bd141700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84b81476b0 0x7f84b809d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.957+0000 7f84bd141700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80a0fb0 con 0x7f84b8147260 2023-10-14T17:00:05.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.957+0000 7f84bd141700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80a1be0 con 0x7f84b80a5330 2023-10-14T17:00:05.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.957+0000 7f84bd141700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80a14c0 con 0x7f84b81476b0 2023-10-14T17:00:05.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.957+0000 7f84b77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b8147260 0x7f84b809d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84b77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b8147260 0x7f84b809d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60286/0 (socket says 172.21.15.8:60286) 2023-10-14T17:00:05.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84b77fe700 1 -- 172.21.15.8:0/1965444133 learned_addr learned my addr 172.21.15.8:0/1965444133 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:05.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84b7fff700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84b80a5330 0x7f84b8146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84bc940700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84b81476b0 0x7f84b809d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84b77fe700 1 -- 172.21.15.8:0/1965444133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84b81476b0 msgr2=0x7f84b809d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84b77fe700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84b81476b0 0x7f84b809d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84b77fe700 1 -- 172.21.15.8:0/1965444133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84b80a5330 msgr2=0x7f84b8146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:05.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84b77fe700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84b80a5330 0x7f84b8146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:05.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84b77fe700 1 -- 172.21.15.8:0/1965444133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a00094f0 con 0x7f84b8147260 2023-10-14T17:00:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84bc940700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84b81476b0 0x7f84b809d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:00:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84b77fe700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b8147260 0x7f84b809d3c0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7f84a00030c0 tx=0x7f84a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84affff700 1 -- 172.21.15.8:0/1965444133 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a001b470 con 0x7f84b8147260 2023-10-14T17:00:05.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84affff700 1 -- 172.21.15.8:0/1965444133 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a001b5f0 con 0x7f84b8147260 2023-10-14T17:00:05.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84bd141700 1 -- 172.21.15.8:0/1965444133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b80a11b0 con 0x7f84b8147260 2023-10-14T17:00:05.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84affff700 1 -- 172.21.15.8:0/1965444133 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a001b9b0 con 0x7f84b8147260 2023-10-14T17:00:05.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.958+0000 7f84bd141700 1 -- 172.21.15.8:0/1965444133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b80a2ed0 con 0x7f84b8147260 2023-10-14T17:00:05.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.959+0000 7f84bd141700 1 -- 172.21.15.8:0/1965444133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b806abf0 con 0x7f84b8147260 2023-10-14T17:00:05.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.959+0000 7f84affff700 1 -- 172.21.15.8:0/1965444133 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84a001bd20 con 0x7f84b8147260 2023-10-14T17:00:05.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.960+0000 7f84affff700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f8498066f30 0x7f84980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:05.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.960+0000 7f84affff700 1 -- 172.21.15.8:0/1965444133 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f84a0085b00 con 0x7f84b8147260 2023-10-14T17:00:05.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.960+0000 7f84b7fff700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f8498066f30 0x7f84980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:05.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.960+0000 7f84b7fff700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f8498066f30 0x7f84980693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009af0 tx=0x7f84a8009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:05.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:05.964+0000 7f84affff700 1 -- 172.21.15.8:0/1965444133 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84a0053290 con 0x7f84b8147260 2023-10-14T17:00:06.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.160+0000 7f84bd141700 1 -- 172.21.15.8:0/1965444133 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f84b80a1340 con 0x7f8498066f30 2023-10-14T17:00:06.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.161+0000 7f84affff700 1 -- 172.21.15.8:0/1965444133 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f84a800e650 con 0x7f8498066f30 2023-10-14T17:00:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.163+0000 7f84bd141700 1 -- 172.21.15.8:0/1965444133 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f8498066f30 msgr2=0x7f84980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.163+0000 7f84bd141700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f8498066f30 0x7f84980693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009af0 tx=0x7f84a8009060 comp rx=0 tx=0).stop 2023-10-14T17:00:06.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.163+0000 7f84bd141700 1 -- 172.21.15.8:0/1965444133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b8147260 msgr2=0x7f84b809d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.163+0000 7f84bd141700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b8147260 0x7f84b809d3c0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7f84a00030c0 tx=0x7f84a0016000 comp rx=0 tx=0).stop 2023-10-14T17:00:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.163+0000 7f84bd141700 1 -- 172.21.15.8:0/1965444133 shutdown_connections 2023-10-14T17:00:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.163+0000 7f84bd141700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f8498066f30 0x7f84980693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.163+0000 7f84bd141700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84b81476b0 0x7f84b809d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.163+0000 7f84bd141700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84b80a5330 0x7f84b8146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.163+0000 7f84bd141700 1 --2- 172.21.15.8:0/1965444133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f84b8147260 0x7f84b809d3c0 unknown :-1 s=CLOSED pgs=2479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.163+0000 7f84bd141700 1 -- 172.21.15.8:0/1965444133 >> 172.21.15.8:0/1965444133 conn(0x7f84b806a7f0 msgr2=0x7f84b8133c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.163+0000 7f84bd141700 1 -- 172.21.15.8:0/1965444133 shutdown_connections 2023-10-14T17:00:06.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.163+0000 7f84bd141700 1 -- 172.21.15.8:0/1965444133 wait complete. 2023-10-14T17:00:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T17:00:06.175 INFO:tasks.ceph:Scrubbing osd.3 2023-10-14T17:00:06.176 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-14T17:00:06.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.298+0000 7f6e7faf8700 1 Processor -- start 2023-10-14T17:00:06.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.298+0000 7f6e7faf8700 1 -- start start 2023-10-14T17:00:06.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.298+0000 7f6e7faf8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e78139ea0 0x7f6e7813c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.298+0000 7f6e7faf8700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7806ad40 con 0x7f6e780a4940 2023-10-14T17:00:06.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.298+0000 7f6e7faf8700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e78069aa0 con 0x7f6e7813c7c0 2023-10-14T17:00:06.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.298+0000 7f6e7faf8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7806a040 con 0x7f6e78139ea0 2023-10-14T17:00:06.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.298+0000 7f6e7d894700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6e780a4940 0x7f6e78137250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40420/0 (socket says 172.21.15.8:40420) 2023-10-14T17:00:06.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.298+0000 7f6e7d894700 1 -- 172.21.15.8:0/457633728 learned_addr learned my addr 172.21.15.8:0/457633728 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:00:06.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7d093700 1 --2- 172.21.15.8:0/457633728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e78139ea0 0x7f6e7813c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959080354 0 0) 0x7f6e70001110 con 0x7f6e780a4940 2023-10-14T17:00:06.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e60003570 con 0x7f6e780a4940 2023-10-14T17:00:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1404043176 0 0) 0x7f6e60003570 con 0x7f6e780a4940 2023-10-14T17:00:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e78139ea0 msgr2=0x7f6e7813c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 --2- 172.21.15.8:0/457633728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e78139ea0 0x7f6e7813c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 >> v1:172.21.15.155:6789/0 conn(0x7f6e7813c7c0 legacy=0x7f6e7813eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e78069d60 con 0x7f6e780a4940 2023-10-14T17:00:06.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f6e70001600 con 0x7f6e780a4940 2023-10-14T17:00:06.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 >> v1:172.21.15.8:6789/0 conn(0x7f6e780a4940 legacy=0x7f6e78137250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 --2- 172.21.15.8:0/457633728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e60003a90 0x7f6e60003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 --2- 172.21.15.8:0/457633728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e60004810 0x7f6e60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 --2- 172.21.15.8:0/457633728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e78139ea0 0x7f6e60005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7806a040 con 0x7f6e60003a90 2023-10-14T17:00:06.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6000bb90 con 0x7f6e60004810 2023-10-14T17:00:06.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6000bd50 con 0x7f6e78139ea0 2023-10-14T17:00:06.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7d894700 1 --2- 172.21.15.8:0/457633728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e60003a90 0x7f6e60003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7d093700 1 --2- 172.21.15.8:0/457633728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e60004810 0x7f6e60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7e095700 1 --2- 172.21.15.8:0/457633728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e78139ea0 0x7f6e60005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7d894700 1 -- 172.21.15.8:0/457633728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e78139ea0 msgr2=0x7f6e60005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:06.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7d894700 1 --2- 172.21.15.8:0/457633728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e78139ea0 0x7f6e60005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7d894700 1 -- 172.21.15.8:0/457633728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e60004810 msgr2=0x7f6e60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:06.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7d894700 1 --2- 172.21.15.8:0/457633728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e60004810 0x7f6e60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.299+0000 7f6e7d894700 1 -- 172.21.15.8:0/457633728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60003570 con 0x7f6e60003a90 2023-10-14T17:00:06.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.300+0000 7f6e7d894700 1 --2- 172.21.15.8:0/457633728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e60003a90 0x7f6e60003e60 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000c440 tx=0x7f6e700079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e09a963a079835f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:06.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.300+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7000cd70 con 0x7f6e60003a90 2023-10-14T17:00:06.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.300+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e70005920 con 0x7f6e60003a90 2023-10-14T17:00:06.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.300+0000 7f6e7c892700 1 -- 172.21.15.8:0/457633728 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70005ce0 con 0x7f6e60003a90 2023-10-14T17:00:06.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.300+0000 7f6e7faf8700 1 -- 172.21.15.8:0/457633728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e60003a90 msgr2=0x7f6e60003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.300+0000 7f6e7faf8700 1 --2- 172.21.15.8:0/457633728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e60003a90 0x7f6e60003e60 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000c440 tx=0x7f6e700079d0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.300+0000 7f6e7e095700 1 -- 172.21.15.8:0/457633728 reap_dead start 2023-10-14T17:00:06.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.300+0000 7f6e7faf8700 1 -- 172.21.15.8:0/457633728 shutdown_connections 2023-10-14T17:00:06.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.300+0000 7f6e7faf8700 1 -- 172.21.15.8:0/457633728 >> 172.21.15.8:0/457633728 conn(0x7f6e7806f840 msgr2=0x7f6e780701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:06.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.300+0000 7f6e7faf8700 1 -- 172.21.15.8:0/457633728 shutdown_connections 2023-10-14T17:00:06.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.300+0000 7f6e7faf8700 1 -- 172.21.15.8:0/457633728 wait complete. 2023-10-14T17:00:06.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.301+0000 7f6e7faf8700 1 Processor -- start 2023-10-14T17:00:06.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.301+0000 7f6e7faf8700 1 -- start start 2023-10-14T17:00:06.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7faf8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e60003a90 0x7f6e78146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7faf8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e78147170 0x7f6e78147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7faf8700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e780a5e40 0x7f6e780a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7faf8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7809af30 con 0x7f6e60003a90 2023-10-14T17:00:06.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7faf8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78147ac0 con 0x7f6e78147170 2023-10-14T17:00:06.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7faf8700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780a7b20 con 0x7f6e780a5e40 2023-10-14T17:00:06.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7d894700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e60003a90 0x7f6e78146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7d894700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e60003a90 0x7f6e78146c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60300/0 (socket says 172.21.15.8:60300) 2023-10-14T17:00:06.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7d093700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e78147170 0x7f6e78147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7d894700 1 -- 172.21.15.8:0/3682349458 learned_addr learned my addr 172.21.15.8:0/3682349458 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:06.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7e095700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e780a5e40 0x7f6e780a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7d894700 1 -- 172.21.15.8:0/3682349458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e780a5e40 msgr2=0x7f6e780a6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7d894700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e780a5e40 0x7f6e780a6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7d894700 1 -- 172.21.15.8:0/3682349458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e78147170 msgr2=0x7f6e78147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7d894700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e78147170 0x7f6e78147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7d894700 1 -- 172.21.15.8:0/3682349458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7809bd10 con 0x7f6e60003a90 2023-10-14T17:00:06.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7d093700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e78147170 0x7f6e78147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T17:00:06.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7d894700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e60003a90 0x7f6e78146c30 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000ca30 tx=0x7f6e70015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:06.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e75ffb700 1 -- 172.21.15.8:0/3682349458 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70005ca0 con 0x7f6e60003a90 2023-10-14T17:00:06.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e75ffb700 1 -- 172.21.15.8:0/3682349458 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e70005e00 con 0x7f6e60003a90 2023-10-14T17:00:06.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e7faf8700 1 -- 172.21.15.8:0/3682349458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7809ab90 con 0x7f6e60003a90 2023-10-14T17:00:06.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.302+0000 7f6e75ffb700 1 -- 172.21.15.8:0/3682349458 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70007530 con 0x7f6e60003a90 2023-10-14T17:00:06.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.303+0000 7f6e7faf8700 1 -- 172.21.15.8:0/3682349458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e780a8b90 con 0x7f6e60003a90 2023-10-14T17:00:06.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.303+0000 7f6e7faf8700 1 -- 172.21.15.8:0/3682349458 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e780708d0 con 0x7f6e60003a90 2023-10-14T17:00:06.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.304+0000 7f6e75ffb700 1 -- 172.21.15.8:0/3682349458 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e70028450 con 0x7f6e60003a90 2023-10-14T17:00:06.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.304+0000 7f6e75ffb700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6e64066f30 0x7f6e640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.304+0000 7f6e75ffb700 1 -- 172.21.15.8:0/3682349458 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f6e70007e40 con 0x7f6e60003a90 2023-10-14T17:00:06.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.304+0000 7f6e7d093700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6e64066f30 0x7f6e640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.304+0000 7f6e75ffb700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] conn(0x7f6e6406ec50 0x7f6e640710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.304+0000 7f6e75ffb700 1 -- 172.21.15.8:0/3682349458 --> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e64071790 con 0x7f6e6406ec50 2023-10-14T17:00:06.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.305+0000 7f6e75ffb700 1 -- 172.21.15.8:0/3682349458 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e70085e90 con 0x7f6e60003a90 2023-10-14T17:00:06.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.305+0000 7f6e7d093700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6e64066f30 0x7f6e640693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6e7809aac0 tx=0x7f6e6c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:06.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.305+0000 7f6e7e095700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] conn(0x7f6e6406ec50 0x7f6e640710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.305+0000 7f6e7e095700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] conn(0x7f6e6406ec50 0x7f6e640710c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:06.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.306+0000 7f6e75ffb700 1 -- 172.21.15.8:0/3682349458 <== osd.3 v2:172.21.15.155:6808/86170 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6e64071790 con 0x7f6e6406ec50 2023-10-14T17:00:06.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.320+0000 7f6e7faf8700 1 -- 172.21.15.8:0/3682349458 --> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6e7806ad40 con 0x7f6e6406ec50 2023-10-14T17:00:06.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.320+0000 7f6e75ffb700 1 -- 172.21.15.8:0/3682349458 <== osd.3 v2:172.21.15.155:6808/86170 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6e7806ad40 con 0x7f6e6406ec50 2023-10-14T17:00:06.328 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-14T17:00:06.328 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T17:00:06.329 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-14T17:00:06.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.320+0000 7f6e7faf8700 1 -- 172.21.15.8:0/3682349458 >> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] conn(0x7f6e6406ec50 msgr2=0x7f6e640710c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.320+0000 7f6e7faf8700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.155:6808/86170,v1:172.21.15.155:6809/86170] conn(0x7f6e6406ec50 0x7f6e640710c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.321+0000 7f6e7faf8700 1 -- 172.21.15.8:0/3682349458 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6e64066f30 msgr2=0x7f6e640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.321+0000 7f6e7faf8700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f6e64066f30 0x7f6e640693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6e7809aac0 tx=0x7f6e6c0091a0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.321+0000 7f6e7faf8700 1 -- 172.21.15.8:0/3682349458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e60003a90 msgr2=0x7f6e78146c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.321+0000 7f6e7faf8700 1 --2- 172.21.15.8:0/3682349458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e60003a90 0x7f6e78146c30 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000ca30 tx=0x7f6e70015000 comp rx=0 tx=0).stop 2023-10-14T17:00:06.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.321+0000 7f6e7e095700 1 -- 172.21.15.8:0/3682349458 reap_dead start 2023-10-14T17:00:06.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.321+0000 7f6e7faf8700 1 -- 172.21.15.8:0/3682349458 shutdown_connections 2023-10-14T17:00:06.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.321+0000 7f6e7faf8700 1 -- 172.21.15.8:0/3682349458 >> 172.21.15.8:0/3682349458 conn(0x7f6e7806f840 msgr2=0x7f6e7813a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:06.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.321+0000 7f6e7faf8700 1 -- 172.21.15.8:0/3682349458 shutdown_connections 2023-10-14T17:00:06.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.321+0000 7f6e7faf8700 1 -- 172.21.15.8:0/3682349458 wait complete. 2023-10-14T17:00:06.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-14T17:00:06.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.452+0000 7f4af53b9700 1 Processor -- start 2023-10-14T17:00:06.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.452+0000 7f4af53b9700 1 -- start start 2023-10-14T17:00:06.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.452+0000 7f4af53b9700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4af00a6a70 0x7f4af00a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.452+0000 7f4af53b9700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4af00a5580 0x7f4af0137080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.452+0000 7f4af53b9700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af00a0d30 con 0x7f4af00a5180 2023-10-14T17:00:06.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.452+0000 7f4af53b9700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af00a4850 con 0x7f4af00a6a70 2023-10-14T17:00:06.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.452+0000 7f4af53b9700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af00a2a40 con 0x7f4af00a5580 2023-10-14T17:00:06.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4aeffff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4af00a6a70 0x7f4af00a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4aef7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4af00a5180 0x7f4af0136970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40422/0 (socket says 172.21.15.8:40422) 2023-10-14T17:00:06.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4aef7fe700 1 -- 172.21.15.8:0/1391312943 learned_addr learned my addr 172.21.15.8:0/1391312943 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:00:06.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4af4bb8700 1 --2- 172.21.15.8:0/1391312943 >> v2:172.21.15.155:3300/0 conn(0x7f4af00a5580 0x7f4af0137080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4aeffff700 1 -- 172.21.15.8:0/1391312943 >> v2:172.21.15.155:3300/0 conn(0x7f4af00a5580 msgr2=0x7f4af0137080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:06.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4aeffff700 1 --2- 172.21.15.8:0/1391312943 >> v2:172.21.15.155:3300/0 conn(0x7f4af00a5580 0x7f4af0137080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4aeffff700 1 -- 172.21.15.8:0/1391312943 >> v1:172.21.15.8:6789/0 conn(0x7f4af00a5180 legacy=0x7f4af0136970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4aeffff700 1 -- 172.21.15.8:0/1391312943 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af00a18c0 con 0x7f4af00a6a70 2023-10-14T17:00:06.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4aeeffd700 1 -- 172.21.15.8:0/1391312943 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581028285 0 0) 0x7f4af00a0d30 con 0x7f4af00a5180 2023-10-14T17:00:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4af4bb8700 1 --2- 172.21.15.8:0/1391312943 >> v2:172.21.15.155:3300/0 conn(0x7f4af00a5580 0x7f4af0137080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:00:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4aeffff700 1 --2- 172.21.15.8:0/1391312943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af00a6a70 0x7f4af00a4c40 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 crypto rx=0x7f4af00a7c00 tx=0x7f4ad80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6855838deb321d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4aeeffd700 1 -- 172.21.15.8:0/1391312943 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800b6b0 con 0x7f4af00a6a70 2023-10-14T17:00:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4aeeffd700 1 -- 172.21.15.8:0/1391312943 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad800b810 con 0x7f4af00a6a70 2023-10-14T17:00:06.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.453+0000 7f4aeeffd700 1 -- 172.21.15.8:0/1391312943 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800bbb0 con 0x7f4af00a6a70 2023-10-14T17:00:06.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.454+0000 7f4af53b9700 1 -- 172.21.15.8:0/1391312943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af00a6a70 msgr2=0x7f4af00a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.454+0000 7f4af53b9700 1 --2- 172.21.15.8:0/1391312943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af00a6a70 0x7f4af00a4c40 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 crypto rx=0x7f4af00a7c00 tx=0x7f4ad80091a0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.454+0000 7f4af53b9700 1 -- 172.21.15.8:0/1391312943 shutdown_connections 2023-10-14T17:00:06.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.454+0000 7f4af53b9700 1 --2- 172.21.15.8:0/1391312943 >> v2:172.21.15.155:3300/0 conn(0x7f4af00a5580 0x7f4af0137080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.454+0000 7f4af53b9700 1 --2- 172.21.15.8:0/1391312943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af00a6a70 0x7f4af00a4c40 unknown :-1 s=CLOSED pgs=2484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.454+0000 7f4af53b9700 1 -- 172.21.15.8:0/1391312943 >> 172.21.15.8:0/1391312943 conn(0x7f4af006a960 msgr2=0x7f4af00701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:06.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.454+0000 7f4af53b9700 1 -- 172.21.15.8:0/1391312943 shutdown_connections 2023-10-14T17:00:06.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.454+0000 7f4af53b9700 1 -- 172.21.15.8:0/1391312943 wait complete. 2023-10-14T17:00:06.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.455+0000 7f4af53b9700 1 Processor -- start 2023-10-14T17:00:06.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.455+0000 7f4af53b9700 1 -- start start 2023-10-14T17:00:06.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.455+0000 7f4af53b9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4af00a5180 0x7f4af0146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.455+0000 7f4af53b9700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4af00a5580 0x7f4af01466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.455+0000 7f4af53b9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af009bbe0 0x7f4af0146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.455+0000 7f4af53b9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00a0830 con 0x7f4af009bbe0 2023-10-14T17:00:06.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.455+0000 7f4af53b9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af009b490 con 0x7f4af00a5180 2023-10-14T17:00:06.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.455+0000 7f4af53b9700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00a0a90 con 0x7f4af00a5580 2023-10-14T17:00:06.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.455+0000 7f4af4bb8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af009bbe0 0x7f4af0146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.455+0000 7f4af4bb8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af009bbe0 0x7f4af0146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60320/0 (socket says 172.21.15.8:60320) 2023-10-14T17:00:06.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4af4bb8700 1 -- 172.21.15.8:0/56685635 learned_addr learned my addr 172.21.15.8:0/56685635 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:06.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4aeffff700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4af00a5180 0x7f4af0146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4aef7fe700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4af00a5580 0x7f4af01466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4af4bb8700 1 -- 172.21.15.8:0/56685635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4af00a5580 msgr2=0x7f4af01466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4af4bb8700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4af00a5580 0x7f4af01466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4af4bb8700 1 -- 172.21.15.8:0/56685635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4af00a5180 msgr2=0x7f4af0146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4af4bb8700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4af00a5180 0x7f4af0146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4af4bb8700 1 -- 172.21.15.8:0/56685635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad8009420 con 0x7f4af009bbe0 2023-10-14T17:00:06.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4af4bb8700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af009bbe0 0x7f4af0146c00 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800d180 tx=0x7f4ae8009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:06.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4ae7fff700 1 -- 172.21.15.8:0/56685635 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae800dcc0 con 0x7f4af009bbe0 2023-10-14T17:00:06.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4ae7fff700 1 -- 172.21.15.8:0/56685635 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae800f040 con 0x7f4af009bbe0 2023-10-14T17:00:06.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4af53b9700 1 -- 172.21.15.8:0/56685635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af009ab30 con 0x7f4af009bbe0 2023-10-14T17:00:06.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4ae7fff700 1 -- 172.21.15.8:0/56685635 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8015690 con 0x7f4af009bbe0 2023-10-14T17:00:06.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.456+0000 7f4af53b9700 1 -- 172.21.15.8:0/56685635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af009c070 con 0x7f4af009bbe0 2023-10-14T17:00:06.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.457+0000 7f4af53b9700 1 -- 172.21.15.8:0/56685635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af006ad60 con 0x7f4af009bbe0 2023-10-14T17:00:06.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.458+0000 7f4ae7fff700 1 -- 172.21.15.8:0/56685635 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ae801e3b0 con 0x7f4af009bbe0 2023-10-14T17:00:06.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.458+0000 7f4ae7fff700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4ad0066f30 0x7f4ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.458+0000 7f4aeffff700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4ad0066f30 0x7f4ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.458+0000 7f4ae7fff700 1 -- 172.21.15.8:0/56685635 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f4ae80844b0 con 0x7f4af009bbe0 2023-10-14T17:00:06.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.458+0000 7f4aeffff700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4ad0066f30 0x7f4ad00693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80093f0 tx=0x7f4ad8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:06.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.462+0000 7f4ae7fff700 1 -- 172.21.15.8:0/56685635 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ae8051c40 con 0x7f4af009bbe0 2023-10-14T17:00:06.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.656+0000 7f4af53b9700 1 -- 172.21.15.8:0/56685635 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4af009b600 con 0x7f4ad0066f30 2023-10-14T17:00:06.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.656+0000 7f4ae7fff700 1 -- 172.21.15.8:0/56685635 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4af009b600 con 0x7f4ad0066f30 2023-10-14T17:00:06.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.658+0000 7f4af53b9700 1 -- 172.21.15.8:0/56685635 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4ad0066f30 msgr2=0x7f4ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.658+0000 7f4af53b9700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4ad0066f30 0x7f4ad00693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80093f0 tx=0x7f4ad8017000 comp rx=0 tx=0).stop 2023-10-14T17:00:06.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.658+0000 7f4af53b9700 1 -- 172.21.15.8:0/56685635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af009bbe0 msgr2=0x7f4af0146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.658+0000 7f4af53b9700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af009bbe0 0x7f4af0146c00 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800d180 tx=0x7f4ae8009a50 comp rx=0 tx=0).stop 2023-10-14T17:00:06.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.658+0000 7f4af53b9700 1 -- 172.21.15.8:0/56685635 shutdown_connections 2023-10-14T17:00:06.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.658+0000 7f4af53b9700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4ad0066f30 0x7f4ad00693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.658+0000 7f4af53b9700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af009bbe0 0x7f4af0146c00 unknown :-1 s=CLOSED pgs=2485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.658+0000 7f4af53b9700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4af00a5180 0x7f4af0146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.658+0000 7f4af53b9700 1 --2- 172.21.15.8:0/56685635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4af00a5580 0x7f4af01466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.658+0000 7f4af53b9700 1 -- 172.21.15.8:0/56685635 >> 172.21.15.8:0/56685635 conn(0x7f4af006a960 msgr2=0x7f4af0132640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:06.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.658+0000 7f4af53b9700 1 -- 172.21.15.8:0/56685635 shutdown_connections 2023-10-14T17:00:06.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.658+0000 7f4af53b9700 1 -- 172.21.15.8:0/56685635 wait complete. 2023-10-14T17:00:06.663 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 3 to deep-scrub 2023-10-14T17:00:06.671 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T17:00:06.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.788+0000 7f25ca454700 1 Processor -- start 2023-10-14T17:00:06.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.788+0000 7f25ca454700 1 -- start start 2023-10-14T17:00:06.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.788+0000 7f25ca454700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f25c40988c0 0x7f25c40965a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.788+0000 7f25ca454700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f25c413c620 0x7f25c413ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.788+0000 7f25ca454700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c40976e0 con 0x7f25c40678b0 2023-10-14T17:00:06.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.788+0000 7f25ca454700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c40a4760 con 0x7f25c40988c0 2023-10-14T17:00:06.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25ca454700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c406c190 con 0x7f25c413c620 2023-10-14T17:00:06.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c37fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f25c40988c0 0x7f25c40965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c37fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f25c40988c0 0x7f25c40965a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60326/0 (socket says 172.21.15.8:60326) 2023-10-14T17:00:06.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c3fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f25c40678b0 0x7f25c4095e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40424/0 (socket says 172.21.15.8:40424) 2023-10-14T17:00:06.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c37fe700 1 -- 172.21.15.8:0/1389537378 learned_addr learned my addr 172.21.15.8:0/1389537378 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:06.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c89f1700 1 --2- 172.21.15.8:0/1389537378 >> v2:172.21.15.155:3300/0 conn(0x7f25c413c620 0x7f25c413ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c37fe700 1 -- 172.21.15.8:0/1389537378 >> v2:172.21.15.155:3300/0 conn(0x7f25c413c620 msgr2=0x7f25c413ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:06.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c37fe700 1 --2- 172.21.15.8:0/1389537378 >> v2:172.21.15.155:3300/0 conn(0x7f25c413c620 0x7f25c413ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c37fe700 1 -- 172.21.15.8:0/1389537378 >> v1:172.21.15.8:6789/0 conn(0x7f25c40678b0 legacy=0x7f25c4095e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c2ffd700 1 -- 172.21.15.8:0/1389537378 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251414255 0 0) 0x7f25c40976e0 con 0x7f25c40678b0 2023-10-14T17:00:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c37fe700 1 -- 172.21.15.8:0/1389537378 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c4097ef0 con 0x7f25c40988c0 2023-10-14T17:00:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c37fe700 1 --2- 172.21.15.8:0/1389537378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25c40988c0 0x7f25c40965a0 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f25c40a3cc0 tx=0x7f25b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8781ba40911113 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c2ffd700 1 -- 172.21.15.8:0/1389537378 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400b860 con 0x7f25c40988c0 2023-10-14T17:00:06.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c2ffd700 1 -- 172.21.15.8:0/1389537378 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b400b9c0 con 0x7f25c40988c0 2023-10-14T17:00:06.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.789+0000 7f25c2ffd700 1 -- 172.21.15.8:0/1389537378 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400bd80 con 0x7f25c40988c0 2023-10-14T17:00:06.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.790+0000 7f25ca454700 1 -- 172.21.15.8:0/1389537378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25c40988c0 msgr2=0x7f25c40965a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.790+0000 7f25ca454700 1 --2- 172.21.15.8:0/1389537378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25c40988c0 0x7f25c40965a0 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f25c40a3cc0 tx=0x7f25b4009250 comp rx=0 tx=0).stop 2023-10-14T17:00:06.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.790+0000 7f25ca454700 1 -- 172.21.15.8:0/1389537378 shutdown_connections 2023-10-14T17:00:06.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.790+0000 7f25ca454700 1 --2- 172.21.15.8:0/1389537378 >> v2:172.21.15.155:3300/0 conn(0x7f25c413c620 0x7f25c413ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.790+0000 7f25ca454700 1 --2- 172.21.15.8:0/1389537378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25c40988c0 0x7f25c40965a0 unknown :-1 s=CLOSED pgs=2487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.790+0000 7f25ca454700 1 -- 172.21.15.8:0/1389537378 >> 172.21.15.8:0/1389537378 conn(0x7f25c4070380 msgr2=0x7f25c4070780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.790+0000 7f25ca454700 1 -- 172.21.15.8:0/1389537378 shutdown_connections 2023-10-14T17:00:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.790+0000 7f25ca454700 1 -- 172.21.15.8:0/1389537378 wait complete. 2023-10-14T17:00:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.791+0000 7f25ca454700 1 Processor -- start 2023-10-14T17:00:06.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.791+0000 7f25ca454700 1 -- start start 2023-10-14T17:00:06.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.791+0000 7f25ca454700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25c40988c0 0x7f25c4120f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.791+0000 7f25ca454700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25c413c620 0x7f25c411e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.791+0000 7f25ca454700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25c411e750 0x7f25c411ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.791+0000 7f25ca454700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c4121460 con 0x7f25c413c620 2023-10-14T17:00:06.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.791+0000 7f25ca454700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c413c460 con 0x7f25c40988c0 2023-10-14T17:00:06.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.791+0000 7f25ca454700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c411feb0 con 0x7f25c411e750 2023-10-14T17:00:06.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25c37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25c413c620 0x7f25c411e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25c37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25c413c620 0x7f25c411e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60332/0 (socket says 172.21.15.8:60332) 2023-10-14T17:00:06.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25c37fe700 1 -- 172.21.15.8:0/1347024506 learned_addr learned my addr 172.21.15.8:0/1347024506 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:06.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25c3fff700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25c40988c0 0x7f25c4120f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25c89f1700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25c411e750 0x7f25c411ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25c37fe700 1 -- 172.21.15.8:0/1347024506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25c411e750 msgr2=0x7f25c411ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25c37fe700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25c411e750 0x7f25c411ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25c37fe700 1 -- 172.21.15.8:0/1347024506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25c40988c0 msgr2=0x7f25c4120f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:06.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25c37fe700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25c40988c0 0x7f25c4120f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:06.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25c37fe700 1 -- 172.21.15.8:0/1347024506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40094f0 con 0x7f25c413c620 2023-10-14T17:00:06.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25c37fe700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25c413c620 0x7f25c411e210 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f25b4006fd0 tx=0x7f25b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:06.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25bbfff700 1 -- 172.21.15.8:0/1347024506 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b401f070 con 0x7f25c413c620 2023-10-14T17:00:06.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25bbfff700 1 -- 172.21.15.8:0/1347024506 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4006b30 con 0x7f25c413c620 2023-10-14T17:00:06.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25ca454700 1 -- 172.21.15.8:0/1347024506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c4121a80 con 0x7f25c413c620 2023-10-14T17:00:06.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25bbfff700 1 -- 172.21.15.8:0/1347024506 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b401a420 con 0x7f25c413c620 2023-10-14T17:00:06.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.792+0000 7f25ca454700 1 -- 172.21.15.8:0/1347024506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c406fc00 con 0x7f25c413c620 2023-10-14T17:00:06.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.793+0000 7f25ca454700 1 -- 172.21.15.8:0/1347024506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c4121ff0 con 0x7f25c413c620 2023-10-14T17:00:06.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.794+0000 7f25bbfff700 1 -- 172.21.15.8:0/1347024506 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25b401a810 con 0x7f25c413c620 2023-10-14T17:00:06.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.794+0000 7f25bbfff700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f25a4066f30 0x7f25a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:06.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.794+0000 7f25bbfff700 1 -- 172.21.15.8:0/1347024506 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f25b4085410 con 0x7f25c413c620 2023-10-14T17:00:06.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.794+0000 7f25c3fff700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f25a4066f30 0x7f25a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:06.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.794+0000 7f25c3fff700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f25a4066f30 0x7f25a40693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f25ac007fd0 tx=0x7f25ac007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:06.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.798+0000 7f25bbfff700 1 -- 172.21.15.8:0/1347024506 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25b4052c20 con 0x7f25c413c620 2023-10-14T17:00:06.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.985+0000 7f25ca454700 1 -- 172.21.15.8:0/1347024506 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25c41221c0 con 0x7f25a4066f30 2023-10-14T17:00:06.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.993+0000 7f25bbfff700 1 -- 172.21.15.8:0/1347024506 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278859 (secure 0 0 0) 0x7f25c41221c0 con 0x7f25a4066f30 2023-10-14T17:00:06.997 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:00:07.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.996+0000 7f25ca454700 1 -- 172.21.15.8:0/1347024506 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f25a4066f30 msgr2=0x7f25a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:07.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.996+0000 7f25ca454700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f25a4066f30 0x7f25a40693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f25ac007fd0 tx=0x7f25ac007d50 comp rx=0 tx=0).stop 2023-10-14T17:00:07.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.996+0000 7f25ca454700 1 -- 172.21.15.8:0/1347024506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25c413c620 msgr2=0x7f25c411e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:07.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.996+0000 7f25ca454700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25c413c620 0x7f25c411e210 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f25b4006fd0 tx=0x7f25b4017000 comp rx=0 tx=0).stop 2023-10-14T17:00:07.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.996+0000 7f25ca454700 1 -- 172.21.15.8:0/1347024506 shutdown_connections 2023-10-14T17:00:07.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.996+0000 7f25ca454700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f25a4066f30 0x7f25a40693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:07.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.996+0000 7f25ca454700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25c411e750 0x7f25c411ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:07.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.996+0000 7f25ca454700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25c40988c0 0x7f25c4120f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:07.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.996+0000 7f25ca454700 1 --2- 172.21.15.8:0/1347024506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25c413c620 0x7f25c411e210 unknown :-1 s=CLOSED pgs=2488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:07.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.996+0000 7f25ca454700 1 -- 172.21.15.8:0/1347024506 >> 172.21.15.8:0/1347024506 conn(0x7f25c4070380 msgr2=0x7f25c40a5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:07.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.996+0000 7f25ca454700 1 -- 172.21.15.8:0/1347024506 shutdown_connections 2023-10-14T17:00:07.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:06.996+0000 7f25ca454700 1 -- 172.21.15.8:0/1347024506 wait complete. 2023-10-14T17:00:07.003 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T17:00:07.008 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-10-14T17:00:06.050802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":191247906,"num_objects":152,"num_object_clones":21,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":8,"num_read":210,"num_read_kb":798,"num_write":33907,"num_write_kb":206276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75326,"ondisk_log_size":75326,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1608872,"kb_used_data":374664,"kb_used_omap":0,"kb_used_meta":1234176,"kb_avail":375878488,"statfs":{"total":386547056640,"available":384899571712,"internally_reserved":0,"allocated":383655936,"data_stored":382831192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1263796224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":399664,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":3,"num_read":6,"num_read_kb":7,"num_write":71,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002837"},"pg_stats":[{"pgid":"4.3f","version":"23'645","reported_seq":711,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939505+0000","last_change":"2023-10-14T16:59:40.048771+0000","last_active":"2023-10-14T16:59:54.939505+0000","last_peered":"2023-10-14T16:59:54.939505+0000","last_clean":"2023-10-14T16:59:54.939505+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T16:59:54.939505+0000","last_undegraded":"2023-10-14T16:59:54.939505+0000","last_fullsized":"2023-10-14T16:59:54.939505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070427155000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"23'746","reported_seq":812,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938563+0000","last_change":"2023-10-14T16:59:40.012472+0000","last_active":"2023-10-14T16:59:54.938563+0000","last_peered":"2023-10-14T16:59:54.938563+0000","last_clean":"2023-10-14T16:59:54.938563+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T16:59:54.938563+0000","last_undegraded":"2023-10-14T16:59:54.938563+0000","last_fullsized":"2023-10-14T16:59:54.938563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038749005000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'628","reported_seq":694,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933861+0000","last_change":"2023-10-14T16:59:40.031831+0000","last_active":"2023-10-14T16:59:54.933861+0000","last_peered":"2023-10-14T16:59:54.933861+0000","last_clean":"2023-10-14T16:59:54.933861+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T16:59:54.933861+0000","last_undegraded":"2023-10-14T16:59:54.933861+0000","last_fullsized":"2023-10-14T16:59:54.933861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:56.343441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152503000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"23'646","reported_seq":712,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.923219+0000","last_change":"2023-10-14T16:59:40.006348+0000","last_active":"2023-10-14T16:59:54.923219+0000","last_peered":"2023-10-14T16:59:54.923219+0000","last_clean":"2023-10-14T16:59:54.923219+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T16:59:54.923219+0000","last_undegraded":"2023-10-14T16:59:54.923219+0000","last_fullsized":"2023-10-14T16:59:54.923219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:05.483417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033834213000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"23'521","reported_seq":587,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937750+0000","last_change":"2023-10-14T16:59:40.046517+0000","last_active":"2023-10-14T16:59:54.937750+0000","last_peered":"2023-10-14T16:59:54.937750+0000","last_clean":"2023-10-14T16:59:54.937750+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T16:59:54.937750+0000","last_undegraded":"2023-10-14T16:59:54.937750+0000","last_fullsized":"2023-10-14T16:59:54.937750+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070258685000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'532","reported_seq":598,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.918042+0000","last_change":"2023-10-14T16:59:40.032103+0000","last_active":"2023-10-14T16:59:54.918042+0000","last_peered":"2023-10-14T16:59:54.918042+0000","last_clean":"2023-10-14T16:59:54.918042+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T16:59:54.918042+0000","last_undegraded":"2023-10-14T16:59:54.918042+0000","last_fullsized":"2023-10-14T16:59:54.918042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:59.572769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058053194000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'962","reported_seq":1028,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921346+0000","last_change":"2023-10-14T16:59:40.032217+0000","last_active":"2023-10-14T16:59:54.921346+0000","last_peered":"2023-10-14T16:59:54.921346+0000","last_clean":"2023-10-14T16:59:54.921346+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T16:59:54.921346+0000","last_undegraded":"2023-10-14T16:59:54.921346+0000","last_fullsized":"2023-10-14T16:59:54.921346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:15:51.621106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058433710999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'666","reported_seq":732,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.919451+0000","last_change":"2023-10-14T16:59:40.032894+0000","last_active":"2023-10-14T16:59:54.919451+0000","last_peered":"2023-10-14T16:59:54.919451+0000","last_clean":"2023-10-14T16:59:54.919451+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T16:59:54.919451+0000","last_undegraded":"2023-10-14T16:59:54.919451+0000","last_fullsized":"2023-10-14T16:59:54.919451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:40.295415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057530364000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"23'726","reported_seq":792,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939207+0000","last_change":"2023-10-14T16:59:40.048548+0000","last_active":"2023-10-14T16:59:54.939207+0000","last_peered":"2023-10-14T16:59:54.939207+0000","last_clean":"2023-10-14T16:59:54.939207+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T16:59:54.939207+0000","last_undegraded":"2023-10-14T16:59:54.939207+0000","last_fullsized":"2023-10-14T16:59:54.939207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070350251000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'591","reported_seq":657,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933559+0000","last_change":"2023-10-14T16:59:40.030928+0000","last_active":"2023-10-14T16:59:54.933559+0000","last_peered":"2023-10-14T16:59:54.933559+0000","last_clean":"2023-10-14T16:59:54.933559+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T16:59:54.933559+0000","last_undegraded":"2023-10-14T16:59:54.933559+0000","last_fullsized":"2023-10-14T16:59:54.933559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:54:37.853332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057828565999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"23'504","reported_seq":569,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.920075+0000","last_change":"2023-10-14T16:59:40.011889+0000","last_active":"2023-10-14T16:59:54.920075+0000","last_peered":"2023-10-14T16:59:54.920075+0000","last_clean":"2023-10-14T16:59:54.920075+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T16:59:54.920075+0000","last_undegraded":"2023-10-14T16:59:54.920075+0000","last_fullsized":"2023-10-14T16:59:54.920075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:18:19.208533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039012109000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"23'510","reported_seq":576,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938970+0000","last_change":"2023-10-14T16:59:40.020882+0000","last_active":"2023-10-14T16:59:54.938970+0000","last_peered":"2023-10-14T16:59:54.938970+0000","last_clean":"2023-10-14T16:59:54.938970+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T16:59:54.938970+0000","last_undegraded":"2023-10-14T16:59:54.938970+0000","last_fullsized":"2023-10-14T16:59:54.938970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047436036000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"23'512","reported_seq":578,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930357+0000","last_change":"2023-10-14T16:59:40.046901+0000","last_active":"2023-10-14T16:59:54.930357+0000","last_peered":"2023-10-14T16:59:54.930357+0000","last_clean":"2023-10-14T16:59:54.930357+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T16:59:54.930357+0000","last_undegraded":"2023-10-14T16:59:54.930357+0000","last_fullsized":"2023-10-14T16:59:54.930357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:13.440525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070191972000000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"23'757","reported_seq":822,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938286+0000","last_change":"2023-10-14T16:59:40.009015+0000","last_active":"2023-10-14T16:59:54.938286+0000","last_peered":"2023-10-14T16:59:54.938286+0000","last_clean":"2023-10-14T16:59:54.938286+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T16:59:54.938286+0000","last_undegraded":"2023-10-14T16:59:54.938286+0000","last_fullsized":"2023-10-14T16:59:54.938286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036605058000000003,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"23'655","reported_seq":721,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.932286+0000","last_change":"2023-10-14T16:59:40.012646+0000","last_active":"2023-10-14T16:59:54.932286+0000","last_peered":"2023-10-14T16:59:54.932286+0000","last_clean":"2023-10-14T16:59:54.932286+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T16:59:54.932286+0000","last_undegraded":"2023-10-14T16:59:54.932286+0000","last_fullsized":"2023-10-14T16:59:54.932286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038947427,"stat_sum":{"num_bytes":4105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"23'745","reported_seq":810,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933504+0000","last_change":"2023-10-14T16:59:40.032292+0000","last_active":"2023-10-14T16:59:54.933504+0000","last_peered":"2023-10-14T16:59:54.933504+0000","last_clean":"2023-10-14T16:59:54.933504+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T16:59:54.933504+0000","last_undegraded":"2023-10-14T16:59:54.933504+0000","last_fullsized":"2023-10-14T16:59:54.933504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:41:12.510526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058345898,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'595","reported_seq":661,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939581+0000","last_change":"2023-10-14T16:59:40.048812+0000","last_active":"2023-10-14T16:59:54.939581+0000","last_peered":"2023-10-14T16:59:54.939581+0000","last_clean":"2023-10-14T16:59:54.939581+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T16:59:54.939581+0000","last_undegraded":"2023-10-14T16:59:54.939581+0000","last_fullsized":"2023-10-14T16:59:54.939581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071573409000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'693","reported_seq":759,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.932562+0000","last_change":"2023-10-14T16:59:40.030743+0000","last_active":"2023-10-14T16:59:54.932562+0000","last_peered":"2023-10-14T16:59:54.932562+0000","last_clean":"2023-10-14T16:59:54.932562+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T16:59:54.932562+0000","last_undegraded":"2023-10-14T16:59:54.932562+0000","last_fullsized":"2023-10-14T16:59:54.932562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057407435999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"23'572","reported_seq":639,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.929581+0000","last_change":"2023-10-14T16:59:40.045847+0000","last_active":"2023-10-14T16:59:54.929581+0000","last_peered":"2023-10-14T16:59:54.929581+0000","last_clean":"2023-10-14T16:59:54.929581+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T16:59:54.929581+0000","last_undegraded":"2023-10-14T16:59:54.929581+0000","last_fullsized":"2023-10-14T16:59:54.929581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070060102999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"23'761","reported_seq":827,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939075+0000","last_change":"2023-10-14T16:59:40.029354+0000","last_active":"2023-10-14T16:59:54.939075+0000","last_peered":"2023-10-14T16:59:54.939075+0000","last_clean":"2023-10-14T16:59:54.939075+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T16:59:54.939075+0000","last_undegraded":"2023-10-14T16:59:54.939075+0000","last_fullsized":"2023-10-14T16:59:54.939075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056633790000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"23'810","reported_seq":876,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938705+0000","last_change":"2023-10-14T16:59:40.012817+0000","last_active":"2023-10-14T16:59:54.938705+0000","last_peered":"2023-10-14T16:59:54.938705+0000","last_clean":"2023-10-14T16:59:54.938705+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T16:59:54.938705+0000","last_undegraded":"2023-10-14T16:59:54.938705+0000","last_fullsized":"2023-10-14T16:59:54.938705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038418550000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"23'694","reported_seq":760,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938748+0000","last_change":"2023-10-14T16:59:40.041012+0000","last_active":"2023-10-14T16:59:54.938748+0000","last_peered":"2023-10-14T16:59:54.938748+0000","last_clean":"2023-10-14T16:59:54.938748+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T16:59:54.938748+0000","last_undegraded":"2023-10-14T16:59:54.938748+0000","last_fullsized":"2023-10-14T16:59:54.938748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.065688290999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'638","reported_seq":704,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935953+0000","last_change":"2023-10-14T16:59:39.983318+0000","last_active":"2023-10-14T16:59:54.935953+0000","last_peered":"2023-10-14T16:59:54.935953+0000","last_clean":"2023-10-14T16:59:54.935953+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T16:59:54.935953+0000","last_undegraded":"2023-10-14T16:59:54.935953+0000","last_fullsized":"2023-10-14T16:59:54.935953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011260075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"23'846","reported_seq":912,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934718+0000","last_change":"2023-10-14T16:59:40.031942+0000","last_active":"2023-10-14T16:59:54.934718+0000","last_peered":"2023-10-14T16:59:54.934718+0000","last_clean":"2023-10-14T16:59:54.934718+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T16:59:54.934718+0000","last_undegraded":"2023-10-14T16:59:54.934718+0000","last_fullsized":"2023-10-14T16:59:54.934718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"23'636","reported_seq":702,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938462+0000","last_change":"2023-10-14T16:59:40.023150+0000","last_active":"2023-10-14T16:59:54.938462+0000","last_peered":"2023-10-14T16:59:54.938462+0000","last_clean":"2023-10-14T16:59:54.938462+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T16:59:54.938462+0000","last_undegraded":"2023-10-14T16:59:54.938462+0000","last_fullsized":"2023-10-14T16:59:54.938462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048983802,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'679","reported_seq":745,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935906+0000","last_change":"2023-10-14T16:59:40.021577+0000","last_active":"2023-10-14T16:59:54.935906+0000","last_peered":"2023-10-14T16:59:54.935906+0000","last_clean":"2023-10-14T16:59:54.935906+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T16:59:54.935906+0000","last_undegraded":"2023-10-14T16:59:54.935906+0000","last_fullsized":"2023-10-14T16:59:54.935906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047799974000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'513","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933795+0000","last_change":"2023-10-14T16:59:40.032393+0000","last_active":"2023-10-14T16:59:54.933795+0000","last_peered":"2023-10-14T16:59:54.933795+0000","last_clean":"2023-10-14T16:59:54.933795+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T16:59:54.933795+0000","last_undegraded":"2023-10-14T16:59:54.933795+0000","last_fullsized":"2023-10-14T16:59:54.933795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:53:46.761206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058565578,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1532","reported_seq":1549,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972294+0000","last_change":"2023-10-14T16:54:54.101946+0000","last_active":"2023-10-14T16:59:39.972294+0000","last_peered":"2023-10-14T16:59:39.972294+0000","last_clean":"2023-10-14T16:59:39.972294+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T16:59:39.972294+0000","last_undegraded":"2023-10-14T16:59:39.972294+0000","last_fullsized":"2023-10-14T16:59:39.972294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1532,"log_dups_size":0,"ondisk_log_size":1532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1524,"num_write_kb":13073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"23'653","reported_seq":720,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936652+0000","last_change":"2023-10-14T16:59:40.043067+0000","last_active":"2023-10-14T16:59:54.936652+0000","last_peered":"2023-10-14T16:59:54.936652+0000","last_clean":"2023-10-14T16:59:54.936652+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T16:59:54.936652+0000","last_undegraded":"2023-10-14T16:59:54.936652+0000","last_fullsized":"2023-10-14T16:59:54.936652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067459389999999994,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"22'755","reported_seq":772,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.480503+0000","last_change":"2023-10-14T16:54:54.096872+0000","last_active":"2023-10-14T16:59:40.480503+0000","last_peered":"2023-10-14T16:59:40.480503+0000","last_clean":"2023-10-14T16:59:40.480503+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T16:59:40.480503+0000","last_undegraded":"2023-10-14T16:59:40.480503+0000","last_fullsized":"2023-10-14T16:59:40.480503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'585","reported_seq":651,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937438+0000","last_change":"2023-10-14T16:59:40.047218+0000","last_active":"2023-10-14T16:59:54.937438+0000","last_peered":"2023-10-14T16:59:54.937438+0000","last_clean":"2023-10-14T16:59:54.937438+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T16:59:54.937438+0000","last_undegraded":"2023-10-14T16:59:54.937438+0000","last_fullsized":"2023-10-14T16:59:54.937438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070886901000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1506","reported_seq":1523,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.115969+0000","last_change":"2023-10-14T16:54:54.094974+0000","last_active":"2023-10-14T16:59:48.115969+0000","last_peered":"2023-10-14T16:59:48.115969+0000","last_clean":"2023-10-14T16:59:48.115969+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T16:59:48.115969+0000","last_undegraded":"2023-10-14T16:59:48.115969+0000","last_fullsized":"2023-10-14T16:59:48.115969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"23'593","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936070+0000","last_change":"2023-10-14T16:59:40.031610+0000","last_active":"2023-10-14T16:59:54.936070+0000","last_peered":"2023-10-14T16:59:54.936070+0000","last_clean":"2023-10-14T16:59:54.936070+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T16:59:54.936070+0000","last_undegraded":"2023-10-14T16:59:54.936070+0000","last_fullsized":"2023-10-14T16:59:54.936070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058803686000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"22'4","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.479890+0000","last_change":"2023-10-14T16:54:54.098193+0000","last_active":"2023-10-14T16:59:40.479890+0000","last_peered":"2023-10-14T16:59:40.479890+0000","last_clean":"2023-10-14T16:59:40.479890+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T16:59:40.479890+0000","last_undegraded":"2023-10-14T16:59:40.479890+0000","last_fullsized":"2023-10-14T16:59:40.479890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:32:33.333473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'583","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935086+0000","last_change":"2023-10-14T16:59:39.997256+0000","last_active":"2023-10-14T16:59:54.935086+0000","last_peered":"2023-10-14T16:59:54.935086+0000","last_clean":"2023-10-14T16:59:54.935086+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T16:59:54.935086+0000","last_undegraded":"2023-10-14T16:59:54.935086+0000","last_fullsized":"2023-10-14T16:59:54.935086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:16.409213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024750503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'756","reported_seq":773,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971815+0000","last_change":"2023-10-14T16:54:54.100620+0000","last_active":"2023-10-14T16:59:47.971815+0000","last_peered":"2023-10-14T16:59:47.971815+0000","last_clean":"2023-10-14T16:59:47.971815+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T16:59:47.971815+0000","last_undegraded":"2023-10-14T16:59:47.971815+0000","last_fullsized":"2023-10-14T16:59:47.971815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'570","reported_seq":636,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.927022+0000","last_change":"2023-10-14T16:59:40.043286+0000","last_active":"2023-10-14T16:59:54.927022+0000","last_peered":"2023-10-14T16:59:54.927022+0000","last_clean":"2023-10-14T16:59:54.927022+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T16:59:54.927022+0000","last_undegraded":"2023-10-14T16:59:54.927022+0000","last_fullsized":"2023-10-14T16:59:54.927022+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067572238000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"23'798","reported_seq":815,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.489258+0000","last_change":"2023-10-14T16:54:54.097908+0000","last_active":"2023-10-14T16:59:55.489258+0000","last_peered":"2023-10-14T16:59:55.489258+0000","last_clean":"2023-10-14T16:59:55.489258+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T16:59:55.489258+0000","last_undegraded":"2023-10-14T16:59:55.489258+0000","last_fullsized":"2023-10-14T16:59:55.489258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"23'414","reported_seq":480,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936113+0000","last_change":"2023-10-14T16:59:39.986224+0000","last_active":"2023-10-14T16:59:54.936113+0000","last_peered":"2023-10-14T16:59:54.936113+0000","last_clean":"2023-10-14T16:59:54.936113+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T16:59:54.936113+0000","last_undegraded":"2023-10-14T16:59:54.936113+0000","last_fullsized":"2023-10-14T16:59:54.936113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013962693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'2297","reported_seq":2314,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:52.483484+0000","last_change":"2023-10-14T16:54:54.098933+0000","last_active":"2023-10-14T16:59:52.483484+0000","last_peered":"2023-10-14T16:59:52.483484+0000","last_clean":"2023-10-14T16:59:52.483484+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T16:59:52.483484+0000","last_undegraded":"2023-10-14T16:59:52.483484+0000","last_fullsized":"2023-10-14T16:59:52.483484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2297,"log_dups_size":0,"ondisk_log_size":2297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:47.391039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2289,"num_write_kb":13405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"23'485","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.922514+0000","last_change":"2023-10-14T16:59:40.013142+0000","last_active":"2023-10-14T16:59:54.922514+0000","last_peered":"2023-10-14T16:59:54.922514+0000","last_clean":"2023-10-14T16:59:54.922514+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T16:59:54.922514+0000","last_undegraded":"2023-10-14T16:59:54.922514+0000","last_fullsized":"2023-10-14T16:59:54.922514+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038441039000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"21'1506","reported_seq":1523,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972386+0000","last_change":"2023-10-14T16:54:54.103486+0000","last_active":"2023-10-14T16:59:39.972386+0000","last_peered":"2023-10-14T16:59:39.972386+0000","last_clean":"2023-10-14T16:59:39.972386+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T16:59:39.972386+0000","last_undegraded":"2023-10-14T16:59:39.972386+0000","last_fullsized":"2023-10-14T16:59:39.972386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1498,"num_write_kb":8967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"23'532","reported_seq":598,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935883+0000","last_change":"2023-10-14T16:59:40.021641+0000","last_active":"2023-10-14T16:59:54.935883+0000","last_peered":"2023-10-14T16:59:54.935883+0000","last_clean":"2023-10-14T16:59:54.935883+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T16:59:54.935883+0000","last_undegraded":"2023-10-14T16:59:54.935883+0000","last_fullsized":"2023-10-14T16:59:54.935883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:06.293959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047574827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"22'3","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.480173+0000","last_change":"2023-10-14T16:54:54.098087+0000","last_active":"2023-10-14T16:59:40.480173+0000","last_peered":"2023-10-14T16:59:40.480173+0000","last_clean":"2023-10-14T16:59:40.480173+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T16:59:40.480173+0000","last_undegraded":"2023-10-14T16:59:40.480173+0000","last_fullsized":"2023-10-14T16:59:40.480173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:45:48.428626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'545","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933734+0000","last_change":"2023-10-14T16:59:40.032678+0000","last_active":"2023-10-14T16:59:54.933734+0000","last_peered":"2023-10-14T16:59:54.933734+0000","last_clean":"2023-10-14T16:59:54.933734+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T16:59:54.933734+0000","last_undegraded":"2023-10-14T16:59:54.933734+0000","last_fullsized":"2023-10-14T16:59:54.933734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:21:19.831648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057513697000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"22'5","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:46.477708+0000","last_change":"2023-10-14T16:54:54.099046+0000","last_active":"2023-10-14T16:59:46.477708+0000","last_peered":"2023-10-14T16:59:46.477708+0000","last_clean":"2023-10-14T16:59:46.477708+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T16:59:46.477708+0000","last_undegraded":"2023-10-14T16:59:46.477708+0000","last_fullsized":"2023-10-14T16:59:46.477708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:13.092692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"23'1019","reported_seq":1085,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.940665+0000","last_change":"2023-10-14T16:59:40.049106+0000","last_active":"2023-10-14T16:59:54.940665+0000","last_peered":"2023-10-14T16:59:54.940665+0000","last_clean":"2023-10-14T16:59:54.940665+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T16:59:54.940665+0000","last_undegraded":"2023-10-14T16:59:54.940665+0000","last_fullsized":"2023-10-14T16:59:54.940665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:06.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.07026193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'1511","reported_seq":1528,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.479573+0000","last_change":"2023-10-14T16:54:54.099281+0000","last_active":"2023-10-14T16:59:40.479573+0000","last_peered":"2023-10-14T16:59:40.479573+0000","last_clean":"2023-10-14T16:59:40.479573+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T16:59:40.479573+0000","last_undegraded":"2023-10-14T16:59:40.479573+0000","last_fullsized":"2023-10-14T16:59:40.479573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1511,"log_dups_size":0,"ondisk_log_size":1511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:47.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1507,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'585","reported_seq":651,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930146+0000","last_change":"2023-10-14T16:59:40.048352+0000","last_active":"2023-10-14T16:59:54.930146+0000","last_peered":"2023-10-14T16:59:54.930146+0000","last_clean":"2023-10-14T16:59:54.930146+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T16:59:54.930146+0000","last_undegraded":"2023-10-14T16:59:54.930146+0000","last_fullsized":"2023-10-14T16:59:54.930146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:29.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071266745000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"23'755","reported_seq":772,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971355+0000","last_change":"2023-10-14T16:54:54.100726+0000","last_active":"2023-10-14T16:59:47.971355+0000","last_peered":"2023-10-14T16:59:47.971355+0000","last_clean":"2023-10-14T16:59:47.971355+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T16:59:47.971355+0000","last_undegraded":"2023-10-14T16:59:47.971355+0000","last_fullsized":"2023-10-14T16:59:47.971355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"23'813","reported_seq":879,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921098+0000","last_change":"2023-10-14T16:59:40.032754+0000","last_active":"2023-10-14T16:59:54.921098+0000","last_peered":"2023-10-14T16:59:54.921098+0000","last_clean":"2023-10-14T16:59:54.921098+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T16:59:54.921098+0000","last_undegraded":"2023-10-14T16:59:54.921098+0000","last_fullsized":"2023-10-14T16:59:54.921098+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057360406000000003,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"22'756","reported_seq":773,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481912+0000","last_change":"2023-10-14T16:54:54.097646+0000","last_active":"2023-10-14T16:59:40.481912+0000","last_peered":"2023-10-14T16:59:40.481912+0000","last_clean":"2023-10-14T16:59:40.481912+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T16:59:40.481912+0000","last_undegraded":"2023-10-14T16:59:40.481912+0000","last_fullsized":"2023-10-14T16:59:40.481912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:25.315141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'593","reported_seq":658,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.932091+0000","last_change":"2023-10-14T16:59:40.012812+0000","last_active":"2023-10-14T16:59:54.932091+0000","last_peered":"2023-10-14T16:59:54.932091+0000","last_clean":"2023-10-14T16:59:54.932091+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T16:59:54.932091+0000","last_undegraded":"2023-10-14T16:59:54.932091+0000","last_fullsized":"2023-10-14T16:59:54.932091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039029367000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'755","reported_seq":772,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:42.475797+0000","last_change":"2023-10-14T16:54:54.100923+0000","last_active":"2023-10-14T16:59:42.475797+0000","last_peered":"2023-10-14T16:59:42.475797+0000","last_clean":"2023-10-14T16:59:42.475797+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T16:59:42.475797+0000","last_undegraded":"2023-10-14T16:59:42.475797+0000","last_fullsized":"2023-10-14T16:59:42.475797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'442","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921947+0000","last_change":"2023-10-14T16:59:40.009237+0000","last_active":"2023-10-14T16:59:54.921947+0000","last_peered":"2023-10-14T16:59:54.921947+0000","last_clean":"2023-10-14T16:59:54.921947+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T16:59:54.921947+0000","last_undegraded":"2023-10-14T16:59:54.921947+0000","last_fullsized":"2023-10-14T16:59:54.921947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:19:12.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036384234000000001,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"23'10","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971383+0000","last_change":"2023-10-14T16:54:54.099363+0000","last_active":"2023-10-14T16:59:47.971383+0000","last_peered":"2023-10-14T16:59:47.971383+0000","last_clean":"2023-10-14T16:59:47.971383+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T16:59:47.971383+0000","last_undegraded":"2023-10-14T16:59:47.971383+0000","last_fullsized":"2023-10-14T16:59:47.971383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:52.124832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"23'731","reported_seq":797,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937679+0000","last_change":"2023-10-14T16:59:40.046588+0000","last_active":"2023-10-14T16:59:54.937679+0000","last_peered":"2023-10-14T16:59:54.937679+0000","last_clean":"2023-10-14T16:59:54.937679+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T16:59:54.937679+0000","last_undegraded":"2023-10-14T16:59:54.937679+0000","last_fullsized":"2023-10-14T16:59:54.937679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070178661000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'1498","reported_seq":1515,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.487396+0000","last_change":"2023-10-14T16:54:54.093771+0000","last_active":"2023-10-14T16:59:55.487396+0000","last_peered":"2023-10-14T16:59:55.487396+0000","last_clean":"2023-10-14T16:59:55.487396+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T16:59:55.487396+0000","last_undegraded":"2023-10-14T16:59:55.487396+0000","last_fullsized":"2023-10-14T16:59:55.487396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1498,"log_dups_size":0,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":12977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"23'732","reported_seq":798,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939415+0000","last_change":"2023-10-14T16:59:40.007122+0000","last_active":"2023-10-14T16:59:54.939415+0000","last_peered":"2023-10-14T16:59:54.939415+0000","last_clean":"2023-10-14T16:59:54.939415+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T16:59:54.939415+0000","last_undegraded":"2023-10-14T16:59:54.939415+0000","last_fullsized":"2023-10-14T16:59:54.939415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034606716000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"22'3227","reported_seq":3244,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481438+0000","last_change":"2023-10-14T16:54:54.103401+0000","last_active":"2023-10-14T16:59:40.481438+0000","last_peered":"2023-10-14T16:59:40.481438+0000","last_clean":"2023-10-14T16:59:40.481438+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T16:59:40.481438+0000","last_undegraded":"2023-10-14T16:59:40.481438+0000","last_fullsized":"2023-10-14T16:59:40.481438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:28.931284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3218,"num_write_kb":10301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'567","reported_seq":632,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930805+0000","last_change":"2023-10-14T16:59:40.032481+0000","last_active":"2023-10-14T16:59:54.930805+0000","last_peered":"2023-10-14T16:59:54.930805+0000","last_clean":"2023-10-14T16:59:54.930805+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T16:59:54.930805+0000","last_undegraded":"2023-10-14T16:59:54.930805+0000","last_fullsized":"2023-10-14T16:59:54.930805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:33:02.932716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057531643,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"21'650","reported_seq":667,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974165+0000","last_change":"2023-10-14T16:54:54.099084+0000","last_active":"2023-10-14T16:59:39.974165+0000","last_peered":"2023-10-14T16:59:39.974165+0000","last_clean":"2023-10-14T16:59:39.974165+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T16:59:39.974165+0000","last_undegraded":"2023-10-14T16:59:39.974165+0000","last_fullsized":"2023-10-14T16:59:39.974165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:07:27.318420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'600","reported_seq":687,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.923665+0000","last_change":"2023-10-14T16:59:40.012352+0000","last_active":"2023-10-14T16:59:54.923665+0000","last_peered":"2023-10-14T16:59:54.923665+0000","last_clean":"2023-10-14T16:59:54.923665+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T16:59:54.923665+0000","last_undegraded":"2023-10-14T16:59:54.923665+0000","last_fullsized":"2023-10-14T16:59:54.923665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:12.562614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038477224999999997,"stat_sum":{"num_bytes":16395,"num_objects":10,"num_object_clones":4,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":32,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"23'757","reported_seq":774,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.115853+0000","last_change":"2023-10-14T16:54:54.095927+0000","last_active":"2023-10-14T16:59:48.115853+0000","last_peered":"2023-10-14T16:59:48.115853+0000","last_clean":"2023-10-14T16:59:48.115853+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T16:59:48.115853+0000","last_undegraded":"2023-10-14T16:59:48.115853+0000","last_fullsized":"2023-10-14T16:59:48.115853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:46:57.926203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'595","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930450+0000","last_change":"2023-10-14T16:59:40.048170+0000","last_active":"2023-10-14T16:59:54.930450+0000","last_peered":"2023-10-14T16:59:54.930450+0000","last_clean":"2023-10-14T16:59:54.930450+0000","last_became_active":"2023-10-14T16:55:45.058862+0000","last_became_peered":"2023-10-14T16:55:45.058862+0000","last_unstale":"2023-10-14T16:59:54.930450+0000","last_undegraded":"2023-10-14T16:59:54.930450+0000","last_fullsized":"2023-10-14T16:59:54.930450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:08.172437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071388894999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'771","reported_seq":788,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.117367+0000","last_change":"2023-10-14T16:54:54.092032+0000","last_active":"2023-10-14T16:59:48.117367+0000","last_peered":"2023-10-14T16:59:48.117367+0000","last_clean":"2023-10-14T16:59:48.117367+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T16:59:48.117367+0000","last_undegraded":"2023-10-14T16:59:48.117367+0000","last_fullsized":"2023-10-14T16:59:48.117367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973059+0000","last_change":"2023-10-14T16:54:49.689264+0000","last_active":"2023-10-14T16:59:39.973059+0000","last_peered":"2023-10-14T16:59:39.973059+0000","last_clean":"2023-10-14T16:59:39.973059+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T16:59:39.973059+0000","last_undegraded":"2023-10-14T16:59:39.973059+0000","last_fullsized":"2023-10-14T16:59:39.973059+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"23'518","reported_seq":584,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.918996+0000","last_change":"2023-10-14T16:59:40.037294+0000","last_active":"2023-10-14T16:59:54.918996+0000","last_peered":"2023-10-14T16:59:54.918996+0000","last_clean":"2023-10-14T16:59:54.918996+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T16:59:54.918996+0000","last_undegraded":"2023-10-14T16:59:54.918996+0000","last_fullsized":"2023-10-14T16:59:54.918996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:49.350211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061999158999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973570+0000","last_change":"2023-10-14T16:54:49.063336+0000","last_active":"2023-10-14T16:59:39.973570+0000","last_peered":"2023-10-14T16:59:39.973570+0000","last_clean":"2023-10-14T16:59:39.973570+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T16:59:39.973570+0000","last_undegraded":"2023-10-14T16:59:39.973570+0000","last_fullsized":"2023-10-14T16:59:39.973570+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"23'49","reported_seq":66,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.219902+0000","last_change":"2023-10-14T16:54:54.093189+0000","last_active":"2023-10-14T16:59:54.219902+0000","last_peered":"2023-10-14T16:59:54.219902+0000","last_clean":"2023-10-14T16:59:54.219902+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T16:59:54.219902+0000","last_undegraded":"2023-10-14T16:59:54.219902+0000","last_fullsized":"2023-10-14T16:59:54.219902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:47.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'517","reported_seq":583,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.922222+0000","last_change":"2023-10-14T16:59:40.011990+0000","last_active":"2023-10-14T16:59:54.922222+0000","last_peered":"2023-10-14T16:59:54.922222+0000","last_clean":"2023-10-14T16:59:54.922222+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T16:59:54.922222+0000","last_undegraded":"2023-10-14T16:59:54.922222+0000","last_fullsized":"2023-10-14T16:59:54.922222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:11:48.395824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038513458,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972353+0000","last_change":"2023-10-14T16:54:49.063688+0000","last_active":"2023-10-14T16:59:39.972353+0000","last_peered":"2023-10-14T16:59:39.972353+0000","last_clean":"2023-10-14T16:59:39.972353+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T16:59:39.972353+0000","last_undegraded":"2023-10-14T16:59:39.972353+0000","last_fullsized":"2023-10-14T16:59:39.972353+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:29.004325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974149+0000","last_change":"2023-10-14T16:54:49.063307+0000","last_active":"2023-10-14T16:59:39.974149+0000","last_peered":"2023-10-14T16:59:39.974149+0000","last_clean":"2023-10-14T16:59:39.974149+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T16:59:39.974149+0000","last_undegraded":"2023-10-14T16:59:39.974149+0000","last_fullsized":"2023-10-14T16:59:39.974149+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:14.196065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'76","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.483585+0000","last_change":"2023-10-14T16:54:54.098588+0000","last_active":"2023-10-14T16:59:55.483585+0000","last_peered":"2023-10-14T16:59:55.483585+0000","last_clean":"2023-10-14T16:59:55.483585+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T16:59:55.483585+0000","last_undegraded":"2023-10-14T16:59:55.483585+0000","last_fullsized":"2023-10-14T16:59:55.483585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:18.107600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":646501,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":64,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'754","reported_seq":821,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.940187+0000","last_change":"2023-10-14T16:59:40.048570+0000","last_active":"2023-10-14T16:59:54.940187+0000","last_peered":"2023-10-14T16:59:54.940187+0000","last_clean":"2023-10-14T16:59:54.940187+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T16:59:54.940187+0000","last_undegraded":"2023-10-14T16:59:54.940187+0000","last_fullsized":"2023-10-14T16:59:54.940187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:28:18.213416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069884818000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972495+0000","last_change":"2023-10-14T16:54:49.689356+0000","last_active":"2023-10-14T16:59:39.972495+0000","last_peered":"2023-10-14T16:59:39.972495+0000","last_clean":"2023-10-14T16:59:39.972495+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T16:59:39.972495+0000","last_undegraded":"2023-10-14T16:59:39.972495+0000","last_fullsized":"2023-10-14T16:59:39.972495+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:07.488615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'2235","reported_seq":2252,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972193+0000","last_change":"2023-10-14T16:54:54.093196+0000","last_active":"2023-10-14T16:59:39.972193+0000","last_peered":"2023-10-14T16:59:39.972193+0000","last_clean":"2023-10-14T16:59:39.972193+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T16:59:39.972193+0000","last_undegraded":"2023-10-14T16:59:39.972193+0000","last_fullsized":"2023-10-14T16:59:39.972193+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2235,"log_dups_size":0,"ondisk_log_size":2235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:40.579119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2227,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'634","reported_seq":700,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935223+0000","last_change":"2023-10-14T16:59:40.021827+0000","last_active":"2023-10-14T16:59:54.935223+0000","last_peered":"2023-10-14T16:59:54.935223+0000","last_clean":"2023-10-14T16:59:54.935223+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T16:59:54.935223+0000","last_undegraded":"2023-10-14T16:59:54.935223+0000","last_fullsized":"2023-10-14T16:59:54.935223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047771027000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974066+0000","last_change":"2023-10-14T16:54:49.689595+0000","last_active":"2023-10-14T16:59:39.974066+0000","last_peered":"2023-10-14T16:59:39.974066+0000","last_clean":"2023-10-14T16:59:39.974066+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T16:59:39.974066+0000","last_undegraded":"2023-10-14T16:59:39.974066+0000","last_fullsized":"2023-10-14T16:59:39.974066+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:46:44.177180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1503","reported_seq":1520,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972138+0000","last_change":"2023-10-14T16:54:54.099381+0000","last_active":"2023-10-14T16:59:39.972138+0000","last_peered":"2023-10-14T16:59:39.972138+0000","last_clean":"2023-10-14T16:59:39.972138+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T16:59:39.972138+0000","last_undegraded":"2023-10-14T16:59:39.972138+0000","last_fullsized":"2023-10-14T16:59:39.972138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:00.067177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"23'759","reported_seq":824,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.931088+0000","last_change":"2023-10-14T16:59:40.032574+0000","last_active":"2023-10-14T16:59:54.931088+0000","last_peered":"2023-10-14T16:59:54.931088+0000","last_clean":"2023-10-14T16:59:54.931088+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T16:59:54.931088+0000","last_undegraded":"2023-10-14T16:59:54.931088+0000","last_fullsized":"2023-10-14T16:59:54.931088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057422879000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.974081+0000","last_change":"2023-10-14T16:54:49.689614+0000","last_active":"2023-10-14T16:59:39.974081+0000","last_peered":"2023-10-14T16:59:39.974081+0000","last_clean":"2023-10-14T16:59:39.974081+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T16:59:39.974081+0000","last_undegraded":"2023-10-14T16:59:39.974081+0000","last_fullsized":"2023-10-14T16:59:39.974081+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:09.272835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'741","reported_seq":758,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.483744+0000","last_change":"2023-10-14T16:54:54.100656+0000","last_active":"2023-10-14T16:59:54.483744+0000","last_peered":"2023-10-14T16:59:54.483744+0000","last_clean":"2023-10-14T16:59:54.483744+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T16:59:54.483744+0000","last_undegraded":"2023-10-14T16:59:54.483744+0000","last_fullsized":"2023-10-14T16:59:54.483744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:52.001928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'580","reported_seq":646,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938837+0000","last_change":"2023-10-14T16:59:40.021216+0000","last_active":"2023-10-14T16:59:54.938837+0000","last_peered":"2023-10-14T16:59:54.938837+0000","last_clean":"2023-10-14T16:59:54.938837+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T16:59:54.938837+0000","last_undegraded":"2023-10-14T16:59:54.938837+0000","last_fullsized":"2023-10-14T16:59:54.938837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:20.274344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047665379000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973447+0000","last_change":"2023-10-14T16:54:49.689836+0000","last_active":"2023-10-14T16:59:39.973447+0000","last_peered":"2023-10-14T16:59:39.973447+0000","last_clean":"2023-10-14T16:59:39.973447+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T16:59:39.973447+0000","last_undegraded":"2023-10-14T16:59:39.973447+0000","last_fullsized":"2023-10-14T16:59:39.973447+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:24.843234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"21'737","reported_seq":754,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.973689+0000","last_change":"2023-10-14T16:54:54.096618+0000","last_active":"2023-10-14T16:59:39.973689+0000","last_peered":"2023-10-14T16:59:39.973689+0000","last_clean":"2023-10-14T16:59:39.973689+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T16:59:39.973689+0000","last_undegraded":"2023-10-14T16:59:39.973689+0000","last_fullsized":"2023-10-14T16:59:39.973689+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'697","reported_seq":763,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930425+0000","last_change":"2023-10-14T16:59:40.044773+0000","last_active":"2023-10-14T16:59:54.930425+0000","last_peered":"2023-10-14T16:59:54.930425+0000","last_clean":"2023-10-14T16:59:54.930425+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T16:59:54.930425+0000","last_undegraded":"2023-10-14T16:59:54.930425+0000","last_fullsized":"2023-10-14T16:59:54.930425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068678344000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972989+0000","last_change":"2023-10-14T16:54:49.064767+0000","last_active":"2023-10-14T16:59:39.972989+0000","last_peered":"2023-10-14T16:59:39.972989+0000","last_clean":"2023-10-14T16:59:39.972989+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T16:59:39.972989+0000","last_undegraded":"2023-10-14T16:59:39.972989+0000","last_fullsized":"2023-10-14T16:59:39.972989+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:34:26.616500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"21'1040","reported_seq":1057,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.972984+0000","last_change":"2023-10-14T16:54:54.106280+0000","last_active":"2023-10-14T16:59:39.972984+0000","last_peered":"2023-10-14T16:59:39.972984+0000","last_clean":"2023-10-14T16:59:39.972984+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T16:59:39.972984+0000","last_undegraded":"2023-10-14T16:59:39.972984+0000","last_fullsized":"2023-10-14T16:59:39.972984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1040,"log_dups_size":0,"ondisk_log_size":1040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:26.610557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":8695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"23'754","reported_seq":820,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936228+0000","last_change":"2023-10-14T16:59:39.988269+0000","last_active":"2023-10-14T16:59:54.936228+0000","last_peered":"2023-10-14T16:59:54.936228+0000","last_clean":"2023-10-14T16:59:54.936228+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T16:59:54.936228+0000","last_undegraded":"2023-10-14T16:59:54.936228+0000","last_fullsized":"2023-10-14T16:59:54.936228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:53.173556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015859669999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'740","reported_seq":757,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481350+0000","last_change":"2023-10-14T16:54:54.102987+0000","last_active":"2023-10-14T16:59:40.481350+0000","last_peered":"2023-10-14T16:59:40.481350+0000","last_clean":"2023-10-14T16:59:40.481350+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T16:59:40.481350+0000","last_undegraded":"2023-10-14T16:59:40.481350+0000","last_fullsized":"2023-10-14T16:59:40.481350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:26:36.725906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'627","reported_seq":693,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.929135+0000","last_change":"2023-10-14T16:59:40.021896+0000","last_active":"2023-10-14T16:59:54.929135+0000","last_peered":"2023-10-14T16:59:54.929135+0000","last_clean":"2023-10-14T16:59:54.929135+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T16:59:54.929135+0000","last_undegraded":"2023-10-14T16:59:54.929135+0000","last_fullsized":"2023-10-14T16:59:54.929135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:40:10.583258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048042644000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"22'754","reported_seq":771,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.480495+0000","last_change":"2023-10-14T16:54:54.095975+0000","last_active":"2023-10-14T16:59:40.480495+0000","last_peered":"2023-10-14T16:59:40.480495+0000","last_clean":"2023-10-14T16:59:40.480495+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T16:59:40.480495+0000","last_undegraded":"2023-10-14T16:59:40.480495+0000","last_fullsized":"2023-10-14T16:59:40.480495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:50:00.048708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"23'834","reported_seq":900,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938606+0000","last_change":"2023-10-14T16:59:40.012979+0000","last_active":"2023-10-14T16:59:54.938606+0000","last_peered":"2023-10-14T16:59:54.938606+0000","last_clean":"2023-10-14T16:59:54.938606+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T16:59:54.938606+0000","last_undegraded":"2023-10-14T16:59:54.938606+0000","last_fullsized":"2023-10-14T16:59:54.938606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038542571999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2256","reported_seq":2273,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:40.481355+0000","last_change":"2023-10-14T16:54:54.103049+0000","last_active":"2023-10-14T16:59:40.481355+0000","last_peered":"2023-10-14T16:59:40.481355+0000","last_clean":"2023-10-14T16:59:40.481355+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T16:59:40.481355+0000","last_undegraded":"2023-10-14T16:59:40.481355+0000","last_fullsized":"2023-10-14T16:59:40.481355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2256,"log_dups_size":0,"ondisk_log_size":2256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:17:46.369733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2245,"num_write_kb":13441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"23'673","reported_seq":739,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.924367+0000","last_change":"2023-10-14T16:59:40.011333+0000","last_active":"2023-10-14T16:59:54.924367+0000","last_peered":"2023-10-14T16:59:54.924367+0000","last_clean":"2023-10-14T16:59:54.924367+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T16:59:54.924367+0000","last_undegraded":"2023-10-14T16:59:54.924367+0000","last_fullsized":"2023-10-14T16:59:54.924367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:03:13.293376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038619158000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3072","reported_seq":3089,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.486482+0000","last_change":"2023-10-14T16:54:54.095418+0000","last_active":"2023-10-14T16:59:55.486482+0000","last_peered":"2023-10-14T16:59:55.486482+0000","last_clean":"2023-10-14T16:59:55.486482+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T16:59:55.486482+0000","last_undegraded":"2023-10-14T16:59:55.486482+0000","last_fullsized":"2023-10-14T16:59:55.486482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3072,"log_dups_size":0,"ondisk_log_size":3072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:42.952466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5333059,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3064,"num_write_kb":7239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"23'766","reported_seq":832,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934086+0000","last_change":"2023-10-14T16:59:40.044481+0000","last_active":"2023-10-14T16:59:54.934086+0000","last_peered":"2023-10-14T16:59:54.934086+0000","last_clean":"2023-10-14T16:59:54.934086+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T16:59:54.934086+0000","last_undegraded":"2023-10-14T16:59:54.934086+0000","last_fullsized":"2023-10-14T16:59:54.934086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:34.943381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068737623999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"21'784","reported_seq":801,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-14T16:59:39.976916+0000","last_change":"2023-10-14T16:54:54.098491+0000","last_active":"2023-10-14T16:59:39.976916+0000","last_peered":"2023-10-14T16:59:39.976916+0000","last_clean":"2023-10-14T16:59:39.976916+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T16:59:39.976916+0000","last_undegraded":"2023-10-14T16:59:39.976916+0000","last_fullsized":"2023-10-14T16:59:39.976916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:31.608731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389162,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'693","reported_seq":757,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934762+0000","last_change":"2023-10-14T16:59:39.998765+0000","last_active":"2023-10-14T16:59:54.934762+0000","last_peered":"2023-10-14T16:59:54.934762+0000","last_clean":"2023-10-14T16:59:54.934762+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T16:59:54.934762+0000","last_undegraded":"2023-10-14T16:59:54.934762+0000","last_fullsized":"2023-10-14T16:59:54.934762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:28.101306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026701018,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"23'669","reported_seq":734,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935703+0000","last_change":"2023-10-14T16:59:39.991721+0000","last_active":"2023-10-14T16:59:54.935703+0000","last_peered":"2023-10-14T16:59:54.935703+0000","last_clean":"2023-10-14T16:59:54.935703+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T16:59:54.935703+0000","last_undegraded":"2023-10-14T16:59:54.935703+0000","last_fullsized":"2023-10-14T16:59:54.935703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01972498,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"23'706","reported_seq":771,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.935578+0000","last_change":"2023-10-14T16:59:39.984241+0000","last_active":"2023-10-14T16:59:54.935578+0000","last_peered":"2023-10-14T16:59:54.935578+0000","last_clean":"2023-10-14T16:59:54.935578+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T16:59:54.935578+0000","last_undegraded":"2023-10-14T16:59:54.935578+0000","last_fullsized":"2023-10-14T16:59:54.935578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:23.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012044934,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"23'775","reported_seq":840,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938669+0000","last_change":"2023-10-14T16:59:40.032026+0000","last_active":"2023-10-14T16:59:54.938669+0000","last_peered":"2023-10-14T16:59:54.938669+0000","last_clean":"2023-10-14T16:59:54.938669+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T16:59:54.938669+0000","last_undegraded":"2023-10-14T16:59:54.938669+0000","last_fullsized":"2023-10-14T16:59:54.938669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:57.142518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058085603999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"23'600","reported_seq":665,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937844+0000","last_change":"2023-10-14T16:59:40.046985+0000","last_active":"2023-10-14T16:59:54.937844+0000","last_peered":"2023-10-14T16:59:54.937844+0000","last_clean":"2023-10-14T16:59:54.937844+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T16:59:54.937844+0000","last_undegraded":"2023-10-14T16:59:54.937844+0000","last_fullsized":"2023-10-14T16:59:54.937844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:19:21.048347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070423702000000005,"stat_sum":{"num_bytes":8224,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"23'394","reported_seq":459,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938679+0000","last_change":"2023-10-14T16:59:40.023267+0000","last_active":"2023-10-14T16:59:54.938679+0000","last_peered":"2023-10-14T16:59:54.938679+0000","last_clean":"2023-10-14T16:59:54.938679+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T16:59:54.938679+0000","last_undegraded":"2023-10-14T16:59:54.938679+0000","last_fullsized":"2023-10-14T16:59:54.938679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:18.601547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048708460000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":30,"num_read_kb":20,"num_write":108,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41370,"ondisk_log_size":41370,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":190530350,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":33640,"num_write_kb":203671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381124608,"data_stored":381060700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33839,"ondisk_log_size":33839,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705731,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396524,"kb_used_data":86948,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93975316,"statfs":{"total":96636764160,"available":96230723584,"internally_reserved":0,"allocated":89034752,"data_stored":88829719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.41399999999999998},"min":{"1min":0.218,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61099999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.379,"5min":0.38600000000000001,"15min":0.42199999999999999},"min":{"1min":0.221,"5min":0.217,"15min":0.217},"max":{"1min":0.57099999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Oct 14 16:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.44700000000000001,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.44700000000000001,"15min":0.47099999999999997},"min":{"1min":0.25,"5min":0.217,"15min":0.217},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.58199999999999996}]},{"osd":2,"last update":"Sat Oct 14 16:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.29599999999999999,"15min":0.33800000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.45200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.30499999999999999,"15min":0.34399999999999997},"min":{"1min":0.20000000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.47599999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.32100000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705731,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426368,"kb_used_data":116792,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93945472,"statfs":{"total":96636764160,"available":96200163328,"internally_reserved":0,"allocated":119595008,"data_stored":119363794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46500000000000002,"15min":0.45000000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.79900000000000004,"5min":5.992,"15min":5.992},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.504,"15min":0.46200000000000002},"min":{"1min":0.24199999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.73999999999999999,"5min":9.2620000000000005,"15min":9.2620000000000005},"last":0.46100000000000002}]},{"osd":1,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66700000000000004,"5min":6.266,"15min":6.266},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54700000000000004,"15min":0.49399999999999999},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.492,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":0.48799999999999999}]},{"osd":3,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.313,"15min":0.318},"min":{"1min":0.184,"5min":0.16,"15min":0.16},"max":{"1min":0.69199999999999995,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.193,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.627,"5min":6.3170000000000002,"15min":6.3170000000000002},"last":0.50900000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705729,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397668,"kb_used_data":92188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":93974172,"statfs":{"total":96636764160,"available":96229552128,"internally_reserved":0,"allocated":94400512,"data_stored":94210119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.27200000000000002,"15min":0.29599999999999999},"min":{"1min":0.20799999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.318},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.50800000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.45700000000000002},"min":{"1min":0.24099999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56299999999999994,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.46500000000000002},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61399999999999999,"5min":0.629,"15min":0.629},"last":0.432}]},{"osd":3,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29299999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.63300000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.45100000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705730,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388312,"kb_used_data":78736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93983528,"statfs":{"total":96636764160,"available":96239132672,"internally_reserved":0,"allocated":80625664,"data_stored":80427560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.27400000000000002},"min":{"1min":0.21099999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.28699999999999998,"15min":0.29899999999999999},"min":{"1min":0.24099999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42599999999999999,"15min":0.45700000000000002},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42199999999999999,"15min":0.46100000000000002},"min":{"1min":0.28399999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63900000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.67100000000000004}]},{"osd":3,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.45300000000000001},"min":{"1min":0.29699999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.59699999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.48599999999999999},"min":{"1min":0.33500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94076928,"data_stored":94060658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":79691776,"data_stored":79691776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":119250944,"data_stored":119226558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88104960,"data_stored":88081708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":53391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":73798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T17:00:07.016 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.017 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.017 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.017 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.018 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.018 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.019 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.019 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.019 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.020 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.020 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.020 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.021 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.021 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.021 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.022 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.022 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.023 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.023 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.023 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.024 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.024 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.024 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.025 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.025 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.026 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.026 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.026 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.027 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.027 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.028 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.028 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.028 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.029 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.029 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.029 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.030 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.030 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.031 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.031 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.031 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.032 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.032 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.032 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.033 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.033 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.033 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.034 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.034 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.035 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.035 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.035 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.036 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.036 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.036 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.037 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.037 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.038 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.038 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.038 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.039 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.039 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.039 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.040 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.040 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.040 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.041 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.041 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.042 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.042 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.042 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.043 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.043 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.043 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.044 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.044 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.045 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.045 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.045 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.046 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.046 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.046 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.047 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.047 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.048 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.048 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.048 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.049 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.049 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.049 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.050 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.050 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.050 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.051 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.051 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.052 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.052 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.052 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.053 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.053 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.054 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.054 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.055 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.055 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.055 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:07.056 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T17:00:15.860 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:00:15.864 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:00:15.867 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:00:27.056 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T17:00:27.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.187+0000 7f352a94b700 1 Processor -- start 2023-10-14T17:00:27.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.187+0000 7f352a94b700 1 -- start start 2023-10-14T17:00:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.187+0000 7f352a94b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f352412eea0 0x7f3524139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.187+0000 7f352a94b700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f352413a3f0 0x7f352413c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.187+0000 7f352a94b700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35240a39b0 con 0x7f35240a81c0 2023-10-14T17:00:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f352a94b700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352406dbf0 con 0x7f352412eea0 2023-10-14T17:00:27.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f352a94b700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352406d2f0 con 0x7f352413a3f0 2023-10-14T17:00:27.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f35237fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f352412eea0 0x7f3524139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:27.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f35237fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f352412eea0 0x7f3524139eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37874/0 (socket says 172.21.15.8:37874) 2023-10-14T17:00:27.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f35237fe700 1 -- 172.21.15.8:0/1322317992 learned_addr learned my addr 172.21.15.8:0/1322317992 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:27.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f3528ee8700 1 --2- 172.21.15.8:0/1322317992 >> v2:172.21.15.155:3300/0 conn(0x7f352413a3f0 0x7f352413c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:27.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f35237fe700 1 -- 172.21.15.8:0/1322317992 >> v2:172.21.15.155:3300/0 conn(0x7f352413a3f0 msgr2=0x7f352413c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:27.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f35237fe700 1 --2- 172.21.15.8:0/1322317992 >> v2:172.21.15.155:3300/0 conn(0x7f352413a3f0 0x7f352413c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:27.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f35237fe700 1 -- 172.21.15.8:0/1322317992 >> v1:172.21.15.8:6789/0 conn(0x7f35240a81c0 legacy=0x7f352412e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:27.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f3522ffd700 1 -- 172.21.15.8:0/1322317992 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286513359 0 0) 0x7f35240a39b0 con 0x7f35240a81c0 2023-10-14T17:00:27.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f35237fe700 1 -- 172.21.15.8:0/1322317992 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352406d590 con 0x7f352412eea0 2023-10-14T17:00:27.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f35237fe700 1 --2- 172.21.15.8:0/1322317992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f352412eea0 0x7f3524139eb0 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f3524131600 tx=0x7f350c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddb75584e7d8b8b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:27.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f3522ffd700 1 -- 172.21.15.8:0/1322317992 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00b860 con 0x7f352412eea0 2023-10-14T17:00:27.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f3522ffd700 1 -- 172.21.15.8:0/1322317992 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c00b9c0 con 0x7f352412eea0 2023-10-14T17:00:27.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.188+0000 7f3522ffd700 1 -- 172.21.15.8:0/1322317992 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00bd80 con 0x7f352412eea0 2023-10-14T17:00:27.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.189+0000 7f352a94b700 1 -- 172.21.15.8:0/1322317992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f352412eea0 msgr2=0x7f3524139eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:27.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.189+0000 7f352a94b700 1 --2- 172.21.15.8:0/1322317992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f352412eea0 0x7f3524139eb0 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f3524131600 tx=0x7f350c009250 comp rx=0 tx=0).stop 2023-10-14T17:00:27.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.189+0000 7f352a94b700 1 -- 172.21.15.8:0/1322317992 shutdown_connections 2023-10-14T17:00:27.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.189+0000 7f352a94b700 1 --2- 172.21.15.8:0/1322317992 >> v2:172.21.15.155:3300/0 conn(0x7f352413a3f0 0x7f352413c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:27.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.189+0000 7f352a94b700 1 --2- 172.21.15.8:0/1322317992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f352412eea0 0x7f3524139eb0 unknown :-1 s=CLOSED pgs=2490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:27.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.189+0000 7f352a94b700 1 -- 172.21.15.8:0/1322317992 >> 172.21.15.8:0/1322317992 conn(0x7f35240701c0 msgr2=0x7f3524070590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:27.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.189+0000 7f352a94b700 1 -- 172.21.15.8:0/1322317992 shutdown_connections 2023-10-14T17:00:27.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.189+0000 7f352a94b700 1 -- 172.21.15.8:0/1322317992 wait complete. 2023-10-14T17:00:27.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.190+0000 7f352a94b700 1 Processor -- start 2023-10-14T17:00:27.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.190+0000 7f352a94b700 1 -- start start 2023-10-14T17:00:27.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.190+0000 7f352a94b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f352412eea0 0x7f352412d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:27.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.190+0000 7f352a94b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f352413a3f0 0x7f352412db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:27.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.190+0000 7f352a94b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3524137cc0 0x7f3524138140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:27.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.190+0000 7f352a94b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524097790 con 0x7f352413a3f0 2023-10-14T17:00:27.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.190+0000 7f352a94b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524097c40 con 0x7f352412eea0 2023-10-14T17:00:27.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.190+0000 7f352a94b700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35240a17e0 con 0x7f3524137cc0 2023-10-14T17:00:27.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f35237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f352413a3f0 0x7f352412db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:27.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f35237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f352413a3f0 0x7f352412db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37882/0 (socket says 172.21.15.8:37882) 2023-10-14T17:00:27.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f35237fe700 1 -- 172.21.15.8:0/3889038909 learned_addr learned my addr 172.21.15.8:0/3889038909 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:27.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f3523fff700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f352412eea0 0x7f352412d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:27.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f3528ee8700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3524137cc0 0x7f3524138140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:27.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f35237fe700 1 -- 172.21.15.8:0/3889038909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3524137cc0 msgr2=0x7f3524138140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:27.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f35237fe700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3524137cc0 0x7f3524138140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:27.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f35237fe700 1 -- 172.21.15.8:0/3889038909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f352412eea0 msgr2=0x7f352412d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:27.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f35237fe700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f352412eea0 0x7f352412d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:27.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f35237fe700 1 -- 172.21.15.8:0/3889038909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c0094f0 con 0x7f352413a3f0 2023-10-14T17:00:27.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f35237fe700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f352413a3f0 0x7f352412db40 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f350c006fd0 tx=0x7f350c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:27.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f351bfff700 1 -- 172.21.15.8:0/3889038909 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c01f070 con 0x7f352413a3f0 2023-10-14T17:00:27.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f351bfff700 1 -- 172.21.15.8:0/3889038909 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c011de0 con 0x7f352413a3f0 2023-10-14T17:00:27.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f352a94b700 1 -- 172.21.15.8:0/3889038909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35240a1300 con 0x7f352413a3f0 2023-10-14T17:00:27.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f351bfff700 1 -- 172.21.15.8:0/3889038909 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c01a670 con 0x7f352413a3f0 2023-10-14T17:00:27.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.191+0000 7f352a94b700 1 -- 172.21.15.8:0/3889038909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35240a1560 con 0x7f352413a3f0 2023-10-14T17:00:27.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.192+0000 7f352a94b700 1 -- 172.21.15.8:0/3889038909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3524096510 con 0x7f352413a3f0 2023-10-14T17:00:27.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.193+0000 7f351bfff700 1 -- 172.21.15.8:0/3889038909 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f350c01a9e0 con 0x7f352413a3f0 2023-10-14T17:00:27.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.193+0000 7f351bfff700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3504066f30 0x7f35040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:27.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.193+0000 7f351bfff700 1 -- 172.21.15.8:0/3889038909 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f350c085580 con 0x7f352413a3f0 2023-10-14T17:00:27.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.193+0000 7f3523fff700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3504066f30 0x7f35040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:27.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.193+0000 7f3523fff700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3504066f30 0x7f35040693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3514007fd0 tx=0x7f3514007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:27.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.197+0000 7f351bfff700 1 -- 172.21.15.8:0/3889038909 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f350c052d90 con 0x7f352413a3f0 2023-10-14T17:00:27.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.385+0000 7f352a94b700 1 -- 172.21.15.8:0/3889038909 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35240a2740 con 0x7f3504066f30 2023-10-14T17:00:27.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.392+0000 7f351bfff700 1 -- 172.21.15.8:0/3889038909 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276546 (secure 0 0 0) 0x7f35240a2740 con 0x7f3504066f30 2023-10-14T17:00:27.396 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:00:27.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.395+0000 7f352a94b700 1 -- 172.21.15.8:0/3889038909 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3504066f30 msgr2=0x7f35040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:27.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.395+0000 7f352a94b700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3504066f30 0x7f35040693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3514007fd0 tx=0x7f3514007d30 comp rx=0 tx=0).stop 2023-10-14T17:00:27.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.395+0000 7f352a94b700 1 -- 172.21.15.8:0/3889038909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f352413a3f0 msgr2=0x7f352412db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.395+0000 7f352a94b700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f352413a3f0 0x7f352412db40 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f350c006fd0 tx=0x7f350c017000 comp rx=0 tx=0).stop 2023-10-14T17:00:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.395+0000 7f352a94b700 1 -- 172.21.15.8:0/3889038909 shutdown_connections 2023-10-14T17:00:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.395+0000 7f352a94b700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f3504066f30 0x7f35040693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.395+0000 7f352a94b700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3524137cc0 0x7f3524138140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:27.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.395+0000 7f352a94b700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f352412eea0 0x7f352412d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:27.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.395+0000 7f352a94b700 1 --2- 172.21.15.8:0/3889038909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f352413a3f0 0x7f352412db40 unknown :-1 s=CLOSED pgs=2491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:27.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.395+0000 7f352a94b700 1 -- 172.21.15.8:0/3889038909 >> 172.21.15.8:0/3889038909 conn(0x7f35240701c0 msgr2=0x7f3524131630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:27.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.395+0000 7f352a94b700 1 -- 172.21.15.8:0/3889038909 shutdown_connections 2023-10-14T17:00:27.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:27.395+0000 7f352a94b700 1 -- 172.21.15.8:0/3889038909 wait complete. 2023-10-14T17:00:27.402 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T17:00:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2023-10-14T17:00:26.055973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":191251786,"num_objects":152,"num_object_clones":21,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":8,"num_read":210,"num_read_kb":798,"num_write":33908,"num_write_kb":206280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75369,"ondisk_log_size":75369,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1608872,"kb_used_data":374664,"kb_used_omap":0,"kb_used_meta":1234176,"kb_avail":375878488,"statfs":{"total":386547056640,"available":384899571712,"internally_reserved":0,"allocated":383655936,"data_stored":382838952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1263796224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003245"},"pg_stats":[{"pgid":"4.3f","version":"23'645","reported_seq":712,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939557+0000","last_change":"2023-10-14T16:59:40.048771+0000","last_active":"2023-10-14T16:59:54.939557+0000","last_peered":"2023-10-14T16:59:54.939557+0000","last_clean":"2023-10-14T16:59:54.939557+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T16:59:54.939557+0000","last_undegraded":"2023-10-14T16:59:54.939557+0000","last_fullsized":"2023-10-14T16:59:54.939557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070427155000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"23'746","reported_seq":813,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938650+0000","last_change":"2023-10-14T16:59:40.012472+0000","last_active":"2023-10-14T16:59:54.938650+0000","last_peered":"2023-10-14T16:59:54.938650+0000","last_clean":"2023-10-14T16:59:54.938650+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T16:59:54.938650+0000","last_undegraded":"2023-10-14T16:59:54.938650+0000","last_fullsized":"2023-10-14T16:59:54.938650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038749005000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'628","reported_seq":695,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933938+0000","last_change":"2023-10-14T16:59:40.031831+0000","last_active":"2023-10-14T16:59:54.933938+0000","last_peered":"2023-10-14T16:59:54.933938+0000","last_clean":"2023-10-14T16:59:54.933938+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T16:59:54.933938+0000","last_undegraded":"2023-10-14T16:59:54.933938+0000","last_fullsized":"2023-10-14T16:59:54.933938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152503000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"23'646","reported_seq":713,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.923307+0000","last_change":"2023-10-14T16:59:40.006348+0000","last_active":"2023-10-14T16:59:54.923307+0000","last_peered":"2023-10-14T16:59:54.923307+0000","last_clean":"2023-10-14T16:59:54.923307+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T16:59:54.923307+0000","last_undegraded":"2023-10-14T16:59:54.923307+0000","last_fullsized":"2023-10-14T16:59:54.923307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033834213000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"23'521","reported_seq":588,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937848+0000","last_change":"2023-10-14T16:59:40.046517+0000","last_active":"2023-10-14T16:59:54.937848+0000","last_peered":"2023-10-14T16:59:54.937848+0000","last_clean":"2023-10-14T16:59:54.937848+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T16:59:54.937848+0000","last_undegraded":"2023-10-14T16:59:54.937848+0000","last_fullsized":"2023-10-14T16:59:54.937848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070258685000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'532","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.918368+0000","last_change":"2023-10-14T16:59:40.032103+0000","last_active":"2023-10-14T16:59:54.918368+0000","last_peered":"2023-10-14T16:59:54.918368+0000","last_clean":"2023-10-14T16:59:54.918368+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T16:59:54.918368+0000","last_undegraded":"2023-10-14T16:59:54.918368+0000","last_fullsized":"2023-10-14T16:59:54.918368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058053194000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'962","reported_seq":1029,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921434+0000","last_change":"2023-10-14T16:59:40.032217+0000","last_active":"2023-10-14T16:59:54.921434+0000","last_peered":"2023-10-14T16:59:54.921434+0000","last_clean":"2023-10-14T16:59:54.921434+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T16:59:54.921434+0000","last_undegraded":"2023-10-14T16:59:54.921434+0000","last_fullsized":"2023-10-14T16:59:54.921434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058433710999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'666","reported_seq":733,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.920919+0000","last_change":"2023-10-14T16:59:40.032894+0000","last_active":"2023-10-14T16:59:54.920919+0000","last_peered":"2023-10-14T16:59:54.920919+0000","last_clean":"2023-10-14T16:59:54.920919+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T16:59:54.920919+0000","last_undegraded":"2023-10-14T16:59:54.920919+0000","last_fullsized":"2023-10-14T16:59:54.920919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057530364000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"23'726","reported_seq":793,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939622+0000","last_change":"2023-10-14T16:59:40.048548+0000","last_active":"2023-10-14T16:59:54.939622+0000","last_peered":"2023-10-14T16:59:54.939622+0000","last_clean":"2023-10-14T16:59:54.939622+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T16:59:54.939622+0000","last_undegraded":"2023-10-14T16:59:54.939622+0000","last_fullsized":"2023-10-14T16:59:54.939622+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070350251000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'591","reported_seq":658,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933655+0000","last_change":"2023-10-14T16:59:40.030928+0000","last_active":"2023-10-14T16:59:54.933655+0000","last_peered":"2023-10-14T16:59:54.933655+0000","last_clean":"2023-10-14T16:59:54.933655+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T16:59:54.933655+0000","last_undegraded":"2023-10-14T16:59:54.933655+0000","last_fullsized":"2023-10-14T16:59:54.933655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057828565999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"23'504","reported_seq":570,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.920150+0000","last_change":"2023-10-14T16:59:40.011889+0000","last_active":"2023-10-14T16:59:54.920150+0000","last_peered":"2023-10-14T16:59:54.920150+0000","last_clean":"2023-10-14T16:59:54.920150+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T16:59:54.920150+0000","last_undegraded":"2023-10-14T16:59:54.920150+0000","last_fullsized":"2023-10-14T16:59:54.920150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039012109000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"23'510","reported_seq":577,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939162+0000","last_change":"2023-10-14T16:59:40.020882+0000","last_active":"2023-10-14T16:59:54.939162+0000","last_peered":"2023-10-14T16:59:54.939162+0000","last_clean":"2023-10-14T16:59:54.939162+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T16:59:54.939162+0000","last_undegraded":"2023-10-14T16:59:54.939162+0000","last_fullsized":"2023-10-14T16:59:54.939162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047436036000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"23'512","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930487+0000","last_change":"2023-10-14T16:59:40.046901+0000","last_active":"2023-10-14T16:59:54.930487+0000","last_peered":"2023-10-14T16:59:54.930487+0000","last_clean":"2023-10-14T16:59:54.930487+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T16:59:54.930487+0000","last_undegraded":"2023-10-14T16:59:54.930487+0000","last_fullsized":"2023-10-14T16:59:54.930487+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070191972000000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"23'757","reported_seq":823,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938420+0000","last_change":"2023-10-14T16:59:40.009015+0000","last_active":"2023-10-14T16:59:54.938420+0000","last_peered":"2023-10-14T16:59:54.938420+0000","last_clean":"2023-10-14T16:59:54.938420+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T16:59:54.938420+0000","last_undegraded":"2023-10-14T16:59:54.938420+0000","last_fullsized":"2023-10-14T16:59:54.938420+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036605058000000003,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"23'655","reported_seq":722,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938675+0000","last_change":"2023-10-14T16:59:40.012646+0000","last_active":"2023-10-14T16:59:54.938675+0000","last_peered":"2023-10-14T16:59:54.938675+0000","last_clean":"2023-10-14T16:59:54.938675+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T16:59:54.938675+0000","last_undegraded":"2023-10-14T16:59:54.938675+0000","last_fullsized":"2023-10-14T16:59:54.938675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038947427,"stat_sum":{"num_bytes":4105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"23'745","reported_seq":811,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933592+0000","last_change":"2023-10-14T16:59:40.032292+0000","last_active":"2023-10-14T16:59:54.933592+0000","last_peered":"2023-10-14T16:59:54.933592+0000","last_clean":"2023-10-14T16:59:54.933592+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T16:59:54.933592+0000","last_undegraded":"2023-10-14T16:59:54.933592+0000","last_fullsized":"2023-10-14T16:59:54.933592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058345898,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'595","reported_seq":662,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939671+0000","last_change":"2023-10-14T16:59:40.048812+0000","last_active":"2023-10-14T16:59:54.939671+0000","last_peered":"2023-10-14T16:59:54.939671+0000","last_clean":"2023-10-14T16:59:54.939671+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T16:59:54.939671+0000","last_undegraded":"2023-10-14T16:59:54.939671+0000","last_fullsized":"2023-10-14T16:59:54.939671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071573409000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'693","reported_seq":760,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.489180+0000","last_change":"2023-10-14T16:59:40.030743+0000","last_active":"2023-10-14T16:59:55.489180+0000","last_peered":"2023-10-14T16:59:55.489180+0000","last_clean":"2023-10-14T16:59:55.489180+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T16:59:55.489180+0000","last_undegraded":"2023-10-14T16:59:55.489180+0000","last_fullsized":"2023-10-14T16:59:55.489180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057407435999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"23'572","reported_seq":640,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930528+0000","last_change":"2023-10-14T16:59:40.045847+0000","last_active":"2023-10-14T16:59:54.930528+0000","last_peered":"2023-10-14T16:59:54.930528+0000","last_clean":"2023-10-14T16:59:54.930528+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T16:59:54.930528+0000","last_undegraded":"2023-10-14T16:59:54.930528+0000","last_fullsized":"2023-10-14T16:59:54.930528+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070060102999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"23'761","reported_seq":828,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939481+0000","last_change":"2023-10-14T16:59:40.029354+0000","last_active":"2023-10-14T16:59:54.939481+0000","last_peered":"2023-10-14T16:59:54.939481+0000","last_clean":"2023-10-14T16:59:54.939481+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T16:59:54.939481+0000","last_undegraded":"2023-10-14T16:59:54.939481+0000","last_fullsized":"2023-10-14T16:59:54.939481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056633790000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"23'810","reported_seq":877,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938819+0000","last_change":"2023-10-14T16:59:40.012817+0000","last_active":"2023-10-14T16:59:54.938819+0000","last_peered":"2023-10-14T16:59:54.938819+0000","last_clean":"2023-10-14T16:59:54.938819+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T16:59:54.938819+0000","last_undegraded":"2023-10-14T16:59:54.938819+0000","last_fullsized":"2023-10-14T16:59:54.938819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038418550000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"23'694","reported_seq":761,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938835+0000","last_change":"2023-10-14T16:59:40.041012+0000","last_active":"2023-10-14T16:59:54.938835+0000","last_peered":"2023-10-14T16:59:54.938835+0000","last_clean":"2023-10-14T16:59:54.938835+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T16:59:54.938835+0000","last_undegraded":"2023-10-14T16:59:54.938835+0000","last_fullsized":"2023-10-14T16:59:54.938835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.065688290999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'638","reported_seq":705,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936056+0000","last_change":"2023-10-14T16:59:39.983318+0000","last_active":"2023-10-14T16:59:54.936056+0000","last_peered":"2023-10-14T16:59:54.936056+0000","last_clean":"2023-10-14T16:59:54.936056+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T16:59:54.936056+0000","last_undegraded":"2023-10-14T16:59:54.936056+0000","last_fullsized":"2023-10-14T16:59:54.936056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011260075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"23'846","reported_seq":913,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934827+0000","last_change":"2023-10-14T16:59:40.031942+0000","last_active":"2023-10-14T16:59:54.934827+0000","last_peered":"2023-10-14T16:59:54.934827+0000","last_clean":"2023-10-14T16:59:54.934827+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T16:59:54.934827+0000","last_undegraded":"2023-10-14T16:59:54.934827+0000","last_fullsized":"2023-10-14T16:59:54.934827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"23'636","reported_seq":703,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938573+0000","last_change":"2023-10-14T16:59:40.023150+0000","last_active":"2023-10-14T16:59:54.938573+0000","last_peered":"2023-10-14T16:59:54.938573+0000","last_clean":"2023-10-14T16:59:54.938573+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T16:59:54.938573+0000","last_undegraded":"2023-10-14T16:59:54.938573+0000","last_fullsized":"2023-10-14T16:59:54.938573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048983802,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'679","reported_seq":756,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:17.045500+0000","last_change":"2023-10-14T17:00:17.045457+0000","last_active":"2023-10-14T17:00:17.045500+0000","last_peered":"2023-10-14T17:00:17.045500+0000","last_clean":"2023-10-14T17:00:17.045500+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T17:00:17.045500+0000","last_undegraded":"2023-10-14T17:00:17.045500+0000","last_fullsized":"2023-10-14T17:00:17.045500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'679","last_scrub_stamp":"2023-10-14T17:00:17.045319+0000","last_deep_scrub":"23'679","last_deep_scrub_stamp":"2023-10-14T17:00:17.045319+0000","last_clean_scrub_stamp":"2023-10-14T17:00:17.045319+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:24.925526+0000","scrub_duration":0.0014699489999999999,"objects_trimmed":0,"snaptrim_duration":0.047799974000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'513","reported_seq":580,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934020+0000","last_change":"2023-10-14T16:59:40.032393+0000","last_active":"2023-10-14T16:59:54.934020+0000","last_peered":"2023-10-14T16:59:54.934020+0000","last_clean":"2023-10-14T16:59:54.934020+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T16:59:54.934020+0000","last_undegraded":"2023-10-14T16:59:54.934020+0000","last_fullsized":"2023-10-14T16:59:54.934020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058565578,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1532","reported_seq":1550,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971057+0000","last_change":"2023-10-14T16:54:54.101946+0000","last_active":"2023-10-14T16:59:47.971057+0000","last_peered":"2023-10-14T16:59:47.971057+0000","last_clean":"2023-10-14T16:59:47.971057+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T16:59:47.971057+0000","last_undegraded":"2023-10-14T16:59:47.971057+0000","last_fullsized":"2023-10-14T16:59:47.971057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1532,"log_dups_size":0,"ondisk_log_size":1532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1524,"num_write_kb":13073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"23'653","reported_seq":721,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937308+0000","last_change":"2023-10-14T16:59:40.043067+0000","last_active":"2023-10-14T16:59:54.937308+0000","last_peered":"2023-10-14T16:59:54.937308+0000","last_clean":"2023-10-14T16:59:54.937308+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T16:59:54.937308+0000","last_undegraded":"2023-10-14T16:59:54.937308+0000","last_fullsized":"2023-10-14T16:59:54.937308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067459389999999994,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"23'756","reported_seq":784,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:16.095374+0000","last_change":"2023-10-14T17:00:16.095338+0000","last_active":"2023-10-14T17:00:16.095374+0000","last_peered":"2023-10-14T17:00:16.095374+0000","last_clean":"2023-10-14T17:00:16.095374+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T17:00:16.095374+0000","last_undegraded":"2023-10-14T17:00:16.095374+0000","last_fullsized":"2023-10-14T17:00:16.095374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'756","last_scrub_stamp":"2023-10-14T17:00:16.095246+0000","last_deep_scrub":"23'756","last_deep_scrub_stamp":"2023-10-14T17:00:16.095246+0000","last_clean_scrub_stamp":"2023-10-14T17:00:16.095246+0000","objects_scrubbed":1,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:54.744269+0000","scrub_duration":0.013423025999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'585","reported_seq":662,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:16.588712+0000","last_change":"2023-10-14T17:00:16.588677+0000","last_active":"2023-10-14T17:00:16.588712+0000","last_peered":"2023-10-14T17:00:16.588712+0000","last_clean":"2023-10-14T17:00:16.588712+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T17:00:16.588712+0000","last_undegraded":"2023-10-14T17:00:16.588712+0000","last_fullsized":"2023-10-14T17:00:16.588712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'585","last_scrub_stamp":"2023-10-14T17:00:16.588581+0000","last_deep_scrub":"23'585","last_deep_scrub_stamp":"2023-10-14T17:00:16.588581+0000","last_clean_scrub_stamp":"2023-10-14T17:00:16.588581+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:41.060437+0000","scrub_duration":0.0019550330000000001,"objects_trimmed":0,"snaptrim_duration":0.070886901000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1509","reported_seq":1537,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:18.073307+0000","last_change":"2023-10-14T17:00:18.073275+0000","last_active":"2023-10-14T17:00:18.073307+0000","last_peered":"2023-10-14T17:00:18.073307+0000","last_clean":"2023-10-14T17:00:18.073307+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T17:00:18.073307+0000","last_undegraded":"2023-10-14T17:00:18.073307+0000","last_fullsized":"2023-10-14T17:00:18.073307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1509","last_scrub_stamp":"2023-10-14T17:00:18.073180+0000","last_deep_scrub":"23'1509","last_deep_scrub_stamp":"2023-10-14T17:00:18.073180+0000","last_clean_scrub_stamp":"2023-10-14T17:00:18.073180+0000","objects_scrubbed":3,"log_size":1509,"log_dups_size":0,"ondisk_log_size":1509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:58.302825+0000","scrub_duration":0.026462619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"23'593","reported_seq":660,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.936150+0000","last_change":"2023-10-14T16:59:40.031610+0000","last_active":"2023-10-14T16:59:54.936150+0000","last_peered":"2023-10-14T16:59:54.936150+0000","last_clean":"2023-10-14T16:59:54.936150+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T16:59:54.936150+0000","last_undegraded":"2023-10-14T16:59:54.936150+0000","last_fullsized":"2023-10-14T16:59:54.936150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058803686000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"22'4","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.970546+0000","last_change":"2023-10-14T16:54:54.098193+0000","last_active":"2023-10-14T16:59:47.970546+0000","last_peered":"2023-10-14T16:59:47.970546+0000","last_clean":"2023-10-14T16:59:47.970546+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T16:59:47.970546+0000","last_undegraded":"2023-10-14T16:59:47.970546+0000","last_fullsized":"2023-10-14T16:59:47.970546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'583","reported_seq":660,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:12.106374+0000","last_change":"2023-10-14T17:00:12.106339+0000","last_active":"2023-10-14T17:00:12.106374+0000","last_peered":"2023-10-14T17:00:12.106374+0000","last_clean":"2023-10-14T17:00:12.106374+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T17:00:12.106374+0000","last_undegraded":"2023-10-14T17:00:12.106374+0000","last_fullsized":"2023-10-14T17:00:12.106374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'583","last_scrub_stamp":"2023-10-14T17:00:12.106239+0000","last_deep_scrub":"23'583","last_deep_scrub_stamp":"2023-10-14T17:00:12.106239+0000","last_clean_scrub_stamp":"2023-10-14T17:00:12.106239+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:53:48.745008+0000","scrub_duration":0.0023297560000000001,"objects_trimmed":0,"snaptrim_duration":0.024750503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'756","reported_seq":774,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.489371+0000","last_change":"2023-10-14T16:54:54.100620+0000","last_active":"2023-10-14T16:59:55.489371+0000","last_peered":"2023-10-14T16:59:55.489371+0000","last_clean":"2023-10-14T16:59:55.489371+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T16:59:55.489371+0000","last_undegraded":"2023-10-14T16:59:55.489371+0000","last_fullsized":"2023-10-14T16:59:55.489371+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'570","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:12.612196+0000","last_change":"2023-10-14T17:00:12.612165+0000","last_active":"2023-10-14T17:00:12.612196+0000","last_peered":"2023-10-14T17:00:12.612196+0000","last_clean":"2023-10-14T17:00:12.612196+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T17:00:12.612196+0000","last_undegraded":"2023-10-14T17:00:12.612196+0000","last_fullsized":"2023-10-14T17:00:12.612196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'570","last_scrub_stamp":"2023-10-14T17:00:12.612058+0000","last_deep_scrub":"23'570","last_deep_scrub_stamp":"2023-10-14T17:00:12.612058+0000","last_clean_scrub_stamp":"2023-10-14T17:00:12.612058+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:51.261080+0000","scrub_duration":0.001901631,"objects_trimmed":0,"snaptrim_duration":0.067572238000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"23'798","reported_seq":816,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.493247+0000","last_change":"2023-10-14T16:54:54.097908+0000","last_active":"2023-10-14T16:59:55.493247+0000","last_peered":"2023-10-14T16:59:55.493247+0000","last_clean":"2023-10-14T16:59:55.493247+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T16:59:55.493247+0000","last_undegraded":"2023-10-14T16:59:55.493247+0000","last_fullsized":"2023-10-14T16:59:55.493247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"23'414","reported_seq":491,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:09.150688+0000","last_change":"2023-10-14T17:00:09.150657+0000","last_active":"2023-10-14T17:00:09.150688+0000","last_peered":"2023-10-14T17:00:09.150688+0000","last_clean":"2023-10-14T17:00:09.150688+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T17:00:09.150688+0000","last_undegraded":"2023-10-14T17:00:09.150688+0000","last_fullsized":"2023-10-14T17:00:09.150688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'414","last_scrub_stamp":"2023-10-14T17:00:09.150551+0000","last_deep_scrub":"23'414","last_deep_scrub_stamp":"2023-10-14T17:00:09.150551+0000","last_clean_scrub_stamp":"2023-10-14T17:00:09.150551+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:38.484247+0000","scrub_duration":0.0020073140000000001,"objects_trimmed":0,"snaptrim_duration":0.013962693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'2297","reported_seq":2315,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.218754+0000","last_change":"2023-10-14T16:54:54.098933+0000","last_active":"2023-10-14T16:59:54.218754+0000","last_peered":"2023-10-14T16:59:54.218754+0000","last_clean":"2023-10-14T16:59:54.218754+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T16:59:54.218754+0000","last_undegraded":"2023-10-14T16:59:54.218754+0000","last_fullsized":"2023-10-14T16:59:54.218754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2297,"log_dups_size":0,"ondisk_log_size":2297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2289,"num_write_kb":13405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"23'485","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:19.481760+0000","last_change":"2023-10-14T17:00:19.481720+0000","last_active":"2023-10-14T17:00:19.481760+0000","last_peered":"2023-10-14T17:00:19.481760+0000","last_clean":"2023-10-14T17:00:19.481760+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T17:00:19.481760+0000","last_undegraded":"2023-10-14T17:00:19.481760+0000","last_fullsized":"2023-10-14T17:00:19.481760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'485","last_scrub_stamp":"2023-10-14T17:00:19.481628+0000","last_deep_scrub":"23'485","last_deep_scrub_stamp":"2023-10-14T17:00:19.481628+0000","last_clean_scrub_stamp":"2023-10-14T17:00:19.481628+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:59.711273+0000","scrub_duration":0.001552152,"objects_trimmed":0,"snaptrim_duration":0.038441039000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"21'1506","reported_seq":1524,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971215+0000","last_change":"2023-10-14T16:54:54.103486+0000","last_active":"2023-10-14T16:59:47.971215+0000","last_peered":"2023-10-14T16:59:47.971215+0000","last_clean":"2023-10-14T16:59:47.971215+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T16:59:47.971215+0000","last_undegraded":"2023-10-14T16:59:47.971215+0000","last_fullsized":"2023-10-14T16:59:47.971215+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1498,"num_write_kb":8967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"23'532","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939103+0000","last_change":"2023-10-14T16:59:40.021641+0000","last_active":"2023-10-14T16:59:54.939103+0000","last_peered":"2023-10-14T16:59:54.939103+0000","last_clean":"2023-10-14T16:59:54.939103+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T16:59:54.939103+0000","last_undegraded":"2023-10-14T16:59:54.939103+0000","last_fullsized":"2023-10-14T16:59:54.939103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047574827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"22'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.969831+0000","last_change":"2023-10-14T16:54:54.098087+0000","last_active":"2023-10-14T16:59:47.969831+0000","last_peered":"2023-10-14T16:59:47.969831+0000","last_clean":"2023-10-14T16:59:47.969831+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T16:59:47.969831+0000","last_undegraded":"2023-10-14T16:59:47.969831+0000","last_fullsized":"2023-10-14T16:59:47.969831+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'546","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.859089+0000","last_change":"2023-10-14T17:00:21.859059+0000","last_active":"2023-10-14T17:00:21.859089+0000","last_peered":"2023-10-14T17:00:21.859089+0000","last_clean":"2023-10-14T17:00:21.859089+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T17:00:21.859089+0000","last_undegraded":"2023-10-14T17:00:21.859089+0000","last_fullsized":"2023-10-14T17:00:21.859089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'546","last_scrub_stamp":"2023-10-14T17:00:21.858971+0000","last_deep_scrub":"23'546","last_deep_scrub_stamp":"2023-10-14T17:00:21.858971+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.858971+0000","objects_scrubbed":3,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:47.102060+0000","scrub_duration":0.0040357489999999999,"objects_trimmed":0,"snaptrim_duration":0.057513697000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"22'5","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971357+0000","last_change":"2023-10-14T16:54:54.099046+0000","last_active":"2023-10-14T16:59:47.971357+0000","last_peered":"2023-10-14T16:59:47.971357+0000","last_clean":"2023-10-14T16:59:47.971357+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T16:59:47.971357+0000","last_undegraded":"2023-10-14T16:59:47.971357+0000","last_fullsized":"2023-10-14T16:59:47.971357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"23'1019","reported_seq":1096,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:10.548287+0000","last_change":"2023-10-14T17:00:10.548242+0000","last_active":"2023-10-14T17:00:10.548287+0000","last_peered":"2023-10-14T17:00:10.548287+0000","last_clean":"2023-10-14T17:00:10.548287+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T17:00:10.548287+0000","last_undegraded":"2023-10-14T17:00:10.548287+0000","last_fullsized":"2023-10-14T17:00:10.548287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1019","last_scrub_stamp":"2023-10-14T17:00:10.548118+0000","last_deep_scrub":"23'1019","last_deep_scrub_stamp":"2023-10-14T17:00:10.548118+0000","last_clean_scrub_stamp":"2023-10-14T17:00:10.548118+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:10.896871+0000","scrub_duration":0.0023116510000000001,"objects_trimmed":0,"snaptrim_duration":0.07026193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'1511","reported_seq":1529,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.974061+0000","last_change":"2023-10-14T16:54:54.099281+0000","last_active":"2023-10-14T16:59:47.974061+0000","last_peered":"2023-10-14T16:59:47.974061+0000","last_clean":"2023-10-14T16:59:47.974061+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T16:59:47.974061+0000","last_undegraded":"2023-10-14T16:59:47.974061+0000","last_fullsized":"2023-10-14T16:59:47.974061+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1511,"log_dups_size":0,"ondisk_log_size":1511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1507,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'585","reported_seq":662,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.585569+0000","last_change":"2023-10-14T17:00:14.585538+0000","last_active":"2023-10-14T17:00:14.585569+0000","last_peered":"2023-10-14T17:00:14.585569+0000","last_clean":"2023-10-14T17:00:14.585569+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T17:00:14.585569+0000","last_undegraded":"2023-10-14T17:00:14.585569+0000","last_fullsized":"2023-10-14T17:00:14.585569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'585","last_scrub_stamp":"2023-10-14T17:00:14.585421+0000","last_deep_scrub":"23'585","last_deep_scrub_stamp":"2023-10-14T17:00:14.585421+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.585421+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:54.815066+0000","scrub_duration":0.0018524399999999999,"objects_trimmed":0,"snaptrim_duration":0.071266745000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"23'755","reported_seq":773,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.491457+0000","last_change":"2023-10-14T16:54:54.100726+0000","last_active":"2023-10-14T16:59:55.491457+0000","last_peered":"2023-10-14T16:59:55.491457+0000","last_clean":"2023-10-14T16:59:55.491457+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T16:59:55.491457+0000","last_undegraded":"2023-10-14T16:59:55.491457+0000","last_fullsized":"2023-10-14T16:59:55.491457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"23'815","reported_seq":892,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:06.672554+0000","last_change":"2023-10-14T17:00:06.672525+0000","last_active":"2023-10-14T17:00:06.672554+0000","last_peered":"2023-10-14T17:00:06.672554+0000","last_clean":"2023-10-14T17:00:06.672554+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T17:00:06.672554+0000","last_undegraded":"2023-10-14T17:00:06.672554+0000","last_fullsized":"2023-10-14T17:00:06.672554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'815","last_scrub_stamp":"2023-10-14T17:00:06.672437+0000","last_deep_scrub":"23'815","last_deep_scrub_stamp":"2023-10-14T17:00:06.672437+0000","last_clean_scrub_stamp":"2023-10-14T17:00:06.672437+0000","objects_scrubbed":2,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:45.321460+0000","scrub_duration":0.0042146179999999998,"objects_trimmed":0,"snaptrim_duration":0.057360406000000003,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"22'756","reported_seq":774,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971756+0000","last_change":"2023-10-14T16:54:54.097646+0000","last_active":"2023-10-14T16:59:47.971756+0000","last_peered":"2023-10-14T16:59:47.971756+0000","last_clean":"2023-10-14T16:59:47.971756+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T16:59:47.971756+0000","last_undegraded":"2023-10-14T16:59:47.971756+0000","last_fullsized":"2023-10-14T16:59:47.971756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'595","reported_seq":671,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:18.436040+0000","last_change":"2023-10-14T17:00:18.436003+0000","last_active":"2023-10-14T17:00:18.436040+0000","last_peered":"2023-10-14T17:00:18.436040+0000","last_clean":"2023-10-14T17:00:18.436040+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T17:00:18.436040+0000","last_undegraded":"2023-10-14T17:00:18.436040+0000","last_fullsized":"2023-10-14T17:00:18.436040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'595","last_scrub_stamp":"2023-10-14T17:00:18.435878+0000","last_deep_scrub":"23'595","last_deep_scrub_stamp":"2023-10-14T17:00:18.435878+0000","last_clean_scrub_stamp":"2023-10-14T17:00:18.435878+0000","objects_scrubbed":2,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:26.316085+0000","scrub_duration":0.0045224619999999997,"objects_trimmed":0,"snaptrim_duration":0.039029367000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'755","reported_seq":773,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.972346+0000","last_change":"2023-10-14T16:54:54.100923+0000","last_active":"2023-10-14T16:59:47.972346+0000","last_peered":"2023-10-14T16:59:47.972346+0000","last_clean":"2023-10-14T16:59:47.972346+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T16:59:47.972346+0000","last_undegraded":"2023-10-14T16:59:47.972346+0000","last_fullsized":"2023-10-14T16:59:47.972346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'445","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:17.439396+0000","last_change":"2023-10-14T17:00:17.439352+0000","last_active":"2023-10-14T17:00:17.439396+0000","last_peered":"2023-10-14T17:00:17.439396+0000","last_clean":"2023-10-14T17:00:17.439396+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T17:00:17.439396+0000","last_undegraded":"2023-10-14T17:00:17.439396+0000","last_fullsized":"2023-10-14T17:00:17.439396+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'445","last_scrub_stamp":"2023-10-14T17:00:17.439252+0000","last_deep_scrub":"23'445","last_deep_scrub_stamp":"2023-10-14T17:00:17.439252+0000","last_clean_scrub_stamp":"2023-10-14T17:00:17.439252+0000","objects_scrubbed":5,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:56.088275+0000","scrub_duration":0.0049452009999999998,"objects_trimmed":0,"snaptrim_duration":0.036384234000000001,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.486568+0000","last_change":"2023-10-14T16:54:54.099363+0000","last_active":"2023-10-14T16:59:55.486568+0000","last_peered":"2023-10-14T16:59:55.486568+0000","last_clean":"2023-10-14T16:59:55.486568+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T16:59:55.486568+0000","last_undegraded":"2023-10-14T16:59:55.486568+0000","last_fullsized":"2023-10-14T16:59:55.486568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"23'731","reported_seq":808,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:20.695393+0000","last_change":"2023-10-14T17:00:20.695362+0000","last_active":"2023-10-14T17:00:20.695393+0000","last_peered":"2023-10-14T17:00:20.695393+0000","last_clean":"2023-10-14T17:00:20.695393+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T17:00:20.695393+0000","last_undegraded":"2023-10-14T17:00:20.695393+0000","last_fullsized":"2023-10-14T17:00:20.695393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'731","last_scrub_stamp":"2023-10-14T17:00:20.695264+0000","last_deep_scrub":"23'731","last_deep_scrub_stamp":"2023-10-14T17:00:20.695264+0000","last_clean_scrub_stamp":"2023-10-14T17:00:20.695264+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:05.017140+0000","scrub_duration":0.001565271,"objects_trimmed":0,"snaptrim_duration":0.070178661000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'1498","reported_seq":1516,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.487568+0000","last_change":"2023-10-14T16:54:54.093771+0000","last_active":"2023-10-14T16:59:55.487568+0000","last_peered":"2023-10-14T16:59:55.487568+0000","last_clean":"2023-10-14T16:59:55.487568+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T16:59:55.487568+0000","last_undegraded":"2023-10-14T16:59:55.487568+0000","last_fullsized":"2023-10-14T16:59:55.487568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1498,"log_dups_size":0,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":12977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"23'732","reported_seq":809,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:07.636144+0000","last_change":"2023-10-14T17:00:07.636098+0000","last_active":"2023-10-14T17:00:07.636144+0000","last_peered":"2023-10-14T17:00:07.636144+0000","last_clean":"2023-10-14T17:00:07.636144+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T17:00:07.636144+0000","last_undegraded":"2023-10-14T17:00:07.636144+0000","last_fullsized":"2023-10-14T17:00:07.636144+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'732","last_scrub_stamp":"2023-10-14T17:00:07.635986+0000","last_deep_scrub":"23'732","last_deep_scrub_stamp":"2023-10-14T17:00:07.635986+0000","last_clean_scrub_stamp":"2023-10-14T17:00:07.635986+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:15.516193+0000","scrub_duration":0.0020539740000000001,"objects_trimmed":0,"snaptrim_duration":0.034606716000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"22'3227","reported_seq":3245,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.972065+0000","last_change":"2023-10-14T16:54:54.103401+0000","last_active":"2023-10-14T16:59:47.972065+0000","last_peered":"2023-10-14T16:59:47.972065+0000","last_clean":"2023-10-14T16:59:47.972065+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T16:59:47.972065+0000","last_undegraded":"2023-10-14T16:59:47.972065+0000","last_fullsized":"2023-10-14T16:59:47.972065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3218,"num_write_kb":10301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'569","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.709675+0000","last_change":"2023-10-14T17:00:14.709621+0000","last_active":"2023-10-14T17:00:14.709675+0000","last_peered":"2023-10-14T17:00:14.709675+0000","last_clean":"2023-10-14T17:00:14.709675+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T17:00:14.709675+0000","last_undegraded":"2023-10-14T17:00:14.709675+0000","last_fullsized":"2023-10-14T17:00:14.709675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'569","last_scrub_stamp":"2023-10-14T17:00:14.709530+0000","last_deep_scrub":"23'569","last_deep_scrub_stamp":"2023-10-14T17:00:14.709530+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.709530+0000","objects_scrubbed":2,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:35:59.031407+0000","scrub_duration":0.0039121779999999997,"objects_trimmed":0,"snaptrim_duration":0.057531643,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"21'650","reported_seq":668,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971954+0000","last_change":"2023-10-14T16:54:54.099084+0000","last_active":"2023-10-14T16:59:47.971954+0000","last_peered":"2023-10-14T16:59:47.971954+0000","last_clean":"2023-10-14T16:59:47.971954+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T16:59:47.971954+0000","last_undegraded":"2023-10-14T16:59:47.971954+0000","last_fullsized":"2023-10-14T16:59:47.971954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'610","reported_seq":708,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:15.396589+0000","last_change":"2023-10-14T17:00:15.396562+0000","last_active":"2023-10-14T17:00:15.396589+0000","last_peered":"2023-10-14T17:00:15.396589+0000","last_clean":"2023-10-14T17:00:15.396589+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T17:00:15.396589+0000","last_undegraded":"2023-10-14T17:00:15.396589+0000","last_fullsized":"2023-10-14T17:00:15.396589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'610","last_scrub_stamp":"2023-10-14T17:00:15.396476+0000","last_deep_scrub":"23'610","last_deep_scrub_stamp":"2023-10-14T17:00:15.396476+0000","last_clean_scrub_stamp":"2023-10-14T17:00:15.396476+0000","objects_scrubbed":10,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:15.745229+0000","scrub_duration":0.0089952309999999994,"objects_trimmed":0,"snaptrim_duration":0.038477224999999997,"stat_sum":{"num_bytes":16395,"num_objects":10,"num_object_clones":4,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":32,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"23'757","reported_seq":775,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.483798+0000","last_change":"2023-10-14T16:54:54.095927+0000","last_active":"2023-10-14T16:59:54.483798+0000","last_peered":"2023-10-14T16:59:54.483798+0000","last_clean":"2023-10-14T16:59:54.483798+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T16:59:54.483798+0000","last_undegraded":"2023-10-14T16:59:54.483798+0000","last_fullsized":"2023-10-14T16:59:54.483798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'595","reported_seq":660,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930520+0000","last_change":"2023-10-14T16:59:40.048170+0000","last_active":"2023-10-14T16:59:54.930520+0000","last_peered":"2023-10-14T16:59:54.930520+0000","last_clean":"2023-10-14T16:59:54.930520+0000","last_became_active":"2023-10-14T16:55:45.058862+0000","last_became_peered":"2023-10-14T16:55:45.058862+0000","last_unstale":"2023-10-14T16:59:54.930520+0000","last_undegraded":"2023-10-14T16:59:54.930520+0000","last_fullsized":"2023-10-14T16:59:54.930520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071388894999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'771","reported_seq":789,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:52.482736+0000","last_change":"2023-10-14T16:54:54.092032+0000","last_active":"2023-10-14T16:59:52.482736+0000","last_peered":"2023-10-14T16:59:52.482736+0000","last_clean":"2023-10-14T16:59:52.482736+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T16:59:52.482736+0000","last_undegraded":"2023-10-14T16:59:52.482736+0000","last_fullsized":"2023-10-14T16:59:52.482736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.973045+0000","last_change":"2023-10-14T16:54:49.689264+0000","last_active":"2023-10-14T16:59:47.973045+0000","last_peered":"2023-10-14T16:59:47.973045+0000","last_clean":"2023-10-14T16:59:47.973045+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T16:59:47.973045+0000","last_undegraded":"2023-10-14T16:59:47.973045+0000","last_fullsized":"2023-10-14T16:59:47.973045+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"23'518","reported_seq":585,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.919082+0000","last_change":"2023-10-14T16:59:40.037294+0000","last_active":"2023-10-14T16:59:54.919082+0000","last_peered":"2023-10-14T16:59:54.919082+0000","last_clean":"2023-10-14T16:59:54.919082+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T16:59:54.919082+0000","last_undegraded":"2023-10-14T16:59:54.919082+0000","last_fullsized":"2023-10-14T16:59:54.919082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061999158999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.116821+0000","last_change":"2023-10-14T16:54:49.063336+0000","last_active":"2023-10-14T16:59:48.116821+0000","last_peered":"2023-10-14T16:59:48.116821+0000","last_clean":"2023-10-14T16:59:48.116821+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T16:59:48.116821+0000","last_undegraded":"2023-10-14T16:59:48.116821+0000","last_fullsized":"2023-10-14T16:59:48.116821+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"23'49","reported_seq":67,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:59.217866+0000","last_change":"2023-10-14T16:54:54.093189+0000","last_active":"2023-10-14T16:59:59.217866+0000","last_peered":"2023-10-14T16:59:59.217866+0000","last_clean":"2023-10-14T16:59:59.217866+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T16:59:59.217866+0000","last_undegraded":"2023-10-14T16:59:59.217866+0000","last_fullsized":"2023-10-14T16:59:59.217866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'517","reported_seq":594,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.446285+0000","last_change":"2023-10-14T17:00:21.446258+0000","last_active":"2023-10-14T17:00:21.446285+0000","last_peered":"2023-10-14T17:00:21.446285+0000","last_clean":"2023-10-14T17:00:21.446285+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T17:00:21.446285+0000","last_undegraded":"2023-10-14T17:00:21.446285+0000","last_fullsized":"2023-10-14T17:00:21.446285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'517","last_scrub_stamp":"2023-10-14T17:00:21.446154+0000","last_deep_scrub":"23'517","last_deep_scrub_stamp":"2023-10-14T17:00:21.446154+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.446154+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:45.918009+0000","scrub_duration":0.0014583549999999999,"objects_trimmed":0,"snaptrim_duration":0.038513458,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:20.098656+0000","last_change":"2023-10-14T17:00:20.098627+0000","last_active":"2023-10-14T17:00:20.098656+0000","last_peered":"2023-10-14T17:00:20.098656+0000","last_clean":"2023-10-14T17:00:20.098656+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T17:00:20.098656+0000","last_undegraded":"2023-10-14T17:00:20.098656+0000","last_fullsized":"2023-10-14T17:00:20.098656+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:20.098523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:20.098523+0000","last_clean_scrub_stamp":"2023-10-14T17:00:20.098523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:44.570379+0000","scrub_duration":0.0018044700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'117","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.973965+0000","last_change":"2023-10-14T16:54:49.063307+0000","last_active":"2023-10-14T16:59:47.973965+0000","last_peered":"2023-10-14T16:59:47.973965+0000","last_clean":"2023-10-14T16:59:47.973965+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T16:59:47.973965+0000","last_undegraded":"2023-10-14T16:59:47.973965+0000","last_fullsized":"2023-10-14T16:59:47.973965+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'76","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.483798+0000","last_change":"2023-10-14T16:54:54.098588+0000","last_active":"2023-10-14T16:59:55.483798+0000","last_peered":"2023-10-14T16:59:55.483798+0000","last_clean":"2023-10-14T16:59:55.483798+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T16:59:55.483798+0000","last_undegraded":"2023-10-14T16:59:55.483798+0000","last_fullsized":"2023-10-14T16:59:55.483798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":646501,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":64,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'754","reported_seq":822,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.940276+0000","last_change":"2023-10-14T16:59:40.048570+0000","last_active":"2023-10-14T16:59:54.940276+0000","last_peered":"2023-10-14T16:59:54.940276+0000","last_clean":"2023-10-14T16:59:54.940276+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T16:59:54.940276+0000","last_undegraded":"2023-10-14T16:59:54.940276+0000","last_fullsized":"2023-10-14T16:59:54.940276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069884818000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971369+0000","last_change":"2023-10-14T16:54:49.689356+0000","last_active":"2023-10-14T16:59:47.971369+0000","last_peered":"2023-10-14T16:59:47.971369+0000","last_clean":"2023-10-14T16:59:47.971369+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T16:59:47.971369+0000","last_undegraded":"2023-10-14T16:59:47.971369+0000","last_fullsized":"2023-10-14T16:59:47.971369+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'2235","reported_seq":2253,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.115989+0000","last_change":"2023-10-14T16:54:54.093196+0000","last_active":"2023-10-14T16:59:48.115989+0000","last_peered":"2023-10-14T16:59:48.115989+0000","last_clean":"2023-10-14T16:59:48.115989+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T16:59:48.115989+0000","last_undegraded":"2023-10-14T16:59:48.115989+0000","last_fullsized":"2023-10-14T16:59:48.115989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":2235,"log_dups_size":0,"ondisk_log_size":2235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2227,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'634","reported_seq":701,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938499+0000","last_change":"2023-10-14T16:59:40.021827+0000","last_active":"2023-10-14T16:59:54.938499+0000","last_peered":"2023-10-14T16:59:54.938499+0000","last_clean":"2023-10-14T16:59:54.938499+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T16:59:54.938499+0000","last_undegraded":"2023-10-14T16:59:54.938499+0000","last_fullsized":"2023-10-14T16:59:54.938499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047771027000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.973875+0000","last_change":"2023-10-14T16:54:49.689595+0000","last_active":"2023-10-14T16:59:47.973875+0000","last_peered":"2023-10-14T16:59:47.973875+0000","last_clean":"2023-10-14T16:59:47.973875+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T16:59:47.973875+0000","last_undegraded":"2023-10-14T16:59:47.973875+0000","last_fullsized":"2023-10-14T16:59:47.973875+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1503","reported_seq":1521,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.116217+0000","last_change":"2023-10-14T16:54:54.099381+0000","last_active":"2023-10-14T16:59:48.116217+0000","last_peered":"2023-10-14T16:59:48.116217+0000","last_clean":"2023-10-14T16:59:48.116217+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T16:59:48.116217+0000","last_undegraded":"2023-10-14T16:59:48.116217+0000","last_fullsized":"2023-10-14T16:59:48.116217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"23'761","reported_seq":837,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:08.665128+0000","last_change":"2023-10-14T17:00:08.665100+0000","last_active":"2023-10-14T17:00:08.665128+0000","last_peered":"2023-10-14T17:00:08.665128+0000","last_clean":"2023-10-14T17:00:08.665128+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T17:00:08.665128+0000","last_undegraded":"2023-10-14T17:00:08.665128+0000","last_fullsized":"2023-10-14T17:00:08.665128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'761","last_scrub_stamp":"2023-10-14T17:00:08.665003+0000","last_deep_scrub":"23'761","last_deep_scrub_stamp":"2023-10-14T17:00:08.665003+0000","last_clean_scrub_stamp":"2023-10-14T17:00:08.665003+0000","objects_scrubbed":2,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:48.894648+0000","scrub_duration":0.0039251659999999999,"objects_trimmed":0,"snaptrim_duration":0.057422879000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971865+0000","last_change":"2023-10-14T16:54:49.689614+0000","last_active":"2023-10-14T16:59:47.971865+0000","last_peered":"2023-10-14T16:59:47.971865+0000","last_clean":"2023-10-14T16:59:47.971865+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T16:59:47.971865+0000","last_undegraded":"2023-10-14T16:59:47.971865+0000","last_fullsized":"2023-10-14T16:59:47.971865+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'741","reported_seq":759,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.489309+0000","last_change":"2023-10-14T16:54:54.100656+0000","last_active":"2023-10-14T16:59:55.489309+0000","last_peered":"2023-10-14T16:59:55.489309+0000","last_clean":"2023-10-14T16:59:55.489309+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T16:59:55.489309+0000","last_undegraded":"2023-10-14T16:59:55.489309+0000","last_fullsized":"2023-10-14T16:59:55.489309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'580","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939040+0000","last_change":"2023-10-14T16:59:40.021216+0000","last_active":"2023-10-14T16:59:54.939040+0000","last_peered":"2023-10-14T16:59:54.939040+0000","last_clean":"2023-10-14T16:59:54.939040+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T16:59:54.939040+0000","last_undegraded":"2023-10-14T16:59:54.939040+0000","last_fullsized":"2023-10-14T16:59:54.939040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047665379000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.972387+0000","last_change":"2023-10-14T16:54:49.689836+0000","last_active":"2023-10-14T16:59:47.972387+0000","last_peered":"2023-10-14T16:59:47.972387+0000","last_clean":"2023-10-14T16:59:47.972387+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T16:59:47.972387+0000","last_undegraded":"2023-10-14T16:59:47.972387+0000","last_fullsized":"2023-10-14T16:59:47.972387+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"21'737","reported_seq":755,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:48.116928+0000","last_change":"2023-10-14T16:54:54.096618+0000","last_active":"2023-10-14T16:59:48.116928+0000","last_peered":"2023-10-14T16:59:48.116928+0000","last_clean":"2023-10-14T16:59:48.116928+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T16:59:48.116928+0000","last_undegraded":"2023-10-14T16:59:48.116928+0000","last_fullsized":"2023-10-14T16:59:48.116928+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'697","reported_seq":764,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930548+0000","last_change":"2023-10-14T16:59:40.044773+0000","last_active":"2023-10-14T16:59:54.930548+0000","last_peered":"2023-10-14T16:59:54.930548+0000","last_clean":"2023-10-14T16:59:54.930548+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T16:59:54.930548+0000","last_undegraded":"2023-10-14T16:59:54.930548+0000","last_fullsized":"2023-10-14T16:59:54.930548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068678344000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.972556+0000","last_change":"2023-10-14T16:54:49.064767+0000","last_active":"2023-10-14T16:59:47.972556+0000","last_peered":"2023-10-14T16:59:47.972556+0000","last_clean":"2023-10-14T16:59:47.972556+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T16:59:47.972556+0000","last_undegraded":"2023-10-14T16:59:47.972556+0000","last_fullsized":"2023-10-14T16:59:47.972556+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"21'1040","reported_seq":1058,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.972956+0000","last_change":"2023-10-14T16:54:54.106280+0000","last_active":"2023-10-14T16:59:47.972956+0000","last_peered":"2023-10-14T16:59:47.972956+0000","last_clean":"2023-10-14T16:59:47.972956+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T16:59:47.972956+0000","last_undegraded":"2023-10-14T16:59:47.972956+0000","last_fullsized":"2023-10-14T16:59:47.972956+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1040,"log_dups_size":0,"ondisk_log_size":1040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":8695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"23'754","reported_seq":821,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938083+0000","last_change":"2023-10-14T16:59:39.988269+0000","last_active":"2023-10-14T16:59:54.938083+0000","last_peered":"2023-10-14T16:59:54.938083+0000","last_clean":"2023-10-14T16:59:54.938083+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T16:59:54.938083+0000","last_undegraded":"2023-10-14T16:59:54.938083+0000","last_fullsized":"2023-10-14T16:59:54.938083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015859669999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'740","reported_seq":758,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.969937+0000","last_change":"2023-10-14T16:54:54.102987+0000","last_active":"2023-10-14T16:59:47.969937+0000","last_peered":"2023-10-14T16:59:47.969937+0000","last_clean":"2023-10-14T16:59:47.969937+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T16:59:47.969937+0000","last_undegraded":"2023-10-14T16:59:47.969937+0000","last_fullsized":"2023-10-14T16:59:47.969937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'627","reported_seq":694,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.929368+0000","last_change":"2023-10-14T16:59:40.021896+0000","last_active":"2023-10-14T16:59:54.929368+0000","last_peered":"2023-10-14T16:59:54.929368+0000","last_clean":"2023-10-14T16:59:54.929368+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T16:59:54.929368+0000","last_undegraded":"2023-10-14T16:59:54.929368+0000","last_fullsized":"2023-10-14T16:59:54.929368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048042644000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"22'754","reported_seq":772,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.972965+0000","last_change":"2023-10-14T16:54:54.095975+0000","last_active":"2023-10-14T16:59:47.972965+0000","last_peered":"2023-10-14T16:59:47.972965+0000","last_clean":"2023-10-14T16:59:47.972965+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T16:59:47.972965+0000","last_undegraded":"2023-10-14T16:59:47.972965+0000","last_fullsized":"2023-10-14T16:59:47.972965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"23'834","reported_seq":901,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938807+0000","last_change":"2023-10-14T16:59:40.012979+0000","last_active":"2023-10-14T16:59:54.938807+0000","last_peered":"2023-10-14T16:59:54.938807+0000","last_clean":"2023-10-14T16:59:54.938807+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T16:59:54.938807+0000","last_undegraded":"2023-10-14T16:59:54.938807+0000","last_fullsized":"2023-10-14T16:59:54.938807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038542571999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2260","reported_seq":2288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:19.853834+0000","last_change":"2023-10-14T17:00:19.853808+0000","last_active":"2023-10-14T17:00:19.853834+0000","last_peered":"2023-10-14T17:00:19.853834+0000","last_clean":"2023-10-14T17:00:19.853834+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T17:00:19.853834+0000","last_undegraded":"2023-10-14T17:00:19.853834+0000","last_fullsized":"2023-10-14T17:00:19.853834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2260","last_scrub_stamp":"2023-10-14T17:00:19.853728+0000","last_deep_scrub":"23'2260","last_deep_scrub_stamp":"2023-10-14T17:00:19.853728+0000","last_clean_scrub_stamp":"2023-10-14T17:00:19.853728+0000","objects_scrubbed":4,"log_size":2260,"log_dups_size":0,"ondisk_log_size":2260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:08.458027+0000","scrub_duration":0.035936590999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2245,"num_write_kb":13441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"23'673","reported_seq":740,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.928559+0000","last_change":"2023-10-14T16:59:40.011333+0000","last_active":"2023-10-14T16:59:54.928559+0000","last_peered":"2023-10-14T16:59:54.928559+0000","last_clean":"2023-10-14T16:59:54.928559+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T16:59:54.928559+0000","last_undegraded":"2023-10-14T16:59:54.928559+0000","last_fullsized":"2023-10-14T16:59:54.928559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038619158000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3073","reported_seq":3091,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:04.219591+0000","last_change":"2023-10-14T16:54:54.095418+0000","last_active":"2023-10-14T17:00:04.219591+0000","last_peered":"2023-10-14T17:00:04.219591+0000","last_clean":"2023-10-14T17:00:04.219591+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T17:00:04.219591+0000","last_undegraded":"2023-10-14T17:00:04.219591+0000","last_fullsized":"2023-10-14T17:00:04.219591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3073,"log_dups_size":0,"ondisk_log_size":3073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5336939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3065,"num_write_kb":7243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"23'767","reported_seq":844,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:13.628534+0000","last_change":"2023-10-14T17:00:13.628505+0000","last_active":"2023-10-14T17:00:13.628534+0000","last_peered":"2023-10-14T17:00:13.628534+0000","last_clean":"2023-10-14T17:00:13.628534+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T17:00:13.628534+0000","last_undegraded":"2023-10-14T17:00:13.628534+0000","last_fullsized":"2023-10-14T17:00:13.628534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'767","last_scrub_stamp":"2023-10-14T17:00:13.628407+0000","last_deep_scrub":"23'767","last_deep_scrub_stamp":"2023-10-14T17:00:13.628407+0000","last_clean_scrub_stamp":"2023-10-14T17:00:13.628407+0000","objects_scrubbed":1,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:21.508614+0000","scrub_duration":0.0032656299999999998,"objects_trimmed":0,"snaptrim_duration":0.068737623999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"21'784","reported_seq":802,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.970258+0000","last_change":"2023-10-14T16:54:54.098491+0000","last_active":"2023-10-14T16:59:47.970258+0000","last_peered":"2023-10-14T16:59:47.970258+0000","last_clean":"2023-10-14T16:59:47.970258+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T16:59:47.970258+0000","last_undegraded":"2023-10-14T16:59:47.970258+0000","last_fullsized":"2023-10-14T16:59:47.970258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389162,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'693","reported_seq":758,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934929+0000","last_change":"2023-10-14T16:59:39.998765+0000","last_active":"2023-10-14T16:59:54.934929+0000","last_peered":"2023-10-14T16:59:54.934929+0000","last_clean":"2023-10-14T16:59:54.934929+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T16:59:54.934929+0000","last_undegraded":"2023-10-14T16:59:54.934929+0000","last_fullsized":"2023-10-14T16:59:54.934929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026701018,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"23'669","reported_seq":735,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.489231+0000","last_change":"2023-10-14T16:59:39.991721+0000","last_active":"2023-10-14T16:59:55.489231+0000","last_peered":"2023-10-14T16:59:55.489231+0000","last_clean":"2023-10-14T16:59:55.489231+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T16:59:55.489231+0000","last_undegraded":"2023-10-14T16:59:55.489231+0000","last_fullsized":"2023-10-14T16:59:55.489231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01972498,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"23'709","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:07.161938+0000","last_change":"2023-10-14T17:00:07.161914+0000","last_active":"2023-10-14T17:00:07.161938+0000","last_peered":"2023-10-14T17:00:07.161938+0000","last_clean":"2023-10-14T17:00:07.161938+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T17:00:07.161938+0000","last_undegraded":"2023-10-14T17:00:07.161938+0000","last_fullsized":"2023-10-14T17:00:07.161938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'709","last_scrub_stamp":"2023-10-14T17:00:07.161847+0000","last_deep_scrub":"23'709","last_deep_scrub_stamp":"2023-10-14T17:00:07.161847+0000","last_clean_scrub_stamp":"2023-10-14T17:00:07.161847+0000","objects_scrubbed":3,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:33:35.683711+0000","scrub_duration":0.003594294,"objects_trimmed":0,"snaptrim_duration":0.012044934,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"23'775","reported_seq":841,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938760+0000","last_change":"2023-10-14T16:59:40.032026+0000","last_active":"2023-10-14T16:59:54.938760+0000","last_peered":"2023-10-14T16:59:54.938760+0000","last_clean":"2023-10-14T16:59:54.938760+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T16:59:54.938760+0000","last_undegraded":"2023-10-14T16:59:54.938760+0000","last_fullsized":"2023-10-14T16:59:54.938760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058085603999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"23'606","reported_seq":682,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.715441+0000","last_change":"2023-10-14T17:00:21.715409+0000","last_active":"2023-10-14T17:00:21.715441+0000","last_peered":"2023-10-14T17:00:21.715441+0000","last_clean":"2023-10-14T17:00:21.715441+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T17:00:21.715441+0000","last_undegraded":"2023-10-14T17:00:21.715441+0000","last_fullsized":"2023-10-14T17:00:21.715441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'606","last_scrub_stamp":"2023-10-14T17:00:21.715312+0000","last_deep_scrub":"23'606","last_deep_scrub_stamp":"2023-10-14T17:00:21.715312+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.715312+0000","objects_scrubbed":6,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:35.370865+0000","scrub_duration":0.0068255670000000003,"objects_trimmed":0,"snaptrim_duration":0.070423702000000005,"stat_sum":{"num_bytes":8224,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"23'396","reported_seq":472,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.082031+0000","last_change":"2023-10-14T17:00:14.081988+0000","last_active":"2023-10-14T17:00:14.082031+0000","last_peered":"2023-10-14T17:00:14.082031+0000","last_clean":"2023-10-14T17:00:14.082031+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T17:00:14.082031+0000","last_undegraded":"2023-10-14T17:00:14.082031+0000","last_fullsized":"2023-10-14T17:00:14.082031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'396","last_scrub_stamp":"2023-10-14T17:00:14.081897+0000","last_deep_scrub":"23'396","last_deep_scrub_stamp":"2023-10-14T17:00:14.081897+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.081897+0000","objects_scrubbed":2,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:21:14.426123+0000","scrub_duration":0.0038898180000000002,"objects_trimmed":0,"snaptrim_duration":0.048708460000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":30,"num_read_kb":20,"num_write":108,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41404,"ondisk_log_size":41404,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":190534230,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":33641,"num_write_kb":203675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381124608,"data_stored":381068460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33848,"ondisk_log_size":33848,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705735,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396524,"kb_used_data":86948,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93975316,"statfs":{"total":96636764160,"available":96230723584,"internally_reserved":0,"allocated":89034752,"data_stored":88829719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.41399999999999998},"min":{"1min":0.218,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61099999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.38600000000000001,"15min":0.42199999999999999},"min":{"1min":0.221,"5min":0.217,"15min":0.217},"max":{"1min":0.57099999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.54500000000000004}]},{"osd":1,"last update":"Sat Oct 14 16:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.44700000000000001,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.44700000000000001,"15min":0.47099999999999997},"min":{"1min":0.25,"5min":0.217,"15min":0.217},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.56200000000000006}]},{"osd":2,"last update":"Sat Oct 14 16:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.29599999999999999,"15min":0.33800000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.45200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.30499999999999999,"15min":0.34399999999999997},"min":{"1min":0.20000000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.47599999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.32000000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705735,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426368,"kb_used_data":116792,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93945472,"statfs":{"total":96636764160,"available":96200163328,"internally_reserved":0,"allocated":119595008,"data_stored":119367674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46500000000000002,"15min":0.45000000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.79900000000000004,"5min":5.992,"15min":5.992},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.504,"15min":0.46200000000000002},"min":{"1min":0.24199999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.73999999999999999,"5min":9.2620000000000005,"15min":9.2620000000000005},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66700000000000004,"5min":6.266,"15min":6.266},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54700000000000004,"15min":0.49399999999999999},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.492,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":0.5}]},{"osd":3,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.313,"15min":0.318},"min":{"1min":0.184,"5min":0.16,"15min":0.16},"max":{"1min":0.69199999999999995,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.193,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.627,"5min":6.3170000000000002,"15min":6.3170000000000002},"last":0.34999999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397668,"kb_used_data":92188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":93974172,"statfs":{"total":96636764160,"available":96229552128,"internally_reserved":0,"allocated":94400512,"data_stored":94213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.27200000000000002,"15min":0.29599999999999999},"min":{"1min":0.20799999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.50800000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.311}]},{"osd":2,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.45700000000000002},"min":{"1min":0.24099999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56299999999999994,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.46500000000000002},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61399999999999999,"5min":0.629,"15min":0.629},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29299999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.63300000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.498}]}]},{"osd":1,"up_from":9,"seq":38654705734,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388312,"kb_used_data":78736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93983528,"statfs":{"total":96636764160,"available":96239132672,"internally_reserved":0,"allocated":80625664,"data_stored":80427560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.27400000000000002},"min":{"1min":0.21099999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.28699999999999998,"15min":0.29899999999999999},"min":{"1min":0.24099999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.36499999999999999}]},{"osd":2,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42599999999999999,"15min":0.45700000000000002},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42199999999999999,"15min":0.46100000000000002},"min":{"1min":0.28399999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63900000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.57299999999999995}]},{"osd":3,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.45300000000000001},"min":{"1min":0.29699999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.59699999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.48599999999999999},"min":{"1min":0.33500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94076928,"data_stored":94064538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":79691776,"data_stored":79691776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":119250944,"data_stored":119230438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88104960,"data_stored":88081708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":53391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":73798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T17:00:27.414 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.414 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.415 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.415 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.415 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.416 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.416 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.416 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.417 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.417 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.418 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.418 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.418 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.419 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.419 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.420 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.420 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.420 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.421 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.421 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.421 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.422 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.422 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.423 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.423 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.423 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.424 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.424 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.425 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.425 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.425 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.426 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.426 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.427 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.427 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.427 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.428 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.428 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.429 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.429 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.429 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.430 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.430 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.431 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.431 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.431 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.432 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.432 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.432 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.433 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.433 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.434 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.434 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.434 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.435 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.435 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.436 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.436 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.436 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.437 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.437 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.438 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.438 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.438 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.439 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.439 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.440 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.440 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.440 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.441 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.441 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.441 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.442 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.442 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.443 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.443 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.444 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.444 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.444 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:27.445 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T17:00:45.978 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:00:45.981 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:00:45.984 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:00:47.446 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T17:00:47.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.577+0000 7fe1b0bee700 1 Processor -- start 2023-10-14T17:00:47.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.577+0000 7fe1b0bee700 1 -- start start 2023-10-14T17:00:47.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.577+0000 7fe1b0bee700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe1ac06d750 0x7fe1ac135050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:47.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.577+0000 7fe1b0bee700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac135590 0x7fe1ac131ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:47.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.577+0000 7fe1b0bee700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac06f5a0 con 0x7fe1ac06df00 2023-10-14T17:00:47.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.577+0000 7fe1b0bee700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac097f80 con 0x7fe1ac06d750 2023-10-14T17:00:47.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.577+0000 7fe1b0bee700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac06e6e0 con 0x7fe1ac135590 2023-10-14T17:00:47.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.578+0000 7fe1aad9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac135590 0x7fe1ac131ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:47.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.578+0000 7fe1aa59c700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe1ac06d750 0x7fe1ac135050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:47.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.578+0000 7fe1aad9d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac135590 0x7fe1ac131ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.8:47952/0 (socket says 172.21.15.8:47952) 2023-10-14T17:00:47.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.578+0000 7fe1a9d9b700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe1ac06df00 0x7fe1ac131590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.8:59662/0 (socket says 172.21.15.8:59662) 2023-10-14T17:00:47.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.578+0000 7fe1aad9d700 1 -- 172.21.15.8:0/755101488 learned_addr learned my addr 172.21.15.8:0/755101488 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:47.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.578+0000 7fe1a959a700 1 -- 172.21.15.8:0/755101488 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708830043 0 0) 0x7fe1ac06f5a0 con 0x7fe1ac06df00 2023-10-14T17:00:47.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.578+0000 7fe1a959a700 1 -- 172.21.15.8:0/755101488 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe198003570 con 0x7fe1ac06df00 2023-10-14T17:00:47.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.578+0000 7fe1aad9d700 1 -- 172.21.15.8:0/755101488 >> v2:172.21.15.155:3300/0 conn(0x7fe1ac06d750 msgr2=0x7fe1ac135050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:00:47.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.578+0000 7fe1aad9d700 1 --2- 172.21.15.8:0/755101488 >> v2:172.21.15.155:3300/0 conn(0x7fe1ac06d750 0x7fe1ac135050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:47.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.578+0000 7fe1aad9d700 1 -- 172.21.15.8:0/755101488 >> v1:172.21.15.155:6789/0 conn(0x7fe1ac06df00 legacy=0x7fe1ac131590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:47.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.578+0000 7fe1aad9d700 1 -- 172.21.15.8:0/755101488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac06e420 con 0x7fe1ac135590 2023-10-14T17:00:47.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.578+0000 7fe1aa59c700 1 --2- 172.21.15.8:0/755101488 >> v2:172.21.15.155:3300/0 conn(0x7fe1ac06d750 0x7fe1ac135050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T17:00:47.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.579+0000 7fe1aad9d700 1 --2- 172.21.15.8:0/755101488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac135590 0x7fe1ac131ca0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac06f730 tx=0x7fe1a4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f89969a46104aa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:47.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.579+0000 7fe1a959a700 1 -- 172.21.15.8:0/755101488 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400b640 con 0x7fe1ac135590 2023-10-14T17:00:47.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.579+0000 7fe1a959a700 1 -- 172.21.15.8:0/755101488 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a400b7a0 con 0x7fe1ac135590 2023-10-14T17:00:47.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.579+0000 7fe1a959a700 1 -- 172.21.15.8:0/755101488 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400bb40 con 0x7fe1ac135590 2023-10-14T17:00:47.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.579+0000 7fe1b0bee700 1 -- 172.21.15.8:0/755101488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac135590 msgr2=0x7fe1ac131ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:47.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.579+0000 7fe1b0bee700 1 --2- 172.21.15.8:0/755101488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac135590 0x7fe1ac131ca0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac06f730 tx=0x7fe1a4009250 comp rx=0 tx=0).stop 2023-10-14T17:00:47.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.579+0000 7fe1b0bee700 1 -- 172.21.15.8:0/755101488 shutdown_connections 2023-10-14T17:00:47.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.579+0000 7fe1b0bee700 1 --2- 172.21.15.8:0/755101488 >> v2:172.21.15.155:3300/0 conn(0x7fe1ac06d750 0x7fe1ac135050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:47.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.579+0000 7fe1b0bee700 1 --2- 172.21.15.8:0/755101488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac135590 0x7fe1ac131ca0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:47.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.579+0000 7fe1b0bee700 1 -- 172.21.15.8:0/755101488 >> 172.21.15.8:0/755101488 conn(0x7fe1ac0a5a60 msgr2=0x7fe1ac0a5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:47.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.579+0000 7fe1b0bee700 1 -- 172.21.15.8:0/755101488 shutdown_connections 2023-10-14T17:00:47.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.579+0000 7fe1b0bee700 1 -- 172.21.15.8:0/755101488 wait complete. 2023-10-14T17:00:47.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.580+0000 7fe1b0bee700 1 Processor -- start 2023-10-14T17:00:47.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.580+0000 7fe1b0bee700 1 -- start start 2023-10-14T17:00:47.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1b0bee700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1ac06df00 0x7fe1ac099420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:47.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1b0bee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1ac135590 0x7fe1ac099960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:47.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1b0bee700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac1320c0 0x7fe1ac099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:47.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1b0bee700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac09c7c0 con 0x7fe1ac135590 2023-10-14T17:00:47.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1b0bee700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0a2dc0 con 0x7fe1ac06df00 2023-10-14T17:00:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1b0bee700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0a3060 con 0x7fe1ac1320c0 2023-10-14T17:00:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1a9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1ac135590 0x7fe1ac099960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1a9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1ac135590 0x7fe1ac099960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51338/0 (socket says 172.21.15.8:51338) 2023-10-14T17:00:47.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1a9d9b700 1 -- 172.21.15.8:0/2855597305 learned_addr learned my addr 172.21.15.8:0/2855597305 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:00:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1aad9d700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac1320c0 0x7fe1ac099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1aa59c700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1ac06df00 0x7fe1ac099420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1a9d9b700 1 -- 172.21.15.8:0/2855597305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac1320c0 msgr2=0x7fe1ac099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:47.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1a9d9b700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac1320c0 0x7fe1ac099ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1a9d9b700 1 -- 172.21.15.8:0/2855597305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1ac06df00 msgr2=0x7fe1ac099420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1a9d9b700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1ac06df00 0x7fe1ac099420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:47.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1a9d9b700 1 -- 172.21.15.8:0/2855597305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c009a20 con 0x7fe1ac135590 2023-10-14T17:00:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.581+0000 7fe1aa59c700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1ac06df00 0x7fe1ac099420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:00:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.582+0000 7fe1a9d9b700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1ac135590 0x7fe1ac099960 secure :-1 s=READY pgs=2492 cs=0 l=1 rev1=1 crypto rx=0x7fe19400c7c0 tx=0x7fe194007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.582+0000 7fe1a27fc700 1 -- 172.21.15.8:0/2855597305 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194005a70 con 0x7fe1ac135590 2023-10-14T17:00:47.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.582+0000 7fe1a27fc700 1 -- 172.21.15.8:0/2855597305 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe194005bd0 con 0x7fe1ac135590 2023-10-14T17:00:47.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.582+0000 7fe1b0bee700 1 -- 172.21.15.8:0/2855597305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a40094f0 con 0x7fe1ac135590 2023-10-14T17:00:47.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.582+0000 7fe1a27fc700 1 -- 172.21.15.8:0/2855597305 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1940070d0 con 0x7fe1ac135590 2023-10-14T17:00:47.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.582+0000 7fe1b0bee700 1 -- 172.21.15.8:0/2855597305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac09b090 con 0x7fe1ac135590 2023-10-14T17:00:47.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.583+0000 7fe1b0bee700 1 -- 172.21.15.8:0/2855597305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac0639b0 con 0x7fe1ac135590 2023-10-14T17:00:47.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.583+0000 7fe1a27fc700 1 -- 172.21.15.8:0/2855597305 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe194007480 con 0x7fe1ac135590 2023-10-14T17:00:47.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.583+0000 7fe1a27fc700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe18c066f30 0x7fe18c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:00:47.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.584+0000 7fe1a27fc700 1 -- 172.21.15.8:0/2855597305 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7fe1940834b0 con 0x7fe1ac135590 2023-10-14T17:00:47.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.584+0000 7fe1aa59c700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe18c066f30 0x7fe18c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:00:47.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.584+0000 7fe1aa59c700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe18c066f30 0x7fe18c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0099f0 tx=0x7fe19c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:00:47.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.588+0000 7fe1a27fc700 1 -- 172.21.15.8:0/2855597305 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe194050c40 con 0x7fe1ac135590 2023-10-14T17:00:47.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.777+0000 7fe1b0bee700 1 -- 172.21.15.8:0/2855597305 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1ac09b310 con 0x7fe18c066f30 2023-10-14T17:00:47.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.784+0000 7fe1a27fc700 1 -- 172.21.15.8:0/2855597305 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278373 (secure 0 0 0) 0x7fe1ac09b310 con 0x7fe18c066f30 2023-10-14T17:00:47.789 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:00:47.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.787+0000 7fe1b0bee700 1 -- 172.21.15.8:0/2855597305 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe18c066f30 msgr2=0x7fe18c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:47.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.787+0000 7fe1b0bee700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe18c066f30 0x7fe18c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0099f0 tx=0x7fe19c00b040 comp rx=0 tx=0).stop 2023-10-14T17:00:47.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.787+0000 7fe1b0bee700 1 -- 172.21.15.8:0/2855597305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1ac135590 msgr2=0x7fe1ac099960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:00:47.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.787+0000 7fe1b0bee700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1ac135590 0x7fe1ac099960 secure :-1 s=READY pgs=2492 cs=0 l=1 rev1=1 crypto rx=0x7fe19400c7c0 tx=0x7fe194007e00 comp rx=0 tx=0).stop 2023-10-14T17:00:47.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.787+0000 7fe1b0bee700 1 -- 172.21.15.8:0/2855597305 shutdown_connections 2023-10-14T17:00:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.787+0000 7fe1b0bee700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fe18c066f30 0x7fe18c0693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.787+0000 7fe1b0bee700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1ac1320c0 0x7fe1ac099ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.787+0000 7fe1b0bee700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1ac06df00 0x7fe1ac099420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:47.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.787+0000 7fe1b0bee700 1 --2- 172.21.15.8:0/2855597305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1ac135590 0x7fe1ac099960 unknown :-1 s=CLOSED pgs=2492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:00:47.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.787+0000 7fe1b0bee700 1 -- 172.21.15.8:0/2855597305 >> 172.21.15.8:0/2855597305 conn(0x7fe1ac0a5a60 msgr2=0x7fe1ac0a3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:00:47.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.787+0000 7fe1b0bee700 1 -- 172.21.15.8:0/2855597305 shutdown_connections 2023-10-14T17:00:47.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:00:47.787+0000 7fe1b0bee700 1 -- 172.21.15.8:0/2855597305 wait complete. 2023-10-14T17:00:47.795 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T17:00:47.800 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2023-10-14T17:00:46.061282+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":191251786,"num_objects":152,"num_object_clones":21,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":8,"num_read":210,"num_read_kb":798,"num_write":33908,"num_write_kb":206280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75421,"ondisk_log_size":75421,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1608872,"kb_used_data":374664,"kb_used_omap":0,"kb_used_meta":1234176,"kb_avail":375878488,"statfs":{"total":386547056640,"available":384899571712,"internally_reserved":0,"allocated":383655936,"data_stored":382838952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1263796224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003349"},"pg_stats":[{"pgid":"4.3f","version":"23'645","reported_seq":712,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939557+0000","last_change":"2023-10-14T16:59:40.048771+0000","last_active":"2023-10-14T16:59:54.939557+0000","last_peered":"2023-10-14T16:59:54.939557+0000","last_clean":"2023-10-14T16:59:54.939557+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T16:59:54.939557+0000","last_undegraded":"2023-10-14T16:59:54.939557+0000","last_fullsized":"2023-10-14T16:59:54.939557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070427155000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"23'746","reported_seq":813,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938650+0000","last_change":"2023-10-14T16:59:40.012472+0000","last_active":"2023-10-14T16:59:54.938650+0000","last_peered":"2023-10-14T16:59:54.938650+0000","last_clean":"2023-10-14T16:59:54.938650+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T16:59:54.938650+0000","last_undegraded":"2023-10-14T16:59:54.938650+0000","last_fullsized":"2023-10-14T16:59:54.938650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038749005000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'628","reported_seq":695,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933938+0000","last_change":"2023-10-14T16:59:40.031831+0000","last_active":"2023-10-14T16:59:54.933938+0000","last_peered":"2023-10-14T16:59:54.933938+0000","last_clean":"2023-10-14T16:59:54.933938+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T16:59:54.933938+0000","last_undegraded":"2023-10-14T16:59:54.933938+0000","last_fullsized":"2023-10-14T16:59:54.933938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152503000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"23'646","reported_seq":713,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.923307+0000","last_change":"2023-10-14T16:59:40.006348+0000","last_active":"2023-10-14T16:59:54.923307+0000","last_peered":"2023-10-14T16:59:54.923307+0000","last_clean":"2023-10-14T16:59:54.923307+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T16:59:54.923307+0000","last_undegraded":"2023-10-14T16:59:54.923307+0000","last_fullsized":"2023-10-14T16:59:54.923307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033834213000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"23'521","reported_seq":588,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.937848+0000","last_change":"2023-10-14T16:59:40.046517+0000","last_active":"2023-10-14T16:59:54.937848+0000","last_peered":"2023-10-14T16:59:54.937848+0000","last_clean":"2023-10-14T16:59:54.937848+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T16:59:54.937848+0000","last_undegraded":"2023-10-14T16:59:54.937848+0000","last_fullsized":"2023-10-14T16:59:54.937848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070258685000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'532","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.918368+0000","last_change":"2023-10-14T16:59:40.032103+0000","last_active":"2023-10-14T16:59:54.918368+0000","last_peered":"2023-10-14T16:59:54.918368+0000","last_clean":"2023-10-14T16:59:54.918368+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T16:59:54.918368+0000","last_undegraded":"2023-10-14T16:59:54.918368+0000","last_fullsized":"2023-10-14T16:59:54.918368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058053194000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'962","reported_seq":1029,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921434+0000","last_change":"2023-10-14T16:59:40.032217+0000","last_active":"2023-10-14T16:59:54.921434+0000","last_peered":"2023-10-14T16:59:54.921434+0000","last_clean":"2023-10-14T16:59:54.921434+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T16:59:54.921434+0000","last_undegraded":"2023-10-14T16:59:54.921434+0000","last_fullsized":"2023-10-14T16:59:54.921434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058433710999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'666","reported_seq":733,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.920919+0000","last_change":"2023-10-14T16:59:40.032894+0000","last_active":"2023-10-14T16:59:54.920919+0000","last_peered":"2023-10-14T16:59:54.920919+0000","last_clean":"2023-10-14T16:59:54.920919+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T16:59:54.920919+0000","last_undegraded":"2023-10-14T16:59:54.920919+0000","last_fullsized":"2023-10-14T16:59:54.920919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057530364000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"23'726","reported_seq":793,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939622+0000","last_change":"2023-10-14T16:59:40.048548+0000","last_active":"2023-10-14T16:59:54.939622+0000","last_peered":"2023-10-14T16:59:54.939622+0000","last_clean":"2023-10-14T16:59:54.939622+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T16:59:54.939622+0000","last_undegraded":"2023-10-14T16:59:54.939622+0000","last_fullsized":"2023-10-14T16:59:54.939622+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070350251000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'591","reported_seq":658,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933655+0000","last_change":"2023-10-14T16:59:40.030928+0000","last_active":"2023-10-14T16:59:54.933655+0000","last_peered":"2023-10-14T16:59:54.933655+0000","last_clean":"2023-10-14T16:59:54.933655+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T16:59:54.933655+0000","last_undegraded":"2023-10-14T16:59:54.933655+0000","last_fullsized":"2023-10-14T16:59:54.933655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057828565999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"23'504","reported_seq":570,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.920150+0000","last_change":"2023-10-14T16:59:40.011889+0000","last_active":"2023-10-14T16:59:54.920150+0000","last_peered":"2023-10-14T16:59:54.920150+0000","last_clean":"2023-10-14T16:59:54.920150+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T16:59:54.920150+0000","last_undegraded":"2023-10-14T16:59:54.920150+0000","last_fullsized":"2023-10-14T16:59:54.920150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039012109000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"23'510","reported_seq":577,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939162+0000","last_change":"2023-10-14T16:59:40.020882+0000","last_active":"2023-10-14T16:59:54.939162+0000","last_peered":"2023-10-14T16:59:54.939162+0000","last_clean":"2023-10-14T16:59:54.939162+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T16:59:54.939162+0000","last_undegraded":"2023-10-14T16:59:54.939162+0000","last_fullsized":"2023-10-14T16:59:54.939162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047436036000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"23'512","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930487+0000","last_change":"2023-10-14T16:59:40.046901+0000","last_active":"2023-10-14T16:59:54.930487+0000","last_peered":"2023-10-14T16:59:54.930487+0000","last_clean":"2023-10-14T16:59:54.930487+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T16:59:54.930487+0000","last_undegraded":"2023-10-14T16:59:54.930487+0000","last_fullsized":"2023-10-14T16:59:54.930487+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070191972000000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"23'757","reported_seq":823,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938420+0000","last_change":"2023-10-14T16:59:40.009015+0000","last_active":"2023-10-14T16:59:54.938420+0000","last_peered":"2023-10-14T16:59:54.938420+0000","last_clean":"2023-10-14T16:59:54.938420+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T16:59:54.938420+0000","last_undegraded":"2023-10-14T16:59:54.938420+0000","last_fullsized":"2023-10-14T16:59:54.938420+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036605058000000003,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"23'655","reported_seq":722,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938675+0000","last_change":"2023-10-14T16:59:40.012646+0000","last_active":"2023-10-14T16:59:54.938675+0000","last_peered":"2023-10-14T16:59:54.938675+0000","last_clean":"2023-10-14T16:59:54.938675+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T16:59:54.938675+0000","last_undegraded":"2023-10-14T16:59:54.938675+0000","last_fullsized":"2023-10-14T16:59:54.938675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038947427,"stat_sum":{"num_bytes":4105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"23'745","reported_seq":811,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933592+0000","last_change":"2023-10-14T16:59:40.032292+0000","last_active":"2023-10-14T16:59:54.933592+0000","last_peered":"2023-10-14T16:59:54.933592+0000","last_clean":"2023-10-14T16:59:54.933592+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T16:59:54.933592+0000","last_undegraded":"2023-10-14T16:59:54.933592+0000","last_fullsized":"2023-10-14T16:59:54.933592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058345898,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'595","reported_seq":662,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939671+0000","last_change":"2023-10-14T16:59:40.048812+0000","last_active":"2023-10-14T16:59:54.939671+0000","last_peered":"2023-10-14T16:59:54.939671+0000","last_clean":"2023-10-14T16:59:54.939671+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T16:59:54.939671+0000","last_undegraded":"2023-10-14T16:59:54.939671+0000","last_fullsized":"2023-10-14T16:59:54.939671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071573409000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'693","reported_seq":760,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.489180+0000","last_change":"2023-10-14T16:59:40.030743+0000","last_active":"2023-10-14T16:59:55.489180+0000","last_peered":"2023-10-14T16:59:55.489180+0000","last_clean":"2023-10-14T16:59:55.489180+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T16:59:55.489180+0000","last_undegraded":"2023-10-14T16:59:55.489180+0000","last_fullsized":"2023-10-14T16:59:55.489180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057407435999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"23'572","reported_seq":640,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930528+0000","last_change":"2023-10-14T16:59:40.045847+0000","last_active":"2023-10-14T16:59:54.930528+0000","last_peered":"2023-10-14T16:59:54.930528+0000","last_clean":"2023-10-14T16:59:54.930528+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T16:59:54.930528+0000","last_undegraded":"2023-10-14T16:59:54.930528+0000","last_fullsized":"2023-10-14T16:59:54.930528+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070060102999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"23'761","reported_seq":828,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939481+0000","last_change":"2023-10-14T16:59:40.029354+0000","last_active":"2023-10-14T16:59:54.939481+0000","last_peered":"2023-10-14T16:59:54.939481+0000","last_clean":"2023-10-14T16:59:54.939481+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T16:59:54.939481+0000","last_undegraded":"2023-10-14T16:59:54.939481+0000","last_fullsized":"2023-10-14T16:59:54.939481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056633790000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"23'810","reported_seq":877,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938819+0000","last_change":"2023-10-14T16:59:40.012817+0000","last_active":"2023-10-14T16:59:54.938819+0000","last_peered":"2023-10-14T16:59:54.938819+0000","last_clean":"2023-10-14T16:59:54.938819+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T16:59:54.938819+0000","last_undegraded":"2023-10-14T16:59:54.938819+0000","last_fullsized":"2023-10-14T16:59:54.938819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038418550000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"23'694","reported_seq":761,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938835+0000","last_change":"2023-10-14T16:59:40.041012+0000","last_active":"2023-10-14T16:59:54.938835+0000","last_peered":"2023-10-14T16:59:54.938835+0000","last_clean":"2023-10-14T16:59:54.938835+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T16:59:54.938835+0000","last_undegraded":"2023-10-14T16:59:54.938835+0000","last_fullsized":"2023-10-14T16:59:54.938835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.065688290999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'638","reported_seq":715,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:41.237813+0000","last_change":"2023-10-14T17:00:41.237783+0000","last_active":"2023-10-14T17:00:41.237813+0000","last_peered":"2023-10-14T17:00:41.237813+0000","last_clean":"2023-10-14T17:00:41.237813+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T17:00:41.237813+0000","last_undegraded":"2023-10-14T17:00:41.237813+0000","last_fullsized":"2023-10-14T17:00:41.237813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'638","last_scrub_stamp":"2023-10-14T17:00:41.237668+0000","last_deep_scrub":"23'638","last_deep_scrub_stamp":"2023-10-14T17:00:41.237668+0000","last_clean_scrub_stamp":"2023-10-14T17:00:41.237668+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:17.477170+0000","scrub_duration":0.0015379790000000001,"objects_trimmed":0,"snaptrim_duration":0.011260075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"23'846","reported_seq":923,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:37.816280+0000","last_change":"2023-10-14T17:00:37.816253+0000","last_active":"2023-10-14T17:00:37.816280+0000","last_peered":"2023-10-14T17:00:37.816280+0000","last_clean":"2023-10-14T17:00:37.816280+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T17:00:37.816280+0000","last_undegraded":"2023-10-14T17:00:37.816280+0000","last_fullsized":"2023-10-14T17:00:37.816280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'846","last_scrub_stamp":"2023-10-14T17:00:37.816136+0000","last_deep_scrub":"23'846","last_deep_scrub_stamp":"2023-10-14T17:00:37.816136+0000","last_clean_scrub_stamp":"2023-10-14T17:00:37.816136+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:19.053769+0000","scrub_duration":0.001974478,"objects_trimmed":0,"snaptrim_duration":0.058152492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"23'636","reported_seq":703,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938573+0000","last_change":"2023-10-14T16:59:40.023150+0000","last_active":"2023-10-14T16:59:54.938573+0000","last_peered":"2023-10-14T16:59:54.938573+0000","last_clean":"2023-10-14T16:59:54.938573+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T16:59:54.938573+0000","last_undegraded":"2023-10-14T16:59:54.938573+0000","last_fullsized":"2023-10-14T16:59:54.938573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048983802,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'679","reported_seq":756,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:17.045500+0000","last_change":"2023-10-14T17:00:17.045457+0000","last_active":"2023-10-14T17:00:17.045500+0000","last_peered":"2023-10-14T17:00:17.045500+0000","last_clean":"2023-10-14T17:00:17.045500+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T17:00:17.045500+0000","last_undegraded":"2023-10-14T17:00:17.045500+0000","last_fullsized":"2023-10-14T17:00:17.045500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'679","last_scrub_stamp":"2023-10-14T17:00:17.045319+0000","last_deep_scrub":"23'679","last_deep_scrub_stamp":"2023-10-14T17:00:17.045319+0000","last_clean_scrub_stamp":"2023-10-14T17:00:17.045319+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:24.925526+0000","scrub_duration":0.0014699489999999999,"objects_trimmed":0,"snaptrim_duration":0.047799974000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'513","reported_seq":580,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.934020+0000","last_change":"2023-10-14T16:59:40.032393+0000","last_active":"2023-10-14T16:59:54.934020+0000","last_peered":"2023-10-14T16:59:54.934020+0000","last_clean":"2023-10-14T16:59:54.934020+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T16:59:54.934020+0000","last_undegraded":"2023-10-14T16:59:54.934020+0000","last_fullsized":"2023-10-14T16:59:54.934020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058565578,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1532","reported_seq":1550,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971057+0000","last_change":"2023-10-14T16:54:54.101946+0000","last_active":"2023-10-14T16:59:47.971057+0000","last_peered":"2023-10-14T16:59:47.971057+0000","last_clean":"2023-10-14T16:59:47.971057+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T16:59:47.971057+0000","last_undegraded":"2023-10-14T16:59:47.971057+0000","last_fullsized":"2023-10-14T16:59:47.971057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1532,"log_dups_size":0,"ondisk_log_size":1532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1524,"num_write_kb":13073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"23'655","reported_seq":733,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:25.725868+0000","last_change":"2023-10-14T17:00:25.725836+0000","last_active":"2023-10-14T17:00:25.725868+0000","last_peered":"2023-10-14T17:00:25.725868+0000","last_clean":"2023-10-14T17:00:25.725868+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T17:00:25.725868+0000","last_undegraded":"2023-10-14T17:00:25.725868+0000","last_fullsized":"2023-10-14T17:00:25.725868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'655","last_scrub_stamp":"2023-10-14T17:00:25.725747+0000","last_deep_scrub":"23'655","last_deep_scrub_stamp":"2023-10-14T17:00:25.725747+0000","last_clean_scrub_stamp":"2023-10-14T17:00:25.725747+0000","objects_scrubbed":2,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:50.968836+0000","scrub_duration":0.0036407990000000001,"objects_trimmed":0,"snaptrim_duration":0.067459389999999994,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"23'756","reported_seq":784,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:16.095374+0000","last_change":"2023-10-14T17:00:16.095338+0000","last_active":"2023-10-14T17:00:16.095374+0000","last_peered":"2023-10-14T17:00:16.095374+0000","last_clean":"2023-10-14T17:00:16.095374+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T17:00:16.095374+0000","last_undegraded":"2023-10-14T17:00:16.095374+0000","last_fullsized":"2023-10-14T17:00:16.095374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'756","last_scrub_stamp":"2023-10-14T17:00:16.095246+0000","last_deep_scrub":"23'756","last_deep_scrub_stamp":"2023-10-14T17:00:16.095246+0000","last_clean_scrub_stamp":"2023-10-14T17:00:16.095246+0000","objects_scrubbed":1,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:54.744269+0000","scrub_duration":0.013423025999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'585","reported_seq":662,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:16.588712+0000","last_change":"2023-10-14T17:00:16.588677+0000","last_active":"2023-10-14T17:00:16.588712+0000","last_peered":"2023-10-14T17:00:16.588712+0000","last_clean":"2023-10-14T17:00:16.588712+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T17:00:16.588712+0000","last_undegraded":"2023-10-14T17:00:16.588712+0000","last_fullsized":"2023-10-14T17:00:16.588712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'585","last_scrub_stamp":"2023-10-14T17:00:16.588581+0000","last_deep_scrub":"23'585","last_deep_scrub_stamp":"2023-10-14T17:00:16.588581+0000","last_clean_scrub_stamp":"2023-10-14T17:00:16.588581+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:41.060437+0000","scrub_duration":0.0019550330000000001,"objects_trimmed":0,"snaptrim_duration":0.070886901000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1509","reported_seq":1537,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:18.073307+0000","last_change":"2023-10-14T17:00:18.073275+0000","last_active":"2023-10-14T17:00:18.073307+0000","last_peered":"2023-10-14T17:00:18.073307+0000","last_clean":"2023-10-14T17:00:18.073307+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T17:00:18.073307+0000","last_undegraded":"2023-10-14T17:00:18.073307+0000","last_fullsized":"2023-10-14T17:00:18.073307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1509","last_scrub_stamp":"2023-10-14T17:00:18.073180+0000","last_deep_scrub":"23'1509","last_deep_scrub_stamp":"2023-10-14T17:00:18.073180+0000","last_clean_scrub_stamp":"2023-10-14T17:00:18.073180+0000","objects_scrubbed":3,"log_size":1509,"log_dups_size":0,"ondisk_log_size":1509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:58.302825+0000","scrub_duration":0.026462619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"23'595","reported_seq":672,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:26.833140+0000","last_change":"2023-10-14T17:00:26.833112+0000","last_active":"2023-10-14T17:00:26.833140+0000","last_peered":"2023-10-14T17:00:26.833140+0000","last_clean":"2023-10-14T17:00:26.833140+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T17:00:26.833140+0000","last_undegraded":"2023-10-14T17:00:26.833140+0000","last_fullsized":"2023-10-14T17:00:26.833140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'595","last_scrub_stamp":"2023-10-14T17:00:26.833028+0000","last_deep_scrub":"23'595","last_deep_scrub_stamp":"2023-10-14T17:00:26.833028+0000","last_clean_scrub_stamp":"2023-10-14T17:00:26.833028+0000","objects_scrubbed":2,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:30.522108+0000","scrub_duration":0.0043885740000000001,"objects_trimmed":0,"snaptrim_duration":0.058803686000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"22'4","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:31.648411+0000","last_change":"2023-10-14T17:00:31.648376+0000","last_active":"2023-10-14T17:00:31.648411+0000","last_peered":"2023-10-14T17:00:31.648411+0000","last_clean":"2023-10-14T17:00:31.648411+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T17:00:31.648411+0000","last_undegraded":"2023-10-14T17:00:31.648411+0000","last_fullsized":"2023-10-14T17:00:31.648411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2023-10-14T17:00:31.648277+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2023-10-14T17:00:31.648277+0000","last_clean_scrub_stamp":"2023-10-14T17:00:31.648277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:35.337357+0000","scrub_duration":0.0020350590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'583","reported_seq":660,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:12.106374+0000","last_change":"2023-10-14T17:00:12.106339+0000","last_active":"2023-10-14T17:00:12.106374+0000","last_peered":"2023-10-14T17:00:12.106374+0000","last_clean":"2023-10-14T17:00:12.106374+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T17:00:12.106374+0000","last_undegraded":"2023-10-14T17:00:12.106374+0000","last_fullsized":"2023-10-14T17:00:12.106374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'583","last_scrub_stamp":"2023-10-14T17:00:12.106239+0000","last_deep_scrub":"23'583","last_deep_scrub_stamp":"2023-10-14T17:00:12.106239+0000","last_clean_scrub_stamp":"2023-10-14T17:00:12.106239+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:53:48.745008+0000","scrub_duration":0.0023297560000000001,"objects_trimmed":0,"snaptrim_duration":0.024750503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'757","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:26.505195+0000","last_change":"2023-10-14T17:00:26.505158+0000","last_active":"2023-10-14T17:00:26.505195+0000","last_peered":"2023-10-14T17:00:26.505195+0000","last_clean":"2023-10-14T17:00:26.505195+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T17:00:26.505195+0000","last_undegraded":"2023-10-14T17:00:26.505195+0000","last_fullsized":"2023-10-14T17:00:26.505195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'757","last_scrub_stamp":"2023-10-14T17:00:26.505033+0000","last_deep_scrub":"23'757","last_deep_scrub_stamp":"2023-10-14T17:00:26.505033+0000","last_clean_scrub_stamp":"2023-10-14T17:00:26.505033+0000","objects_scrubbed":1,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:40.160585+0000","scrub_duration":0.014321274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'570","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:12.612196+0000","last_change":"2023-10-14T17:00:12.612165+0000","last_active":"2023-10-14T17:00:12.612196+0000","last_peered":"2023-10-14T17:00:12.612196+0000","last_clean":"2023-10-14T17:00:12.612196+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T17:00:12.612196+0000","last_undegraded":"2023-10-14T17:00:12.612196+0000","last_fullsized":"2023-10-14T17:00:12.612196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'570","last_scrub_stamp":"2023-10-14T17:00:12.612058+0000","last_deep_scrub":"23'570","last_deep_scrub_stamp":"2023-10-14T17:00:12.612058+0000","last_clean_scrub_stamp":"2023-10-14T17:00:12.612058+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:51.261080+0000","scrub_duration":0.001901631,"objects_trimmed":0,"snaptrim_duration":0.067572238000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"23'798","reported_seq":816,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.493247+0000","last_change":"2023-10-14T16:54:54.097908+0000","last_active":"2023-10-14T16:59:55.493247+0000","last_peered":"2023-10-14T16:59:55.493247+0000","last_clean":"2023-10-14T16:59:55.493247+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T16:59:55.493247+0000","last_undegraded":"2023-10-14T16:59:55.493247+0000","last_fullsized":"2023-10-14T16:59:55.493247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"23'414","reported_seq":491,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:09.150688+0000","last_change":"2023-10-14T17:00:09.150657+0000","last_active":"2023-10-14T17:00:09.150688+0000","last_peered":"2023-10-14T17:00:09.150688+0000","last_clean":"2023-10-14T17:00:09.150688+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T17:00:09.150688+0000","last_undegraded":"2023-10-14T17:00:09.150688+0000","last_fullsized":"2023-10-14T17:00:09.150688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'414","last_scrub_stamp":"2023-10-14T17:00:09.150551+0000","last_deep_scrub":"23'414","last_deep_scrub_stamp":"2023-10-14T17:00:09.150551+0000","last_clean_scrub_stamp":"2023-10-14T17:00:09.150551+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:38.484247+0000","scrub_duration":0.0020073140000000001,"objects_trimmed":0,"snaptrim_duration":0.013962693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'2303","reported_seq":2331,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:24.855552+0000","last_change":"2023-10-14T17:00:24.855526+0000","last_active":"2023-10-14T17:00:24.855552+0000","last_peered":"2023-10-14T17:00:24.855552+0000","last_clean":"2023-10-14T17:00:24.855552+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T17:00:24.855552+0000","last_undegraded":"2023-10-14T17:00:24.855552+0000","last_fullsized":"2023-10-14T17:00:24.855552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2303","last_scrub_stamp":"2023-10-14T17:00:24.855445+0000","last_deep_scrub":"23'2303","last_deep_scrub_stamp":"2023-10-14T17:00:24.855445+0000","last_clean_scrub_stamp":"2023-10-14T17:00:24.855445+0000","objects_scrubbed":6,"log_size":2303,"log_dups_size":0,"ondisk_log_size":2303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:55.570593+0000","scrub_duration":0.039868383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2289,"num_write_kb":13405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"23'485","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:19.481760+0000","last_change":"2023-10-14T17:00:19.481720+0000","last_active":"2023-10-14T17:00:19.481760+0000","last_peered":"2023-10-14T17:00:19.481760+0000","last_clean":"2023-10-14T17:00:19.481760+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T17:00:19.481760+0000","last_undegraded":"2023-10-14T17:00:19.481760+0000","last_fullsized":"2023-10-14T17:00:19.481760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'485","last_scrub_stamp":"2023-10-14T17:00:19.481628+0000","last_deep_scrub":"23'485","last_deep_scrub_stamp":"2023-10-14T17:00:19.481628+0000","last_clean_scrub_stamp":"2023-10-14T17:00:19.481628+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:59.711273+0000","scrub_duration":0.001552152,"objects_trimmed":0,"snaptrim_duration":0.038441039000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"21'1506","reported_seq":1524,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971215+0000","last_change":"2023-10-14T16:54:54.103486+0000","last_active":"2023-10-14T16:59:47.971215+0000","last_peered":"2023-10-14T16:59:47.971215+0000","last_clean":"2023-10-14T16:59:47.971215+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T16:59:47.971215+0000","last_undegraded":"2023-10-14T16:59:47.971215+0000","last_fullsized":"2023-10-14T16:59:47.971215+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1498,"num_write_kb":8967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"23'532","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939103+0000","last_change":"2023-10-14T16:59:40.021641+0000","last_active":"2023-10-14T16:59:54.939103+0000","last_peered":"2023-10-14T16:59:54.939103+0000","last_clean":"2023-10-14T16:59:54.939103+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T16:59:54.939103+0000","last_undegraded":"2023-10-14T16:59:54.939103+0000","last_fullsized":"2023-10-14T16:59:54.939103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047574827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"22'3","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:36.699025+0000","last_change":"2023-10-14T17:00:36.698989+0000","last_active":"2023-10-14T17:00:36.699025+0000","last_peered":"2023-10-14T17:00:36.699025+0000","last_clean":"2023-10-14T17:00:36.699025+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T17:00:36.699025+0000","last_undegraded":"2023-10-14T17:00:36.699025+0000","last_fullsized":"2023-10-14T17:00:36.699025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2023-10-14T17:00:36.698893+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2023-10-14T17:00:36.698893+0000","last_clean_scrub_stamp":"2023-10-14T17:00:36.698893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:17.764307+0000","scrub_duration":0.001518506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'546","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.859089+0000","last_change":"2023-10-14T17:00:21.859059+0000","last_active":"2023-10-14T17:00:21.859089+0000","last_peered":"2023-10-14T17:00:21.859089+0000","last_clean":"2023-10-14T17:00:21.859089+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T17:00:21.859089+0000","last_undegraded":"2023-10-14T17:00:21.859089+0000","last_fullsized":"2023-10-14T17:00:21.859089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'546","last_scrub_stamp":"2023-10-14T17:00:21.858971+0000","last_deep_scrub":"23'546","last_deep_scrub_stamp":"2023-10-14T17:00:21.858971+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.858971+0000","objects_scrubbed":3,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:47.102060+0000","scrub_duration":0.0040357489999999999,"objects_trimmed":0,"snaptrim_duration":0.057513697000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"22'5","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:27.799109+0000","last_change":"2023-10-14T17:00:27.799084+0000","last_active":"2023-10-14T17:00:27.799109+0000","last_peered":"2023-10-14T17:00:27.799109+0000","last_clean":"2023-10-14T17:00:27.799109+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T17:00:27.799109+0000","last_undegraded":"2023-10-14T17:00:27.799109+0000","last_fullsized":"2023-10-14T17:00:27.799109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2023-10-14T17:00:27.798994+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2023-10-14T17:00:27.798994+0000","last_clean_scrub_stamp":"2023-10-14T17:00:27.798994+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:07.088613+0000","scrub_duration":0.0014250129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"23'1019","reported_seq":1096,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:10.548287+0000","last_change":"2023-10-14T17:00:10.548242+0000","last_active":"2023-10-14T17:00:10.548287+0000","last_peered":"2023-10-14T17:00:10.548287+0000","last_clean":"2023-10-14T17:00:10.548287+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T17:00:10.548287+0000","last_undegraded":"2023-10-14T17:00:10.548287+0000","last_fullsized":"2023-10-14T17:00:10.548287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1019","last_scrub_stamp":"2023-10-14T17:00:10.548118+0000","last_deep_scrub":"23'1019","last_deep_scrub_stamp":"2023-10-14T17:00:10.548118+0000","last_clean_scrub_stamp":"2023-10-14T17:00:10.548118+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:10.896871+0000","scrub_duration":0.0023116510000000001,"objects_trimmed":0,"snaptrim_duration":0.07026193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'1517","reported_seq":1545,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:33.925606+0000","last_change":"2023-10-14T17:00:33.925560+0000","last_active":"2023-10-14T17:00:33.925606+0000","last_peered":"2023-10-14T17:00:33.925606+0000","last_clean":"2023-10-14T17:00:33.925606+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T17:00:33.925606+0000","last_undegraded":"2023-10-14T17:00:33.925606+0000","last_fullsized":"2023-10-14T17:00:33.925606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1517","last_scrub_stamp":"2023-10-14T17:00:33.925467+0000","last_deep_scrub":"23'1517","last_deep_scrub_stamp":"2023-10-14T17:00:33.925467+0000","last_clean_scrub_stamp":"2023-10-14T17:00:33.925467+0000","objects_scrubbed":6,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:10.164969+0000","scrub_duration":0.024970293000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1507,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'585","reported_seq":662,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.585569+0000","last_change":"2023-10-14T17:00:14.585538+0000","last_active":"2023-10-14T17:00:14.585569+0000","last_peered":"2023-10-14T17:00:14.585569+0000","last_clean":"2023-10-14T17:00:14.585569+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T17:00:14.585569+0000","last_undegraded":"2023-10-14T17:00:14.585569+0000","last_fullsized":"2023-10-14T17:00:14.585569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'585","last_scrub_stamp":"2023-10-14T17:00:14.585421+0000","last_deep_scrub":"23'585","last_deep_scrub_stamp":"2023-10-14T17:00:14.585421+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.585421+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:54.815066+0000","scrub_duration":0.0018524399999999999,"objects_trimmed":0,"snaptrim_duration":0.071266745000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"23'757","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:30.436241+0000","last_change":"2023-10-14T17:00:30.436214+0000","last_active":"2023-10-14T17:00:30.436241+0000","last_peered":"2023-10-14T17:00:30.436241+0000","last_clean":"2023-10-14T17:00:30.436241+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T17:00:30.436241+0000","last_undegraded":"2023-10-14T17:00:30.436241+0000","last_fullsized":"2023-10-14T17:00:30.436241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'757","last_scrub_stamp":"2023-10-14T17:00:30.436119+0000","last_deep_scrub":"23'757","last_deep_scrub_stamp":"2023-10-14T17:00:30.436119+0000","last_clean_scrub_stamp":"2023-10-14T17:00:30.436119+0000","objects_scrubbed":2,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:55.679208+0000","scrub_duration":0.014880749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"23'815","reported_seq":892,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:06.672554+0000","last_change":"2023-10-14T17:00:06.672525+0000","last_active":"2023-10-14T17:00:06.672554+0000","last_peered":"2023-10-14T17:00:06.672554+0000","last_clean":"2023-10-14T17:00:06.672554+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T17:00:06.672554+0000","last_undegraded":"2023-10-14T17:00:06.672554+0000","last_fullsized":"2023-10-14T17:00:06.672554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'815","last_scrub_stamp":"2023-10-14T17:00:06.672437+0000","last_deep_scrub":"23'815","last_deep_scrub_stamp":"2023-10-14T17:00:06.672437+0000","last_clean_scrub_stamp":"2023-10-14T17:00:06.672437+0000","objects_scrubbed":2,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:45.321460+0000","scrub_duration":0.0042146179999999998,"objects_trimmed":0,"snaptrim_duration":0.057360406000000003,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"22'756","reported_seq":774,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971756+0000","last_change":"2023-10-14T16:54:54.097646+0000","last_active":"2023-10-14T16:59:47.971756+0000","last_peered":"2023-10-14T16:59:47.971756+0000","last_clean":"2023-10-14T16:59:47.971756+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T16:59:47.971756+0000","last_undegraded":"2023-10-14T16:59:47.971756+0000","last_fullsized":"2023-10-14T16:59:47.971756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'595","reported_seq":671,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:18.436040+0000","last_change":"2023-10-14T17:00:18.436003+0000","last_active":"2023-10-14T17:00:18.436040+0000","last_peered":"2023-10-14T17:00:18.436040+0000","last_clean":"2023-10-14T17:00:18.436040+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T17:00:18.436040+0000","last_undegraded":"2023-10-14T17:00:18.436040+0000","last_fullsized":"2023-10-14T17:00:18.436040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'595","last_scrub_stamp":"2023-10-14T17:00:18.435878+0000","last_deep_scrub":"23'595","last_deep_scrub_stamp":"2023-10-14T17:00:18.435878+0000","last_clean_scrub_stamp":"2023-10-14T17:00:18.435878+0000","objects_scrubbed":2,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:26.316085+0000","scrub_duration":0.0045224619999999997,"objects_trimmed":0,"snaptrim_duration":0.039029367000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'755","reported_seq":773,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.972346+0000","last_change":"2023-10-14T16:54:54.100923+0000","last_active":"2023-10-14T16:59:47.972346+0000","last_peered":"2023-10-14T16:59:47.972346+0000","last_clean":"2023-10-14T16:59:47.972346+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T16:59:47.972346+0000","last_undegraded":"2023-10-14T16:59:47.972346+0000","last_fullsized":"2023-10-14T16:59:47.972346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'445","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:17.439396+0000","last_change":"2023-10-14T17:00:17.439352+0000","last_active":"2023-10-14T17:00:17.439396+0000","last_peered":"2023-10-14T17:00:17.439396+0000","last_clean":"2023-10-14T17:00:17.439396+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T17:00:17.439396+0000","last_undegraded":"2023-10-14T17:00:17.439396+0000","last_fullsized":"2023-10-14T17:00:17.439396+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'445","last_scrub_stamp":"2023-10-14T17:00:17.439252+0000","last_deep_scrub":"23'445","last_deep_scrub_stamp":"2023-10-14T17:00:17.439252+0000","last_clean_scrub_stamp":"2023-10-14T17:00:17.439252+0000","objects_scrubbed":5,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:56.088275+0000","scrub_duration":0.0049452009999999998,"objects_trimmed":0,"snaptrim_duration":0.036384234000000001,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.486568+0000","last_change":"2023-10-14T16:54:54.099363+0000","last_active":"2023-10-14T16:59:55.486568+0000","last_peered":"2023-10-14T16:59:55.486568+0000","last_clean":"2023-10-14T16:59:55.486568+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T16:59:55.486568+0000","last_undegraded":"2023-10-14T16:59:55.486568+0000","last_fullsized":"2023-10-14T16:59:55.486568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"23'731","reported_seq":808,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:20.695393+0000","last_change":"2023-10-14T17:00:20.695362+0000","last_active":"2023-10-14T17:00:20.695393+0000","last_peered":"2023-10-14T17:00:20.695393+0000","last_clean":"2023-10-14T17:00:20.695393+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T17:00:20.695393+0000","last_undegraded":"2023-10-14T17:00:20.695393+0000","last_fullsized":"2023-10-14T17:00:20.695393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'731","last_scrub_stamp":"2023-10-14T17:00:20.695264+0000","last_deep_scrub":"23'731","last_deep_scrub_stamp":"2023-10-14T17:00:20.695264+0000","last_clean_scrub_stamp":"2023-10-14T17:00:20.695264+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:05.017140+0000","scrub_duration":0.001565271,"objects_trimmed":0,"snaptrim_duration":0.070178661000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'1502","reported_seq":1530,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:36.331783+0000","last_change":"2023-10-14T17:00:36.331735+0000","last_active":"2023-10-14T17:00:36.331783+0000","last_peered":"2023-10-14T17:00:36.331783+0000","last_clean":"2023-10-14T17:00:36.331783+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T17:00:36.331783+0000","last_undegraded":"2023-10-14T17:00:36.331783+0000","last_fullsized":"2023-10-14T17:00:36.331783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1502","last_scrub_stamp":"2023-10-14T17:00:36.331637+0000","last_deep_scrub":"23'1502","last_deep_scrub_stamp":"2023-10-14T17:00:36.331637+0000","last_clean_scrub_stamp":"2023-10-14T17:00:36.331637+0000","objects_scrubbed":4,"log_size":1502,"log_dups_size":0,"ondisk_log_size":1502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:15.621256+0000","scrub_duration":0.027209761999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":12977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"23'732","reported_seq":809,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:07.636144+0000","last_change":"2023-10-14T17:00:07.636098+0000","last_active":"2023-10-14T17:00:07.636144+0000","last_peered":"2023-10-14T17:00:07.636144+0000","last_clean":"2023-10-14T17:00:07.636144+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T17:00:07.636144+0000","last_undegraded":"2023-10-14T17:00:07.636144+0000","last_fullsized":"2023-10-14T17:00:07.636144+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'732","last_scrub_stamp":"2023-10-14T17:00:07.635986+0000","last_deep_scrub":"23'732","last_deep_scrub_stamp":"2023-10-14T17:00:07.635986+0000","last_clean_scrub_stamp":"2023-10-14T17:00:07.635986+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:15.516193+0000","scrub_duration":0.0020539740000000001,"objects_trimmed":0,"snaptrim_duration":0.034606716000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'3229","reported_seq":3257,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:39.800699+0000","last_change":"2023-10-14T17:00:39.800656+0000","last_active":"2023-10-14T17:00:39.800699+0000","last_peered":"2023-10-14T17:00:39.800699+0000","last_clean":"2023-10-14T17:00:39.800699+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T17:00:39.800699+0000","last_undegraded":"2023-10-14T17:00:39.800699+0000","last_fullsized":"2023-10-14T17:00:39.800699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3229","last_scrub_stamp":"2023-10-14T17:00:39.800562+0000","last_deep_scrub":"23'3229","last_deep_scrub_stamp":"2023-10-14T17:00:39.800562+0000","last_clean_scrub_stamp":"2023-10-14T17:00:39.800562+0000","objects_scrubbed":2,"log_size":3229,"log_dups_size":0,"ondisk_log_size":3229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:36.839625+0000","scrub_duration":0.027341382000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3218,"num_write_kb":10301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'569","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.709675+0000","last_change":"2023-10-14T17:00:14.709621+0000","last_active":"2023-10-14T17:00:14.709675+0000","last_peered":"2023-10-14T17:00:14.709675+0000","last_clean":"2023-10-14T17:00:14.709675+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T17:00:14.709675+0000","last_undegraded":"2023-10-14T17:00:14.709675+0000","last_fullsized":"2023-10-14T17:00:14.709675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'569","last_scrub_stamp":"2023-10-14T17:00:14.709530+0000","last_deep_scrub":"23'569","last_deep_scrub_stamp":"2023-10-14T17:00:14.709530+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.709530+0000","objects_scrubbed":2,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:35:59.031407+0000","scrub_duration":0.0039121779999999997,"objects_trimmed":0,"snaptrim_duration":0.057531643,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"21'650","reported_seq":668,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971954+0000","last_change":"2023-10-14T16:54:54.099084+0000","last_active":"2023-10-14T16:59:47.971954+0000","last_peered":"2023-10-14T16:59:47.971954+0000","last_clean":"2023-10-14T16:59:47.971954+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T16:59:47.971954+0000","last_undegraded":"2023-10-14T16:59:47.971954+0000","last_fullsized":"2023-10-14T16:59:47.971954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'610","reported_seq":708,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:15.396589+0000","last_change":"2023-10-14T17:00:15.396562+0000","last_active":"2023-10-14T17:00:15.396589+0000","last_peered":"2023-10-14T17:00:15.396589+0000","last_clean":"2023-10-14T17:00:15.396589+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T17:00:15.396589+0000","last_undegraded":"2023-10-14T17:00:15.396589+0000","last_fullsized":"2023-10-14T17:00:15.396589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'610","last_scrub_stamp":"2023-10-14T17:00:15.396476+0000","last_deep_scrub":"23'610","last_deep_scrub_stamp":"2023-10-14T17:00:15.396476+0000","last_clean_scrub_stamp":"2023-10-14T17:00:15.396476+0000","objects_scrubbed":10,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:15.745229+0000","scrub_duration":0.0089952309999999994,"objects_trimmed":0,"snaptrim_duration":0.038477224999999997,"stat_sum":{"num_bytes":16395,"num_objects":10,"num_object_clones":4,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":32,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"23'758","reported_seq":786,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:35.288431+0000","last_change":"2023-10-14T17:00:35.288382+0000","last_active":"2023-10-14T17:00:35.288431+0000","last_peered":"2023-10-14T17:00:35.288431+0000","last_clean":"2023-10-14T17:00:35.288431+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T17:00:35.288431+0000","last_undegraded":"2023-10-14T17:00:35.288431+0000","last_fullsized":"2023-10-14T17:00:35.288431+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'758","last_scrub_stamp":"2023-10-14T17:00:35.288276+0000","last_deep_scrub":"23'758","last_deep_scrub_stamp":"2023-10-14T17:00:35.288276+0000","last_clean_scrub_stamp":"2023-10-14T17:00:35.288276+0000","objects_scrubbed":1,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:38.977356+0000","scrub_duration":0.013787259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'595","reported_seq":660,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930520+0000","last_change":"2023-10-14T16:59:40.048170+0000","last_active":"2023-10-14T16:59:54.930520+0000","last_peered":"2023-10-14T16:59:54.930520+0000","last_clean":"2023-10-14T16:59:54.930520+0000","last_became_active":"2023-10-14T16:55:45.058862+0000","last_became_peered":"2023-10-14T16:55:45.058862+0000","last_unstale":"2023-10-14T16:59:54.930520+0000","last_undegraded":"2023-10-14T16:59:54.930520+0000","last_fullsized":"2023-10-14T16:59:54.930520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071388894999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'773","reported_seq":801,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:25.221455+0000","last_change":"2023-10-14T17:00:25.221425+0000","last_active":"2023-10-14T17:00:25.221455+0000","last_peered":"2023-10-14T17:00:25.221455+0000","last_clean":"2023-10-14T17:00:25.221455+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T17:00:25.221455+0000","last_undegraded":"2023-10-14T17:00:25.221455+0000","last_fullsized":"2023-10-14T17:00:25.221455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'773","last_scrub_stamp":"2023-10-14T17:00:25.221335+0000","last_deep_scrub":"23'773","last_deep_scrub_stamp":"2023-10-14T17:00:25.221335+0000","last_clean_scrub_stamp":"2023-10-14T17:00:25.221335+0000","objects_scrubbed":2,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:38.876887+0000","scrub_duration":0.013685787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:36.456601+0000","last_change":"2023-10-14T17:00:36.456573+0000","last_active":"2023-10-14T17:00:36.456601+0000","last_peered":"2023-10-14T17:00:36.456601+0000","last_clean":"2023-10-14T17:00:36.456601+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T17:00:36.456601+0000","last_undegraded":"2023-10-14T17:00:36.456601+0000","last_fullsized":"2023-10-14T17:00:36.456601+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:36.456470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:36.456470+0000","last_clean_scrub_stamp":"2023-10-14T17:00:36.456470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:40.145551+0000","scrub_duration":0.0018203920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"23'518","reported_seq":585,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.919082+0000","last_change":"2023-10-14T16:59:40.037294+0000","last_active":"2023-10-14T16:59:54.919082+0000","last_peered":"2023-10-14T16:59:54.919082+0000","last_clean":"2023-10-14T16:59:54.919082+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T16:59:54.919082+0000","last_undegraded":"2023-10-14T16:59:54.919082+0000","last_fullsized":"2023-10-14T16:59:54.919082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061999158999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:24.168089+0000","last_change":"2023-10-14T17:00:24.168059+0000","last_active":"2023-10-14T17:00:24.168089+0000","last_peered":"2023-10-14T17:00:24.168089+0000","last_clean":"2023-10-14T17:00:24.168089+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T17:00:24.168089+0000","last_undegraded":"2023-10-14T17:00:24.168089+0000","last_fullsized":"2023-10-14T17:00:24.168089+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:24.167949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:24.167949+0000","last_clean_scrub_stamp":"2023-10-14T17:00:24.167949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:08.489825+0000","scrub_duration":0.0018258009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"23'50","reported_seq":78,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:32.698034+0000","last_change":"2023-10-14T17:00:32.697997+0000","last_active":"2023-10-14T17:00:32.698034+0000","last_peered":"2023-10-14T17:00:32.698034+0000","last_clean":"2023-10-14T17:00:32.698034+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T17:00:32.698034+0000","last_undegraded":"2023-10-14T17:00:32.698034+0000","last_fullsized":"2023-10-14T17:00:32.698034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'50","last_scrub_stamp":"2023-10-14T17:00:32.697897+0000","last_deep_scrub":"23'50","last_deep_scrub_stamp":"2023-10-14T17:00:32.697897+0000","last_clean_scrub_stamp":"2023-10-14T17:00:32.697897+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:11.987516+0000","scrub_duration":0.0026746600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'517","reported_seq":594,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.446285+0000","last_change":"2023-10-14T17:00:21.446258+0000","last_active":"2023-10-14T17:00:21.446285+0000","last_peered":"2023-10-14T17:00:21.446285+0000","last_clean":"2023-10-14T17:00:21.446285+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T17:00:21.446285+0000","last_undegraded":"2023-10-14T17:00:21.446285+0000","last_fullsized":"2023-10-14T17:00:21.446285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'517","last_scrub_stamp":"2023-10-14T17:00:21.446154+0000","last_deep_scrub":"23'517","last_deep_scrub_stamp":"2023-10-14T17:00:21.446154+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.446154+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:45.918009+0000","scrub_duration":0.0014583549999999999,"objects_trimmed":0,"snaptrim_duration":0.038513458,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:20.098656+0000","last_change":"2023-10-14T17:00:20.098627+0000","last_active":"2023-10-14T17:00:20.098656+0000","last_peered":"2023-10-14T17:00:20.098656+0000","last_clean":"2023-10-14T17:00:20.098656+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T17:00:20.098656+0000","last_undegraded":"2023-10-14T17:00:20.098656+0000","last_fullsized":"2023-10-14T17:00:20.098656+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:20.098523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:20.098523+0000","last_clean_scrub_stamp":"2023-10-14T17:00:20.098523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:44.570379+0000","scrub_duration":0.0018044700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'117","reported_seq":171,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.973965+0000","last_change":"2023-10-14T16:54:49.063307+0000","last_active":"2023-10-14T16:59:47.973965+0000","last_peered":"2023-10-14T16:59:47.973965+0000","last_clean":"2023-10-14T16:59:47.973965+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T16:59:47.973965+0000","last_undegraded":"2023-10-14T16:59:47.973965+0000","last_fullsized":"2023-10-14T16:59:47.973965+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'76","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.483798+0000","last_change":"2023-10-14T16:54:54.098588+0000","last_active":"2023-10-14T16:59:55.483798+0000","last_peered":"2023-10-14T16:59:55.483798+0000","last_clean":"2023-10-14T16:59:55.483798+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T16:59:55.483798+0000","last_undegraded":"2023-10-14T16:59:55.483798+0000","last_fullsized":"2023-10-14T16:59:55.483798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":646501,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":64,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'755","reported_seq":833,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:24.676945+0000","last_change":"2023-10-14T17:00:24.676899+0000","last_active":"2023-10-14T17:00:24.676945+0000","last_peered":"2023-10-14T17:00:24.676945+0000","last_clean":"2023-10-14T17:00:24.676945+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T17:00:24.676945+0000","last_undegraded":"2023-10-14T17:00:24.676945+0000","last_fullsized":"2023-10-14T17:00:24.676945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'755","last_scrub_stamp":"2023-10-14T17:00:24.676790+0000","last_deep_scrub":"23'755","last_deep_scrub_stamp":"2023-10-14T17:00:24.676790+0000","last_clean_scrub_stamp":"2023-10-14T17:00:24.676790+0000","objects_scrubbed":1,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:13.281090+0000","scrub_duration":0.0031994969999999999,"objects_trimmed":0,"snaptrim_duration":0.069884818000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:34.403364+0000","last_change":"2023-10-14T17:00:34.403336+0000","last_active":"2023-10-14T17:00:34.403364+0000","last_peered":"2023-10-14T17:00:34.403364+0000","last_clean":"2023-10-14T17:00:34.403364+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T17:00:34.403364+0000","last_undegraded":"2023-10-14T17:00:34.403364+0000","last_fullsized":"2023-10-14T17:00:34.403364+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:34.403232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:34.403232+0000","last_clean_scrub_stamp":"2023-10-14T17:00:34.403232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:05.118380+0000","scrub_duration":0.0023433809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'2238","reported_seq":2266,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:28.231608+0000","last_change":"2023-10-14T17:00:28.231580+0000","last_active":"2023-10-14T17:00:28.231608+0000","last_peered":"2023-10-14T17:00:28.231608+0000","last_clean":"2023-10-14T17:00:28.231608+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T17:00:28.231608+0000","last_undegraded":"2023-10-14T17:00:28.231608+0000","last_fullsized":"2023-10-14T17:00:28.231608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2238","last_scrub_stamp":"2023-10-14T17:00:28.231497+0000","last_deep_scrub":"23'2238","last_deep_scrub_stamp":"2023-10-14T17:00:28.231497+0000","last_clean_scrub_stamp":"2023-10-14T17:00:28.231497+0000","objects_scrubbed":3,"log_size":2238,"log_dups_size":0,"ondisk_log_size":2238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:16.835797+0000","scrub_duration":0.028927609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2227,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'634","reported_seq":701,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938499+0000","last_change":"2023-10-14T16:59:40.021827+0000","last_active":"2023-10-14T16:59:54.938499+0000","last_peered":"2023-10-14T16:59:54.938499+0000","last_clean":"2023-10-14T16:59:54.938499+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T16:59:54.938499+0000","last_undegraded":"2023-10-14T16:59:54.938499+0000","last_fullsized":"2023-10-14T16:59:54.938499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047771027000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.973875+0000","last_change":"2023-10-14T16:54:49.689595+0000","last_active":"2023-10-14T16:59:47.973875+0000","last_peered":"2023-10-14T16:59:47.973875+0000","last_clean":"2023-10-14T16:59:47.973875+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T16:59:47.973875+0000","last_undegraded":"2023-10-14T16:59:47.973875+0000","last_fullsized":"2023-10-14T16:59:47.973875+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'1505","reported_seq":1533,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:33.281438+0000","last_change":"2023-10-14T17:00:33.281411+0000","last_active":"2023-10-14T17:00:33.281438+0000","last_peered":"2023-10-14T17:00:33.281438+0000","last_clean":"2023-10-14T17:00:33.281438+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T17:00:33.281438+0000","last_undegraded":"2023-10-14T17:00:33.281438+0000","last_fullsized":"2023-10-14T17:00:33.281438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1505","last_scrub_stamp":"2023-10-14T17:00:33.281327+0000","last_deep_scrub":"23'1505","last_deep_scrub_stamp":"2023-10-14T17:00:33.281327+0000","last_clean_scrub_stamp":"2023-10-14T17:00:33.281327+0000","objects_scrubbed":2,"log_size":1505,"log_dups_size":0,"ondisk_log_size":1505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:03.996475+0000","scrub_duration":0.022221726000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"23'761","reported_seq":837,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:08.665128+0000","last_change":"2023-10-14T17:00:08.665100+0000","last_active":"2023-10-14T17:00:08.665128+0000","last_peered":"2023-10-14T17:00:08.665128+0000","last_clean":"2023-10-14T17:00:08.665128+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T17:00:08.665128+0000","last_undegraded":"2023-10-14T17:00:08.665128+0000","last_fullsized":"2023-10-14T17:00:08.665128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'761","last_scrub_stamp":"2023-10-14T17:00:08.665003+0000","last_deep_scrub":"23'761","last_deep_scrub_stamp":"2023-10-14T17:00:08.665003+0000","last_clean_scrub_stamp":"2023-10-14T17:00:08.665003+0000","objects_scrubbed":2,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:48.894648+0000","scrub_duration":0.0039251659999999999,"objects_trimmed":0,"snaptrim_duration":0.057422879000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.971865+0000","last_change":"2023-10-14T16:54:49.689614+0000","last_active":"2023-10-14T16:59:47.971865+0000","last_peered":"2023-10-14T16:59:47.971865+0000","last_clean":"2023-10-14T16:59:47.971865+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T16:59:47.971865+0000","last_undegraded":"2023-10-14T16:59:47.971865+0000","last_fullsized":"2023-10-14T16:59:47.971865+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'742","reported_seq":770,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:37.452608+0000","last_change":"2023-10-14T17:00:37.452579+0000","last_active":"2023-10-14T17:00:37.452608+0000","last_peered":"2023-10-14T17:00:37.452608+0000","last_clean":"2023-10-14T17:00:37.452608+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T17:00:37.452608+0000","last_undegraded":"2023-10-14T17:00:37.452608+0000","last_fullsized":"2023-10-14T17:00:37.452608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'742","last_scrub_stamp":"2023-10-14T17:00:37.452486+0000","last_deep_scrub":"23'742","last_deep_scrub_stamp":"2023-10-14T17:00:37.452486+0000","last_clean_scrub_stamp":"2023-10-14T17:00:37.452486+0000","objects_scrubbed":1,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:16.742105+0000","scrub_duration":0.012675855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'580","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939040+0000","last_change":"2023-10-14T16:59:40.021216+0000","last_active":"2023-10-14T16:59:54.939040+0000","last_peered":"2023-10-14T16:59:54.939040+0000","last_clean":"2023-10-14T16:59:54.939040+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T16:59:54.939040+0000","last_undegraded":"2023-10-14T16:59:54.939040+0000","last_fullsized":"2023-10-14T16:59:54.939040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047665379000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.972387+0000","last_change":"2023-10-14T16:54:49.689836+0000","last_active":"2023-10-14T16:59:47.972387+0000","last_peered":"2023-10-14T16:59:47.972387+0000","last_clean":"2023-10-14T16:59:47.972387+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T16:59:47.972387+0000","last_undegraded":"2023-10-14T16:59:47.972387+0000","last_fullsized":"2023-10-14T16:59:47.972387+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'738","reported_seq":766,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:29.244189+0000","last_change":"2023-10-14T17:00:29.244159+0000","last_active":"2023-10-14T17:00:29.244189+0000","last_peered":"2023-10-14T17:00:29.244189+0000","last_clean":"2023-10-14T17:00:29.244189+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T17:00:29.244189+0000","last_undegraded":"2023-10-14T17:00:29.244189+0000","last_fullsized":"2023-10-14T17:00:29.244189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'738","last_scrub_stamp":"2023-10-14T17:00:29.244076+0000","last_deep_scrub":"23'738","last_deep_scrub_stamp":"2023-10-14T17:00:29.244076+0000","last_clean_scrub_stamp":"2023-10-14T17:00:29.244076+0000","objects_scrubbed":1,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:54.487165+0000","scrub_duration":0.012834883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'698","reported_seq":775,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:29.644827+0000","last_change":"2023-10-14T17:00:29.644796+0000","last_active":"2023-10-14T17:00:29.644827+0000","last_peered":"2023-10-14T17:00:29.644827+0000","last_clean":"2023-10-14T17:00:29.644827+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T17:00:29.644827+0000","last_undegraded":"2023-10-14T17:00:29.644827+0000","last_fullsized":"2023-10-14T17:00:29.644827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'698","last_scrub_stamp":"2023-10-14T17:00:29.644709+0000","last_deep_scrub":"23'698","last_deep_scrub_stamp":"2023-10-14T17:00:29.644709+0000","last_clean_scrub_stamp":"2023-10-14T17:00:29.644709+0000","objects_scrubbed":1,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:00.359857+0000","scrub_duration":0.0037276449999999999,"objects_trimmed":0,"snaptrim_duration":0.068678344000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.972556+0000","last_change":"2023-10-14T16:54:49.064767+0000","last_active":"2023-10-14T16:59:47.972556+0000","last_peered":"2023-10-14T16:59:47.972556+0000","last_clean":"2023-10-14T16:59:47.972556+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T16:59:47.972556+0000","last_undegraded":"2023-10-14T16:59:47.972556+0000","last_fullsized":"2023-10-14T16:59:47.972556+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:48.055617+0000","last_clean_scrub_stamp":"2023-10-14T16:54:48.055617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"21'1040","reported_seq":1058,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.972956+0000","last_change":"2023-10-14T16:54:54.106280+0000","last_active":"2023-10-14T16:59:47.972956+0000","last_peered":"2023-10-14T16:59:47.972956+0000","last_clean":"2023-10-14T16:59:47.972956+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T16:59:47.972956+0000","last_undegraded":"2023-10-14T16:59:47.972956+0000","last_fullsized":"2023-10-14T16:59:47.972956+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":1040,"log_dups_size":0,"ondisk_log_size":1040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":8695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"23'755","reported_seq":832,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:39.294771+0000","last_change":"2023-10-14T17:00:39.294739+0000","last_active":"2023-10-14T17:00:39.294771+0000","last_peered":"2023-10-14T17:00:39.294771+0000","last_clean":"2023-10-14T17:00:39.294771+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T17:00:39.294771+0000","last_undegraded":"2023-10-14T17:00:39.294771+0000","last_fullsized":"2023-10-14T17:00:39.294771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'755","last_scrub_stamp":"2023-10-14T17:00:39.294633+0000","last_deep_scrub":"23'755","last_deep_scrub_stamp":"2023-10-14T17:00:39.294633+0000","last_clean_scrub_stamp":"2023-10-14T17:00:39.294633+0000","objects_scrubbed":1,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:20.360047+0000","scrub_duration":0.0038686810000000001,"objects_trimmed":0,"snaptrim_duration":0.015859669999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'740","reported_seq":758,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:47.969937+0000","last_change":"2023-10-14T16:54:54.102987+0000","last_active":"2023-10-14T16:59:47.969937+0000","last_peered":"2023-10-14T16:59:47.969937+0000","last_clean":"2023-10-14T16:59:47.969937+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T16:59:47.969937+0000","last_undegraded":"2023-10-14T16:59:47.969937+0000","last_fullsized":"2023-10-14T16:59:47.969937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'628","reported_seq":705,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:37.264296+0000","last_change":"2023-10-14T17:00:37.264268+0000","last_active":"2023-10-14T17:00:37.264296+0000","last_peered":"2023-10-14T17:00:37.264296+0000","last_clean":"2023-10-14T17:00:37.264296+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T17:00:37.264296+0000","last_undegraded":"2023-10-14T17:00:37.264296+0000","last_fullsized":"2023-10-14T17:00:37.264296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'628","last_scrub_stamp":"2023-10-14T17:00:37.264178+0000","last_deep_scrub":"23'628","last_deep_scrub_stamp":"2023-10-14T17:00:37.264178+0000","last_clean_scrub_stamp":"2023-10-14T17:00:37.264178+0000","objects_scrubbed":1,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:56.886434+0000","scrub_duration":0.0030037409999999999,"objects_trimmed":0,"snaptrim_duration":0.048042644000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'756","reported_seq":784,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:41.497508+0000","last_change":"2023-10-14T17:00:41.497480+0000","last_active":"2023-10-14T17:00:41.497508+0000","last_peered":"2023-10-14T17:00:41.497508+0000","last_clean":"2023-10-14T17:00:41.497508+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T17:00:41.497508+0000","last_undegraded":"2023-10-14T17:00:41.497508+0000","last_fullsized":"2023-10-14T17:00:41.497508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'756","last_scrub_stamp":"2023-10-14T17:00:41.497391+0000","last_deep_scrub":"23'756","last_deep_scrub_stamp":"2023-10-14T17:00:41.497391+0000","last_clean_scrub_stamp":"2023-10-14T17:00:41.497391+0000","objects_scrubbed":2,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:22.562805+0000","scrub_duration":0.014326548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"23'834","reported_seq":901,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938807+0000","last_change":"2023-10-14T16:59:40.012979+0000","last_active":"2023-10-14T16:59:54.938807+0000","last_peered":"2023-10-14T16:59:54.938807+0000","last_clean":"2023-10-14T16:59:54.938807+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T16:59:54.938807+0000","last_undegraded":"2023-10-14T16:59:54.938807+0000","last_fullsized":"2023-10-14T16:59:54.938807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038542571999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2260","reported_seq":2288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:19.853834+0000","last_change":"2023-10-14T17:00:19.853808+0000","last_active":"2023-10-14T17:00:19.853834+0000","last_peered":"2023-10-14T17:00:19.853834+0000","last_clean":"2023-10-14T17:00:19.853834+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T17:00:19.853834+0000","last_undegraded":"2023-10-14T17:00:19.853834+0000","last_fullsized":"2023-10-14T17:00:19.853834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2260","last_scrub_stamp":"2023-10-14T17:00:19.853728+0000","last_deep_scrub":"23'2260","last_deep_scrub_stamp":"2023-10-14T17:00:19.853728+0000","last_clean_scrub_stamp":"2023-10-14T17:00:19.853728+0000","objects_scrubbed":4,"log_size":2260,"log_dups_size":0,"ondisk_log_size":2260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:08.458027+0000","scrub_duration":0.035936590999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2245,"num_write_kb":13441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"23'673","reported_seq":750,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:29.414546+0000","last_change":"2023-10-14T17:00:29.414519+0000","last_active":"2023-10-14T17:00:29.414546+0000","last_peered":"2023-10-14T17:00:29.414546+0000","last_clean":"2023-10-14T17:00:29.414546+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T17:00:29.414546+0000","last_undegraded":"2023-10-14T17:00:29.414546+0000","last_fullsized":"2023-10-14T17:00:29.414546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'673","last_scrub_stamp":"2023-10-14T17:00:29.414416+0000","last_deep_scrub":"23'673","last_deep_scrub_stamp":"2023-10-14T17:00:29.414416+0000","last_clean_scrub_stamp":"2023-10-14T17:00:29.414416+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:18.018716+0000","scrub_duration":0.0018134749999999999,"objects_trimmed":0,"snaptrim_duration":0.038619158000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3073","reported_seq":3091,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:04.219591+0000","last_change":"2023-10-14T16:54:54.095418+0000","last_active":"2023-10-14T17:00:04.219591+0000","last_peered":"2023-10-14T17:00:04.219591+0000","last_clean":"2023-10-14T17:00:04.219591+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T17:00:04.219591+0000","last_undegraded":"2023-10-14T17:00:04.219591+0000","last_fullsized":"2023-10-14T17:00:04.219591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:53.067740+0000","last_clean_scrub_stamp":"2023-10-14T16:54:53.067740+0000","objects_scrubbed":0,"log_size":3073,"log_dups_size":0,"ondisk_log_size":3073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5336939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3065,"num_write_kb":7243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"23'767","reported_seq":844,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:13.628534+0000","last_change":"2023-10-14T17:00:13.628505+0000","last_active":"2023-10-14T17:00:13.628534+0000","last_peered":"2023-10-14T17:00:13.628534+0000","last_clean":"2023-10-14T17:00:13.628534+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T17:00:13.628534+0000","last_undegraded":"2023-10-14T17:00:13.628534+0000","last_fullsized":"2023-10-14T17:00:13.628534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'767","last_scrub_stamp":"2023-10-14T17:00:13.628407+0000","last_deep_scrub":"23'767","last_deep_scrub_stamp":"2023-10-14T17:00:13.628407+0000","last_clean_scrub_stamp":"2023-10-14T17:00:13.628407+0000","objects_scrubbed":1,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:21.508614+0000","scrub_duration":0.0032656299999999998,"objects_trimmed":0,"snaptrim_duration":0.068737623999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'788","reported_seq":816,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:38.718974+0000","last_change":"2023-10-14T17:00:38.718944+0000","last_active":"2023-10-14T17:00:38.718974+0000","last_peered":"2023-10-14T17:00:38.718974+0000","last_clean":"2023-10-14T17:00:38.718974+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T17:00:38.718974+0000","last_undegraded":"2023-10-14T17:00:38.718974+0000","last_fullsized":"2023-10-14T17:00:38.718974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'788","last_scrub_stamp":"2023-10-14T17:00:38.718839+0000","last_deep_scrub":"23'788","last_deep_scrub_stamp":"2023-10-14T17:00:38.718839+0000","last_clean_scrub_stamp":"2023-10-14T17:00:38.718839+0000","objects_scrubbed":4,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:14.958342+0000","scrub_duration":0.020417911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389162,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'697","reported_seq":772,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:25.463530+0000","last_change":"2023-10-14T17:00:25.463505+0000","last_active":"2023-10-14T17:00:25.463530+0000","last_peered":"2023-10-14T17:00:25.463530+0000","last_clean":"2023-10-14T17:00:25.463530+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T17:00:25.463530+0000","last_undegraded":"2023-10-14T17:00:25.463530+0000","last_fullsized":"2023-10-14T17:00:25.463530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'697","last_scrub_stamp":"2023-10-14T17:00:25.463404+0000","last_deep_scrub":"23'697","last_deep_scrub_stamp":"2023-10-14T17:00:25.463404+0000","last_clean_scrub_stamp":"2023-10-14T17:00:25.463404+0000","objects_scrubbed":4,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:09.785280+0000","scrub_duration":0.0057845700000000002,"objects_trimmed":0,"snaptrim_duration":0.026701018,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"23'669","reported_seq":735,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.489231+0000","last_change":"2023-10-14T16:59:39.991721+0000","last_active":"2023-10-14T16:59:55.489231+0000","last_peered":"2023-10-14T16:59:55.489231+0000","last_clean":"2023-10-14T16:59:55.489231+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T16:59:55.489231+0000","last_undegraded":"2023-10-14T16:59:55.489231+0000","last_fullsized":"2023-10-14T16:59:55.489231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01972498,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"23'709","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:07.161938+0000","last_change":"2023-10-14T17:00:07.161914+0000","last_active":"2023-10-14T17:00:07.161938+0000","last_peered":"2023-10-14T17:00:07.161938+0000","last_clean":"2023-10-14T17:00:07.161938+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T17:00:07.161938+0000","last_undegraded":"2023-10-14T17:00:07.161938+0000","last_fullsized":"2023-10-14T17:00:07.161938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'709","last_scrub_stamp":"2023-10-14T17:00:07.161847+0000","last_deep_scrub":"23'709","last_deep_scrub_stamp":"2023-10-14T17:00:07.161847+0000","last_clean_scrub_stamp":"2023-10-14T17:00:07.161847+0000","objects_scrubbed":3,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:33:35.683711+0000","scrub_duration":0.003594294,"objects_trimmed":0,"snaptrim_duration":0.012044934,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"23'777","reported_seq":853,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:31.885442+0000","last_change":"2023-10-14T17:00:31.885415+0000","last_active":"2023-10-14T17:00:31.885442+0000","last_peered":"2023-10-14T17:00:31.885442+0000","last_clean":"2023-10-14T17:00:31.885442+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T17:00:31.885442+0000","last_undegraded":"2023-10-14T17:00:31.885442+0000","last_fullsized":"2023-10-14T17:00:31.885442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'777","last_scrub_stamp":"2023-10-14T17:00:31.885334+0000","last_deep_scrub":"23'777","last_deep_scrub_stamp":"2023-10-14T17:00:31.885334+0000","last_clean_scrub_stamp":"2023-10-14T17:00:31.885334+0000","objects_scrubbed":2,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:12.950748+0000","scrub_duration":0.0045303030000000003,"objects_trimmed":0,"snaptrim_duration":0.058085603999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"23'606","reported_seq":682,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.715441+0000","last_change":"2023-10-14T17:00:21.715409+0000","last_active":"2023-10-14T17:00:21.715441+0000","last_peered":"2023-10-14T17:00:21.715441+0000","last_clean":"2023-10-14T17:00:21.715441+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T17:00:21.715441+0000","last_undegraded":"2023-10-14T17:00:21.715441+0000","last_fullsized":"2023-10-14T17:00:21.715441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'606","last_scrub_stamp":"2023-10-14T17:00:21.715312+0000","last_deep_scrub":"23'606","last_deep_scrub_stamp":"2023-10-14T17:00:21.715312+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.715312+0000","objects_scrubbed":6,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:35.370865+0000","scrub_duration":0.0068255670000000003,"objects_trimmed":0,"snaptrim_duration":0.070423702000000005,"stat_sum":{"num_bytes":8224,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"23'396","reported_seq":472,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.082031+0000","last_change":"2023-10-14T17:00:14.081988+0000","last_active":"2023-10-14T17:00:14.082031+0000","last_peered":"2023-10-14T17:00:14.082031+0000","last_clean":"2023-10-14T17:00:14.082031+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T17:00:14.082031+0000","last_undegraded":"2023-10-14T17:00:14.082031+0000","last_fullsized":"2023-10-14T17:00:14.082031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'396","last_scrub_stamp":"2023-10-14T17:00:14.081897+0000","last_deep_scrub":"23'396","last_deep_scrub_stamp":"2023-10-14T17:00:14.081897+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.081897+0000","objects_scrubbed":2,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:21:14.426123+0000","scrub_duration":0.0038898180000000002,"objects_trimmed":0,"snaptrim_duration":0.048708460000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":30,"num_read_kb":20,"num_write":108,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41418,"ondisk_log_size":41418,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":190534230,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":33641,"num_write_kb":203675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381124608,"data_stored":381068460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33886,"ondisk_log_size":33886,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705739,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396524,"kb_used_data":86948,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93975316,"statfs":{"total":96636764160,"available":96230723584,"internally_reserved":0,"allocated":89034752,"data_stored":88829719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.41399999999999998},"min":{"1min":0.218,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61099999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.433},{"interface":"front","average":{"1min":0.379,"5min":0.38600000000000001,"15min":0.42199999999999999},"min":{"1min":0.221,"5min":0.217,"15min":0.217},"max":{"1min":0.57099999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.496}]},{"osd":1,"last update":"Sat Oct 14 16:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.44700000000000001,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.44700000000000001,"15min":0.47099999999999997},"min":{"1min":0.25,"5min":0.217,"15min":0.217},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.48299999999999998}]},{"osd":2,"last update":"Sat Oct 14 16:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.29599999999999999,"15min":0.33800000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.45200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.28699999999999998,"5min":0.30499999999999999,"15min":0.34399999999999997},"min":{"1min":0.20000000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.47599999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.33200000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705739,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426368,"kb_used_data":116792,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93945472,"statfs":{"total":96636764160,"available":96200163328,"internally_reserved":0,"allocated":119595008,"data_stored":119367674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46500000000000002,"15min":0.45000000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.79900000000000004,"5min":5.992,"15min":5.992},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.504,"15min":0.46200000000000002},"min":{"1min":0.24199999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.73999999999999999,"5min":9.2620000000000005,"15min":9.2620000000000005},"last":0.53200000000000003}]},{"osd":1,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66700000000000004,"5min":6.266,"15min":6.266},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.54700000000000004,"15min":0.49399999999999999},"min":{"1min":0.252,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.492,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":0.502}]},{"osd":3,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.313,"15min":0.318},"min":{"1min":0.184,"5min":0.16,"15min":0.16},"max":{"1min":0.69199999999999995,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.193,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.627,"5min":6.3170000000000002,"15min":6.3170000000000002},"last":0.309}]}]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397668,"kb_used_data":92188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":93974172,"statfs":{"total":96636764160,"available":96229552128,"internally_reserved":0,"allocated":94400512,"data_stored":94213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.27200000000000002,"15min":0.29599999999999999},"min":{"1min":0.20799999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.28699999999999998,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.50800000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.26000000000000001}]},{"osd":2,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.45700000000000002},"min":{"1min":0.24099999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56299999999999994,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.433},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.46500000000000002},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61399999999999999,"5min":0.629,"15min":0.629},"last":0.377}]},{"osd":3,"last update":"Sat Oct 14 16:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.47599999999999998},"min":{"1min":0.29299999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.63300000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.39900000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705738,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388312,"kb_used_data":78736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93983528,"statfs":{"total":96636764160,"available":96239132672,"internally_reserved":0,"allocated":80625664,"data_stored":80427560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.27400000000000002},"min":{"1min":0.21099999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.376},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.28699999999999998,"15min":0.29899999999999999},"min":{"1min":0.24099999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42599999999999999,"15min":0.45700000000000002},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42199999999999999,"15min":0.46100000000000002},"min":{"1min":0.28399999999999997,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63900000000000001,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Oct 14 16:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.45300000000000001},"min":{"1min":0.29699999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.59699999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.48599999999999999},"min":{"1min":0.33500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94076928,"data_stored":94064538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":79691776,"data_stored":79691776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":119250944,"data_stored":119230438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88104960,"data_stored":88081708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":53391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":73798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T17:00:47.807 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.808 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.808 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.808 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.809 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.809 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.809 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.810 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.810 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.811 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.811 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.811 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.812 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.812 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.813 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.813 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.813 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.814 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.814 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.814 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.815 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.815 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.816 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.816 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.816 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.817 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.817 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.818 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.818 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.819 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.819 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.819 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.820 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.820 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.821 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.821 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.822 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.822 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.825 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.825 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.826 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.826 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-14T16:54:48.055617+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.827 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.827 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.827 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.828 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-14T16:54:53.067740+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.828 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:00:47.829 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T17:01:07.830 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T17:01:07.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.965+0000 7f31da31d700 1 Processor -- start 2023-10-14T17:01:07.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.965+0000 7f31da31d700 1 -- start start 2023-10-14T17:01:07.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.965+0000 7f31da31d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f31d40a9fa0 0x7f31d4133f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:07.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.965+0000 7f31da31d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f31d40a47b0 0x7f31d40a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:07.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.965+0000 7f31da31d700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d4133740 con 0x7f31d40a5170 2023-10-14T17:01:07.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.965+0000 7f31da31d700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d40a55d0 con 0x7f31d40a9fa0 2023-10-14T17:01:07.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.965+0000 7f31da31d700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d40a12a0 con 0x7f31d40a47b0 2023-10-14T17:01:07.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.965+0000 7f31d3fff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f31d40a9fa0 0x7f31d4133f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:07.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.965+0000 7f31d88ba700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f31d40a5170 0x7f31d413e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52984/0 (socket says 172.21.15.8:52984) 2023-10-14T17:01:07.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.965+0000 7f31d88ba700 1 -- 172.21.15.8:0/2681249475 learned_addr learned my addr 172.21.15.8:0/2681249475 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:01:07.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.966+0000 7f31d37fe700 1 --2- 172.21.15.8:0/2681249475 >> v2:172.21.15.155:3300/0 conn(0x7f31d40a47b0 0x7f31d40a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:07.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.966+0000 7f31d3fff700 1 -- 172.21.15.8:0/2681249475 >> v2:172.21.15.155:3300/0 conn(0x7f31d40a47b0 msgr2=0x7f31d40a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:07.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.966+0000 7f31d3fff700 1 --2- 172.21.15.8:0/2681249475 >> v2:172.21.15.155:3300/0 conn(0x7f31d40a47b0 0x7f31d40a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:07.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.966+0000 7f31d3fff700 1 -- 172.21.15.8:0/2681249475 >> v1:172.21.15.8:6789/0 conn(0x7f31d40a5170 legacy=0x7f31d413e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:07.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.966+0000 7f31d3fff700 1 -- 172.21.15.8:0/2681249475 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d40a1bc0 con 0x7f31d40a9fa0 2023-10-14T17:01:07.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.966+0000 7f31d37fe700 1 --2- 172.21.15.8:0/2681249475 >> v2:172.21.15.155:3300/0 conn(0x7f31d40a47b0 0x7f31d40a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T17:01:07.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.966+0000 7f31d3fff700 1 --2- 172.21.15.8:0/2681249475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31d40a9fa0 0x7f31d4133f60 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7f31d406af90 tx=0x7f31bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205a46f00c65f5dc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:07.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.966+0000 7f31d2ffd700 1 -- 172.21.15.8:0/2681249475 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00b6b0 con 0x7f31d40a9fa0 2023-10-14T17:01:07.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.966+0000 7f31d2ffd700 1 -- 172.21.15.8:0/2681249475 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc00b810 con 0x7f31d40a9fa0 2023-10-14T17:01:07.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.966+0000 7f31d2ffd700 1 -- 172.21.15.8:0/2681249475 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00bbb0 con 0x7f31d40a9fa0 2023-10-14T17:01:07.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.966+0000 7f31da31d700 1 -- 172.21.15.8:0/2681249475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31d40a9fa0 msgr2=0x7f31d4133f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:07.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.966+0000 7f31da31d700 1 --2- 172.21.15.8:0/2681249475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31d40a9fa0 0x7f31d4133f60 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7f31d406af90 tx=0x7f31bc0091a0 comp rx=0 tx=0).stop 2023-10-14T17:01:07.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.967+0000 7f31da31d700 1 -- 172.21.15.8:0/2681249475 shutdown_connections 2023-10-14T17:01:07.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.967+0000 7f31da31d700 1 --2- 172.21.15.8:0/2681249475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31d40a9fa0 0x7f31d4133f60 unknown :-1 s=CLOSED pgs=2494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.967+0000 7f31da31d700 1 --2- 172.21.15.8:0/2681249475 >> v2:172.21.15.155:3300/0 conn(0x7f31d40a47b0 0x7f31d40a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.967+0000 7f31da31d700 1 -- 172.21.15.8:0/2681249475 >> 172.21.15.8:0/2681249475 conn(0x7f31d406a960 msgr2=0x7f31d40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.967+0000 7f31da31d700 1 -- 172.21.15.8:0/2681249475 shutdown_connections 2023-10-14T17:01:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.967+0000 7f31da31d700 1 -- 172.21.15.8:0/2681249475 wait complete. 2023-10-14T17:01:07.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.967+0000 7f31da31d700 1 Processor -- start 2023-10-14T17:01:07.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.968+0000 7f31da31d700 1 -- start start 2023-10-14T17:01:07.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.968+0000 7f31da31d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31d40a47b0 0x7f31d4147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:07.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.968+0000 7f31da31d700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31d40a5170 0x7f31d41476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:07.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.968+0000 7f31da31d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31d4098870 0x7f31d4098cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:07.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.968+0000 7f31da31d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40a60d0 con 0x7f31d4098870 2023-10-14T17:01:07.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.968+0000 7f31da31d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d409c970 con 0x7f31d40a47b0 2023-10-14T17:01:07.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.968+0000 7f31da31d700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d409c250 con 0x7f31d40a5170 2023-10-14T17:01:07.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.968+0000 7f31d88ba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31d4098870 0x7f31d4098cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:07.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.968+0000 7f31d88ba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31d4098870 0x7f31d4098cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43950/0 (socket says 172.21.15.8:43950) 2023-10-14T17:01:07.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.968+0000 7f31d88ba700 1 -- 172.21.15.8:0/2525060077 learned_addr learned my addr 172.21.15.8:0/2525060077 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.968+0000 7f31d37fe700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31d40a5170 0x7f31d41476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.968+0000 7f31d3fff700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31d40a47b0 0x7f31d4147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.969+0000 7f31d88ba700 1 -- 172.21.15.8:0/2525060077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31d40a5170 msgr2=0x7f31d41476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:07.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.969+0000 7f31d88ba700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31d40a5170 0x7f31d41476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:07.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.969+0000 7f31d88ba700 1 -- 172.21.15.8:0/2525060077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31d40a47b0 msgr2=0x7f31d4147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:07.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.969+0000 7f31d88ba700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31d40a47b0 0x7f31d4147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:07.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.969+0000 7f31d88ba700 1 -- 172.21.15.8:0/2525060077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc009420 con 0x7f31d4098870 2023-10-14T17:01:07.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.969+0000 7f31d88ba700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31d4098870 0x7f31d4098cf0 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00cc40 tx=0x7f31cc001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:07.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.969+0000 7f31cbfff700 1 -- 172.21.15.8:0/2525060077 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00a8b0 con 0x7f31d4098870 2023-10-14T17:01:07.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.969+0000 7f31cbfff700 1 -- 172.21.15.8:0/2525060077 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc00aa10 con 0x7f31d4098870 2023-10-14T17:01:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.969+0000 7f31da31d700 1 -- 172.21.15.8:0/2525060077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d409bc30 con 0x7f31d4098870 2023-10-14T17:01:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.969+0000 7f31cbfff700 1 -- 172.21.15.8:0/2525060077 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00add0 con 0x7f31d4098870 2023-10-14T17:01:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.969+0000 7f31da31d700 1 -- 172.21.15.8:0/2525060077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d409b240 con 0x7f31d4098870 2023-10-14T17:01:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.970+0000 7f31da31d700 1 -- 172.21.15.8:0/2525060077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d406ad60 con 0x7f31d4098870 2023-10-14T17:01:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.970+0000 7f31cbfff700 1 -- 172.21.15.8:0/2525060077 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31cc007300 con 0x7f31d4098870 2023-10-14T17:01:07.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.971+0000 7f31cbfff700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f31b4066f60 0x7f31b4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:07.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.971+0000 7f31d3fff700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f31b4066f60 0x7f31b4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:07.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.971+0000 7f31cbfff700 1 -- 172.21.15.8:0/2525060077 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f31cc0842b0 con 0x7f31d4098870 2023-10-14T17:01:07.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.971+0000 7f31d3fff700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f31b4066f60 0x7f31b4069410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0093f0 tx=0x7f31bc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:07.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:07.975+0000 7f31cbfff700 1 -- 172.21.15.8:0/2525060077 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31cc051ac0 con 0x7f31d4098870 2023-10-14T17:01:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.162+0000 7f31da31d700 1 -- 172.21.15.8:0/2525060077 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31d409cb90 con 0x7f31b4066f60 2023-10-14T17:01:08.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.169+0000 7f31cbfff700 1 -- 172.21.15.8:0/2525060077 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280801 (secure 0 0 0) 0x7f31d409cb90 con 0x7f31b4066f60 2023-10-14T17:01:08.173 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:01:08.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.172+0000 7f31da31d700 1 -- 172.21.15.8:0/2525060077 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f31b4066f60 msgr2=0x7f31b4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:08.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.172+0000 7f31da31d700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f31b4066f60 0x7f31b4069410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0093f0 tx=0x7f31bc017000 comp rx=0 tx=0).stop 2023-10-14T17:01:08.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.172+0000 7f31da31d700 1 -- 172.21.15.8:0/2525060077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31d4098870 msgr2=0x7f31d4098cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:08.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.172+0000 7f31da31d700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31d4098870 0x7f31d4098cf0 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00cc40 tx=0x7f31cc001a50 comp rx=0 tx=0).stop 2023-10-14T17:01:08.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.172+0000 7f31da31d700 1 -- 172.21.15.8:0/2525060077 shutdown_connections 2023-10-14T17:01:08.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.172+0000 7f31da31d700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f31b4066f60 0x7f31b4069410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:08.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.172+0000 7f31da31d700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31d4098870 0x7f31d4098cf0 unknown :-1 s=CLOSED pgs=2495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:08.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.172+0000 7f31da31d700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31d40a47b0 0x7f31d4147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:08.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.172+0000 7f31da31d700 1 --2- 172.21.15.8:0/2525060077 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31d40a5170 0x7f31d41476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:08.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.172+0000 7f31da31d700 1 -- 172.21.15.8:0/2525060077 >> 172.21.15.8:0/2525060077 conn(0x7f31d406a960 msgr2=0x7f31d40a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:08.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.172+0000 7f31da31d700 1 -- 172.21.15.8:0/2525060077 shutdown_connections 2023-10-14T17:01:08.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:08.172+0000 7f31da31d700 1 -- 172.21.15.8:0/2525060077 wait complete. 2023-10-14T17:01:08.179 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T17:01:08.185 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2023-10-14T17:01:08.066990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":191251786,"num_objects":152,"num_object_clones":21,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":8,"num_read":210,"num_read_kb":798,"num_write":33908,"num_write_kb":206280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75465,"ondisk_log_size":75465,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1608872,"kb_used_data":374664,"kb_used_omap":0,"kb_used_meta":1234176,"kb_avail":375878488,"statfs":{"total":386547056640,"available":384899571712,"internally_reserved":0,"allocated":383655936,"data_stored":382838952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1263796224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003347"},"pg_stats":[{"pgid":"4.3f","version":"23'645","reported_seq":722,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:06.455532+0000","last_change":"2023-10-14T17:01:06.455487+0000","last_active":"2023-10-14T17:01:06.455532+0000","last_peered":"2023-10-14T17:01:06.455532+0000","last_clean":"2023-10-14T17:01:06.455532+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T17:01:06.455532+0000","last_undegraded":"2023-10-14T17:01:06.455532+0000","last_fullsized":"2023-10-14T17:01:06.455532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'645","last_scrub_stamp":"2023-10-14T17:01:06.455340+0000","last_deep_scrub":"23'645","last_deep_scrub_stamp":"2023-10-14T17:01:06.455340+0000","last_clean_scrub_stamp":"2023-10-14T17:01:06.455340+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:43.534168+0000","scrub_duration":0.001558242,"objects_trimmed":0,"snaptrim_duration":0.070427155000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"23'746","reported_seq":813,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938650+0000","last_change":"2023-10-14T16:59:40.012472+0000","last_active":"2023-10-14T16:59:54.938650+0000","last_peered":"2023-10-14T16:59:54.938650+0000","last_clean":"2023-10-14T16:59:54.938650+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T16:59:54.938650+0000","last_undegraded":"2023-10-14T16:59:54.938650+0000","last_fullsized":"2023-10-14T16:59:54.938650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038749005000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'628","reported_seq":695,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933938+0000","last_change":"2023-10-14T16:59:40.031831+0000","last_active":"2023-10-14T16:59:54.933938+0000","last_peered":"2023-10-14T16:59:54.933938+0000","last_clean":"2023-10-14T16:59:54.933938+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T16:59:54.933938+0000","last_undegraded":"2023-10-14T16:59:54.933938+0000","last_fullsized":"2023-10-14T16:59:54.933938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152503000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"23'646","reported_seq":723,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:04.212672+0000","last_change":"2023-10-14T17:01:04.212641+0000","last_active":"2023-10-14T17:01:04.212672+0000","last_peered":"2023-10-14T17:01:04.212672+0000","last_clean":"2023-10-14T17:01:04.212672+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T17:01:04.212672+0000","last_undegraded":"2023-10-14T17:01:04.212672+0000","last_fullsized":"2023-10-14T17:01:04.212672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'646","last_scrub_stamp":"2023-10-14T17:01:04.212545+0000","last_deep_scrub":"23'646","last_deep_scrub_stamp":"2023-10-14T17:01:04.212545+0000","last_clean_scrub_stamp":"2023-10-14T17:01:04.212545+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:17:04.668707+0000","scrub_duration":0.0018472569999999999,"objects_trimmed":0,"snaptrim_duration":0.033834213000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"23'522","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:02.501798+0000","last_change":"2023-10-14T17:01:02.501748+0000","last_active":"2023-10-14T17:01:02.501798+0000","last_peered":"2023-10-14T17:01:02.501798+0000","last_clean":"2023-10-14T17:01:02.501798+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T17:01:02.501798+0000","last_undegraded":"2023-10-14T17:01:02.501798+0000","last_fullsized":"2023-10-14T17:01:02.501798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'522","last_scrub_stamp":"2023-10-14T17:01:02.501640+0000","last_deep_scrub":"23'522","last_deep_scrub_stamp":"2023-10-14T17:01:02.501640+0000","last_clean_scrub_stamp":"2023-10-14T17:01:02.501640+0000","objects_scrubbed":1,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:52.643543+0000","scrub_duration":0.0031778309999999999,"objects_trimmed":0,"snaptrim_duration":0.070258685000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'532","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.918368+0000","last_change":"2023-10-14T16:59:40.032103+0000","last_active":"2023-10-14T16:59:54.918368+0000","last_peered":"2023-10-14T16:59:54.918368+0000","last_clean":"2023-10-14T16:59:54.918368+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T16:59:54.918368+0000","last_undegraded":"2023-10-14T16:59:54.918368+0000","last_fullsized":"2023-10-14T16:59:54.918368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058053194000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'962","reported_seq":1029,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.921434+0000","last_change":"2023-10-14T16:59:40.032217+0000","last_active":"2023-10-14T16:59:54.921434+0000","last_peered":"2023-10-14T16:59:54.921434+0000","last_clean":"2023-10-14T16:59:54.921434+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T16:59:54.921434+0000","last_undegraded":"2023-10-14T16:59:54.921434+0000","last_fullsized":"2023-10-14T16:59:54.921434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058433710999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'666","reported_seq":733,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.920919+0000","last_change":"2023-10-14T16:59:40.032894+0000","last_active":"2023-10-14T16:59:54.920919+0000","last_peered":"2023-10-14T16:59:54.920919+0000","last_clean":"2023-10-14T16:59:54.920919+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T16:59:54.920919+0000","last_undegraded":"2023-10-14T16:59:54.920919+0000","last_fullsized":"2023-10-14T16:59:54.920919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057530364000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"23'727","reported_seq":804,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:00.537609+0000","last_change":"2023-10-14T17:01:00.537582+0000","last_active":"2023-10-14T17:01:00.537609+0000","last_peered":"2023-10-14T17:01:00.537609+0000","last_clean":"2023-10-14T17:01:00.537609+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T17:01:00.537609+0000","last_undegraded":"2023-10-14T17:01:00.537609+0000","last_fullsized":"2023-10-14T17:01:00.537609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'727","last_scrub_stamp":"2023-10-14T17:01:00.537474+0000","last_deep_scrub":"23'727","last_deep_scrub_stamp":"2023-10-14T17:01:00.537474+0000","last_clean_scrub_stamp":"2023-10-14T17:01:00.537474+0000","objects_scrubbed":1,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:53.640313+0000","scrub_duration":0.0032466209999999999,"objects_trimmed":0,"snaptrim_duration":0.070350251000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'591","reported_seq":658,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933655+0000","last_change":"2023-10-14T16:59:40.030928+0000","last_active":"2023-10-14T16:59:54.933655+0000","last_peered":"2023-10-14T16:59:54.933655+0000","last_clean":"2023-10-14T16:59:54.933655+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T16:59:54.933655+0000","last_undegraded":"2023-10-14T16:59:54.933655+0000","last_fullsized":"2023-10-14T16:59:54.933655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057828565999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"23'506","reported_seq":582,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:02.265952+0000","last_change":"2023-10-14T17:01:02.265922+0000","last_active":"2023-10-14T17:01:02.265952+0000","last_peered":"2023-10-14T17:01:02.265952+0000","last_clean":"2023-10-14T17:01:02.265952+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T17:01:02.265952+0000","last_undegraded":"2023-10-14T17:01:02.265952+0000","last_fullsized":"2023-10-14T17:01:02.265952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'506","last_scrub_stamp":"2023-10-14T17:01:02.265830+0000","last_deep_scrub":"23'506","last_deep_scrub_stamp":"2023-10-14T17:01:02.265830+0000","last_clean_scrub_stamp":"2023-10-14T17:01:02.265830+0000","objects_scrubbed":2,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:21.484359+0000","scrub_duration":0.0038646399999999999,"objects_trimmed":0,"snaptrim_duration":0.039012109000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"23'511","reported_seq":588,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:58.478777+0000","last_change":"2023-10-14T17:00:58.478747+0000","last_active":"2023-10-14T17:00:58.478777+0000","last_peered":"2023-10-14T17:00:58.478777+0000","last_clean":"2023-10-14T17:00:58.478777+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T17:00:58.478777+0000","last_undegraded":"2023-10-14T17:00:58.478777+0000","last_fullsized":"2023-10-14T17:00:58.478777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'511","last_scrub_stamp":"2023-10-14T17:00:58.478655+0000","last_deep_scrub":"23'511","last_deep_scrub_stamp":"2023-10-14T17:00:58.478655+0000","last_clean_scrub_stamp":"2023-10-14T17:00:58.478655+0000","objects_scrubbed":1,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:05.432324+0000","scrub_duration":0.0037711939999999998,"objects_trimmed":0,"snaptrim_duration":0.047436036000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"23'513","reported_seq":590,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:55.535325+0000","last_change":"2023-10-14T17:00:55.535277+0000","last_active":"2023-10-14T17:00:55.535325+0000","last_peered":"2023-10-14T17:00:55.535325+0000","last_clean":"2023-10-14T17:00:55.535325+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T17:00:55.535325+0000","last_undegraded":"2023-10-14T17:00:55.535325+0000","last_fullsized":"2023-10-14T17:00:55.535325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'513","last_scrub_stamp":"2023-10-14T17:00:55.535176+0000","last_deep_scrub":"23'513","last_deep_scrub_stamp":"2023-10-14T17:00:55.535176+0000","last_clean_scrub_stamp":"2023-10-14T17:00:55.535176+0000","objects_scrubbed":1,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:20.386408+0000","scrub_duration":0.0042822859999999997,"objects_trimmed":0,"snaptrim_duration":0.070191972000000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"23'760","reported_seq":836,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:00.231581+0000","last_change":"2023-10-14T17:01:00.231548+0000","last_active":"2023-10-14T17:01:00.231581+0000","last_peered":"2023-10-14T17:01:00.231581+0000","last_clean":"2023-10-14T17:01:00.231581+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T17:01:00.231581+0000","last_undegraded":"2023-10-14T17:01:00.231581+0000","last_fullsized":"2023-10-14T17:01:00.231581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'760","last_scrub_stamp":"2023-10-14T17:01:00.231450+0000","last_deep_scrub":"23'760","last_deep_scrub_stamp":"2023-10-14T17:01:00.231450+0000","last_clean_scrub_stamp":"2023-10-14T17:01:00.231450+0000","objects_scrubbed":3,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:25.082681+0000","scrub_duration":0.0049133129999999999,"objects_trimmed":0,"snaptrim_duration":0.036605058000000003,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"23'657","reported_seq":734,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:05.190463+0000","last_change":"2023-10-14T17:01:05.190436+0000","last_active":"2023-10-14T17:01:05.190463+0000","last_peered":"2023-10-14T17:01:05.190463+0000","last_clean":"2023-10-14T17:01:05.190463+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T17:01:05.190463+0000","last_undegraded":"2023-10-14T17:01:05.190463+0000","last_fullsized":"2023-10-14T17:01:05.190463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'657","last_scrub_stamp":"2023-10-14T17:01:05.190351+0000","last_deep_scrub":"23'657","last_deep_scrub_stamp":"2023-10-14T17:01:05.190351+0000","last_clean_scrub_stamp":"2023-10-14T17:01:05.190351+0000","objects_scrubbed":2,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:58.293190+0000","scrub_duration":0.0042399380000000004,"objects_trimmed":0,"snaptrim_duration":0.038947427,"stat_sum":{"num_bytes":4105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"23'745","reported_seq":811,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933592+0000","last_change":"2023-10-14T16:59:40.032292+0000","last_active":"2023-10-14T16:59:54.933592+0000","last_peered":"2023-10-14T16:59:54.933592+0000","last_clean":"2023-10-14T16:59:54.933592+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T16:59:54.933592+0000","last_undegraded":"2023-10-14T16:59:54.933592+0000","last_fullsized":"2023-10-14T16:59:54.933592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058345898,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'595","reported_seq":672,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:59.555851+0000","last_change":"2023-10-14T17:00:59.555819+0000","last_active":"2023-10-14T17:00:59.555851+0000","last_peered":"2023-10-14T17:00:59.555851+0000","last_clean":"2023-10-14T17:00:59.555851+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T17:00:59.555851+0000","last_undegraded":"2023-10-14T17:00:59.555851+0000","last_fullsized":"2023-10-14T17:00:59.555851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'595","last_scrub_stamp":"2023-10-14T17:00:59.555722+0000","last_deep_scrub":"23'595","last_deep_scrub_stamp":"2023-10-14T17:00:59.555722+0000","last_clean_scrub_stamp":"2023-10-14T17:00:59.555722+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:17:00.011883+0000","scrub_duration":0.0014926679999999999,"objects_trimmed":0,"snaptrim_duration":0.071573409000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'693","reported_seq":760,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:55.489180+0000","last_change":"2023-10-14T16:59:40.030743+0000","last_active":"2023-10-14T16:59:55.489180+0000","last_peered":"2023-10-14T16:59:55.489180+0000","last_clean":"2023-10-14T16:59:55.489180+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T16:59:55.489180+0000","last_undegraded":"2023-10-14T16:59:55.489180+0000","last_fullsized":"2023-10-14T16:59:55.489180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057407435999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"23'574","reported_seq":652,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:57.611618+0000","last_change":"2023-10-14T17:00:57.611589+0000","last_active":"2023-10-14T17:00:57.611618+0000","last_peered":"2023-10-14T17:00:57.611618+0000","last_clean":"2023-10-14T17:00:57.611618+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T17:00:57.611618+0000","last_undegraded":"2023-10-14T17:00:57.611618+0000","last_fullsized":"2023-10-14T17:00:57.611618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'574","last_scrub_stamp":"2023-10-14T17:00:57.611471+0000","last_deep_scrub":"23'574","last_deep_scrub_stamp":"2023-10-14T17:00:57.611471+0000","last_clean_scrub_stamp":"2023-10-14T17:00:57.611471+0000","objects_scrubbed":2,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:16.830000+0000","scrub_duration":0.004107383,"objects_trimmed":0,"snaptrim_duration":0.070060102999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"23'761","reported_seq":828,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.939481+0000","last_change":"2023-10-14T16:59:40.029354+0000","last_active":"2023-10-14T16:59:54.939481+0000","last_peered":"2023-10-14T16:59:54.939481+0000","last_clean":"2023-10-14T16:59:54.939481+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T16:59:54.939481+0000","last_undegraded":"2023-10-14T16:59:54.939481+0000","last_fullsized":"2023-10-14T16:59:54.939481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056633790000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"23'810","reported_seq":877,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.938819+0000","last_change":"2023-10-14T16:59:40.012817+0000","last_active":"2023-10-14T16:59:54.938819+0000","last_peered":"2023-10-14T16:59:54.938819+0000","last_clean":"2023-10-14T16:59:54.938819+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T16:59:54.938819+0000","last_undegraded":"2023-10-14T16:59:54.938819+0000","last_fullsized":"2023-10-14T16:59:54.938819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038418550000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"23'695","reported_seq":772,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:54.580738+0000","last_change":"2023-10-14T17:00:54.580711+0000","last_active":"2023-10-14T17:00:54.580738+0000","last_peered":"2023-10-14T17:00:54.580738+0000","last_clean":"2023-10-14T17:00:54.580738+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T17:00:54.580738+0000","last_undegraded":"2023-10-14T17:00:54.580738+0000","last_fullsized":"2023-10-14T17:00:54.580738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'695","last_scrub_stamp":"2023-10-14T17:00:54.580623+0000","last_deep_scrub":"23'695","last_deep_scrub_stamp":"2023-10-14T17:00:54.580623+0000","last_clean_scrub_stamp":"2023-10-14T17:00:54.580623+0000","objects_scrubbed":1,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:00.134264+0000","scrub_duration":0.0030110179999999999,"objects_trimmed":0,"snaptrim_duration":0.065688290999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'638","reported_seq":715,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:41.237813+0000","last_change":"2023-10-14T17:00:41.237783+0000","last_active":"2023-10-14T17:00:41.237813+0000","last_peered":"2023-10-14T17:00:41.237813+0000","last_clean":"2023-10-14T17:00:41.237813+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T17:00:41.237813+0000","last_undegraded":"2023-10-14T17:00:41.237813+0000","last_fullsized":"2023-10-14T17:00:41.237813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'638","last_scrub_stamp":"2023-10-14T17:00:41.237668+0000","last_deep_scrub":"23'638","last_deep_scrub_stamp":"2023-10-14T17:00:41.237668+0000","last_clean_scrub_stamp":"2023-10-14T17:00:41.237668+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:17.477170+0000","scrub_duration":0.0015379790000000001,"objects_trimmed":0,"snaptrim_duration":0.011260075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"23'846","reported_seq":923,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:37.816280+0000","last_change":"2023-10-14T17:00:37.816253+0000","last_active":"2023-10-14T17:00:37.816280+0000","last_peered":"2023-10-14T17:00:37.816280+0000","last_clean":"2023-10-14T17:00:37.816280+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T17:00:37.816280+0000","last_undegraded":"2023-10-14T17:00:37.816280+0000","last_fullsized":"2023-10-14T17:00:37.816280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'846","last_scrub_stamp":"2023-10-14T17:00:37.816136+0000","last_deep_scrub":"23'846","last_deep_scrub_stamp":"2023-10-14T17:00:37.816136+0000","last_clean_scrub_stamp":"2023-10-14T17:00:37.816136+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:19.053769+0000","scrub_duration":0.001974478,"objects_trimmed":0,"snaptrim_duration":0.058152492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"23'636","reported_seq":713,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:47.417925+0000","last_change":"2023-10-14T17:00:47.417893+0000","last_active":"2023-10-14T17:00:47.417925+0000","last_peered":"2023-10-14T17:00:47.417925+0000","last_clean":"2023-10-14T17:00:47.417925+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T17:00:47.417925+0000","last_undegraded":"2023-10-14T17:00:47.417925+0000","last_fullsized":"2023-10-14T17:00:47.417925+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'636","last_scrub_stamp":"2023-10-14T17:00:47.417788+0000","last_deep_scrub":"23'636","last_deep_scrub_stamp":"2023-10-14T17:00:47.417788+0000","last_clean_scrub_stamp":"2023-10-14T17:00:47.417788+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:44.456851+0000","scrub_duration":0.002011554,"objects_trimmed":0,"snaptrim_duration":0.048983802,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'679","reported_seq":756,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:17.045500+0000","last_change":"2023-10-14T17:00:17.045457+0000","last_active":"2023-10-14T17:00:17.045500+0000","last_peered":"2023-10-14T17:00:17.045500+0000","last_clean":"2023-10-14T17:00:17.045500+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T17:00:17.045500+0000","last_undegraded":"2023-10-14T17:00:17.045500+0000","last_fullsized":"2023-10-14T17:00:17.045500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'679","last_scrub_stamp":"2023-10-14T17:00:17.045319+0000","last_deep_scrub":"23'679","last_deep_scrub_stamp":"2023-10-14T17:00:17.045319+0000","last_clean_scrub_stamp":"2023-10-14T17:00:17.045319+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:24.925526+0000","scrub_duration":0.0014699489999999999,"objects_trimmed":0,"snaptrim_duration":0.047799974000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'513","reported_seq":590,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:42.696392+0000","last_change":"2023-10-14T17:00:42.696361+0000","last_active":"2023-10-14T17:00:42.696392+0000","last_peered":"2023-10-14T17:00:42.696392+0000","last_clean":"2023-10-14T17:00:42.696392+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T17:00:42.696392+0000","last_undegraded":"2023-10-14T17:00:42.696392+0000","last_fullsized":"2023-10-14T17:00:42.696392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'513","last_scrub_stamp":"2023-10-14T17:00:42.696267+0000","last_deep_scrub":"23'513","last_deep_scrub_stamp":"2023-10-14T17:00:42.696267+0000","last_clean_scrub_stamp":"2023-10-14T17:00:42.696267+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:28.060990+0000","scrub_duration":0.0019776569999999999,"objects_trimmed":0,"snaptrim_duration":0.058565578,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1535","reported_seq":1563,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:49.427466+0000","last_change":"2023-10-14T17:00:49.427436+0000","last_active":"2023-10-14T17:00:49.427466+0000","last_peered":"2023-10-14T17:00:49.427466+0000","last_clean":"2023-10-14T17:00:49.427466+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T17:00:49.427466+0000","last_undegraded":"2023-10-14T17:00:49.427466+0000","last_fullsized":"2023-10-14T17:00:49.427466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1535","last_scrub_stamp":"2023-10-14T17:00:49.427350+0000","last_deep_scrub":"23'1535","last_deep_scrub_stamp":"2023-10-14T17:00:49.427350+0000","last_clean_scrub_stamp":"2023-10-14T17:00:49.427350+0000","objects_scrubbed":3,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:46.466413+0000","scrub_duration":0.028509313000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1524,"num_write_kb":13073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"23'655","reported_seq":733,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:25.725868+0000","last_change":"2023-10-14T17:00:25.725836+0000","last_active":"2023-10-14T17:00:25.725868+0000","last_peered":"2023-10-14T17:00:25.725868+0000","last_clean":"2023-10-14T17:00:25.725868+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T17:00:25.725868+0000","last_undegraded":"2023-10-14T17:00:25.725868+0000","last_fullsized":"2023-10-14T17:00:25.725868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'655","last_scrub_stamp":"2023-10-14T17:00:25.725747+0000","last_deep_scrub":"23'655","last_deep_scrub_stamp":"2023-10-14T17:00:25.725747+0000","last_clean_scrub_stamp":"2023-10-14T17:00:25.725747+0000","objects_scrubbed":2,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:50.968836+0000","scrub_duration":0.0036407990000000001,"objects_trimmed":0,"snaptrim_duration":0.067459389999999994,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"23'756","reported_seq":784,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:16.095374+0000","last_change":"2023-10-14T17:00:16.095338+0000","last_active":"2023-10-14T17:00:16.095374+0000","last_peered":"2023-10-14T17:00:16.095374+0000","last_clean":"2023-10-14T17:00:16.095374+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T17:00:16.095374+0000","last_undegraded":"2023-10-14T17:00:16.095374+0000","last_fullsized":"2023-10-14T17:00:16.095374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'756","last_scrub_stamp":"2023-10-14T17:00:16.095246+0000","last_deep_scrub":"23'756","last_deep_scrub_stamp":"2023-10-14T17:00:16.095246+0000","last_clean_scrub_stamp":"2023-10-14T17:00:16.095246+0000","objects_scrubbed":1,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:54.744269+0000","scrub_duration":0.013423025999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'585","reported_seq":662,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:16.588712+0000","last_change":"2023-10-14T17:00:16.588677+0000","last_active":"2023-10-14T17:00:16.588712+0000","last_peered":"2023-10-14T17:00:16.588712+0000","last_clean":"2023-10-14T17:00:16.588712+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T17:00:16.588712+0000","last_undegraded":"2023-10-14T17:00:16.588712+0000","last_fullsized":"2023-10-14T17:00:16.588712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'585","last_scrub_stamp":"2023-10-14T17:00:16.588581+0000","last_deep_scrub":"23'585","last_deep_scrub_stamp":"2023-10-14T17:00:16.588581+0000","last_clean_scrub_stamp":"2023-10-14T17:00:16.588581+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:41.060437+0000","scrub_duration":0.0019550330000000001,"objects_trimmed":0,"snaptrim_duration":0.070886901000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1509","reported_seq":1537,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:18.073307+0000","last_change":"2023-10-14T17:00:18.073275+0000","last_active":"2023-10-14T17:00:18.073307+0000","last_peered":"2023-10-14T17:00:18.073307+0000","last_clean":"2023-10-14T17:00:18.073307+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T17:00:18.073307+0000","last_undegraded":"2023-10-14T17:00:18.073307+0000","last_fullsized":"2023-10-14T17:00:18.073307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1509","last_scrub_stamp":"2023-10-14T17:00:18.073180+0000","last_deep_scrub":"23'1509","last_deep_scrub_stamp":"2023-10-14T17:00:18.073180+0000","last_clean_scrub_stamp":"2023-10-14T17:00:18.073180+0000","objects_scrubbed":3,"log_size":1509,"log_dups_size":0,"ondisk_log_size":1509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:58.302825+0000","scrub_duration":0.026462619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"23'595","reported_seq":672,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:26.833140+0000","last_change":"2023-10-14T17:00:26.833112+0000","last_active":"2023-10-14T17:00:26.833140+0000","last_peered":"2023-10-14T17:00:26.833140+0000","last_clean":"2023-10-14T17:00:26.833140+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T17:00:26.833140+0000","last_undegraded":"2023-10-14T17:00:26.833140+0000","last_fullsized":"2023-10-14T17:00:26.833140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'595","last_scrub_stamp":"2023-10-14T17:00:26.833028+0000","last_deep_scrub":"23'595","last_deep_scrub_stamp":"2023-10-14T17:00:26.833028+0000","last_clean_scrub_stamp":"2023-10-14T17:00:26.833028+0000","objects_scrubbed":2,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:30.522108+0000","scrub_duration":0.0043885740000000001,"objects_trimmed":0,"snaptrim_duration":0.058803686000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"22'4","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:31.648411+0000","last_change":"2023-10-14T17:00:31.648376+0000","last_active":"2023-10-14T17:00:31.648411+0000","last_peered":"2023-10-14T17:00:31.648411+0000","last_clean":"2023-10-14T17:00:31.648411+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T17:00:31.648411+0000","last_undegraded":"2023-10-14T17:00:31.648411+0000","last_fullsized":"2023-10-14T17:00:31.648411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2023-10-14T17:00:31.648277+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2023-10-14T17:00:31.648277+0000","last_clean_scrub_stamp":"2023-10-14T17:00:31.648277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:35.337357+0000","scrub_duration":0.0020350590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'583","reported_seq":660,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:12.106374+0000","last_change":"2023-10-14T17:00:12.106339+0000","last_active":"2023-10-14T17:00:12.106374+0000","last_peered":"2023-10-14T17:00:12.106374+0000","last_clean":"2023-10-14T17:00:12.106374+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T17:00:12.106374+0000","last_undegraded":"2023-10-14T17:00:12.106374+0000","last_fullsized":"2023-10-14T17:00:12.106374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'583","last_scrub_stamp":"2023-10-14T17:00:12.106239+0000","last_deep_scrub":"23'583","last_deep_scrub_stamp":"2023-10-14T17:00:12.106239+0000","last_clean_scrub_stamp":"2023-10-14T17:00:12.106239+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:53:48.745008+0000","scrub_duration":0.0023297560000000001,"objects_trimmed":0,"snaptrim_duration":0.024750503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'757","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:26.505195+0000","last_change":"2023-10-14T17:00:26.505158+0000","last_active":"2023-10-14T17:00:26.505195+0000","last_peered":"2023-10-14T17:00:26.505195+0000","last_clean":"2023-10-14T17:00:26.505195+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T17:00:26.505195+0000","last_undegraded":"2023-10-14T17:00:26.505195+0000","last_fullsized":"2023-10-14T17:00:26.505195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'757","last_scrub_stamp":"2023-10-14T17:00:26.505033+0000","last_deep_scrub":"23'757","last_deep_scrub_stamp":"2023-10-14T17:00:26.505033+0000","last_clean_scrub_stamp":"2023-10-14T17:00:26.505033+0000","objects_scrubbed":1,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:40.160585+0000","scrub_duration":0.014321274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'570","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:12.612196+0000","last_change":"2023-10-14T17:00:12.612165+0000","last_active":"2023-10-14T17:00:12.612196+0000","last_peered":"2023-10-14T17:00:12.612196+0000","last_clean":"2023-10-14T17:00:12.612196+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T17:00:12.612196+0000","last_undegraded":"2023-10-14T17:00:12.612196+0000","last_fullsized":"2023-10-14T17:00:12.612196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'570","last_scrub_stamp":"2023-10-14T17:00:12.612058+0000","last_deep_scrub":"23'570","last_deep_scrub_stamp":"2023-10-14T17:00:12.612058+0000","last_clean_scrub_stamp":"2023-10-14T17:00:12.612058+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:51.261080+0000","scrub_duration":0.001901631,"objects_trimmed":0,"snaptrim_duration":0.067572238000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"23'801","reported_seq":829,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:47.460594+0000","last_change":"2023-10-14T17:00:47.460567+0000","last_active":"2023-10-14T17:00:47.460594+0000","last_peered":"2023-10-14T17:00:47.460594+0000","last_clean":"2023-10-14T17:00:47.460594+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T17:00:47.460594+0000","last_undegraded":"2023-10-14T17:00:47.460594+0000","last_fullsized":"2023-10-14T17:00:47.460594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'801","last_scrub_stamp":"2023-10-14T17:00:47.460484+0000","last_deep_scrub":"23'801","last_deep_scrub_stamp":"2023-10-14T17:00:47.460484+0000","last_clean_scrub_stamp":"2023-10-14T17:00:47.460484+0000","objects_scrubbed":3,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:28.698116+0000","scrub_duration":0.01328207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"23'414","reported_seq":491,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:09.150688+0000","last_change":"2023-10-14T17:00:09.150657+0000","last_active":"2023-10-14T17:00:09.150688+0000","last_peered":"2023-10-14T17:00:09.150688+0000","last_clean":"2023-10-14T17:00:09.150688+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T17:00:09.150688+0000","last_undegraded":"2023-10-14T17:00:09.150688+0000","last_fullsized":"2023-10-14T17:00:09.150688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'414","last_scrub_stamp":"2023-10-14T17:00:09.150551+0000","last_deep_scrub":"23'414","last_deep_scrub_stamp":"2023-10-14T17:00:09.150551+0000","last_clean_scrub_stamp":"2023-10-14T17:00:09.150551+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:38.484247+0000","scrub_duration":0.0020073140000000001,"objects_trimmed":0,"snaptrim_duration":0.013962693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'2303","reported_seq":2331,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:24.855552+0000","last_change":"2023-10-14T17:00:24.855526+0000","last_active":"2023-10-14T17:00:24.855552+0000","last_peered":"2023-10-14T17:00:24.855552+0000","last_clean":"2023-10-14T17:00:24.855552+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T17:00:24.855552+0000","last_undegraded":"2023-10-14T17:00:24.855552+0000","last_fullsized":"2023-10-14T17:00:24.855552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2303","last_scrub_stamp":"2023-10-14T17:00:24.855445+0000","last_deep_scrub":"23'2303","last_deep_scrub_stamp":"2023-10-14T17:00:24.855445+0000","last_clean_scrub_stamp":"2023-10-14T17:00:24.855445+0000","objects_scrubbed":6,"log_size":2303,"log_dups_size":0,"ondisk_log_size":2303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:55.570593+0000","scrub_duration":0.039868383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2289,"num_write_kb":13405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"23'485","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:19.481760+0000","last_change":"2023-10-14T17:00:19.481720+0000","last_active":"2023-10-14T17:00:19.481760+0000","last_peered":"2023-10-14T17:00:19.481760+0000","last_clean":"2023-10-14T17:00:19.481760+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T17:00:19.481760+0000","last_undegraded":"2023-10-14T17:00:19.481760+0000","last_fullsized":"2023-10-14T17:00:19.481760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'485","last_scrub_stamp":"2023-10-14T17:00:19.481628+0000","last_deep_scrub":"23'485","last_deep_scrub_stamp":"2023-10-14T17:00:19.481628+0000","last_clean_scrub_stamp":"2023-10-14T17:00:19.481628+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:59.711273+0000","scrub_duration":0.001552152,"objects_trimmed":0,"snaptrim_duration":0.038441039000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"23'1510","reported_seq":1538,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:02.877946+0000","last_change":"2023-10-14T17:01:02.877898+0000","last_active":"2023-10-14T17:01:02.877946+0000","last_peered":"2023-10-14T17:01:02.877946+0000","last_clean":"2023-10-14T17:01:02.877946+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T17:01:02.877946+0000","last_undegraded":"2023-10-14T17:01:02.877946+0000","last_fullsized":"2023-10-14T17:01:02.877946+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1510","last_scrub_stamp":"2023-10-14T17:01:02.877802+0000","last_deep_scrub":"23'1510","last_deep_scrub_stamp":"2023-10-14T17:01:02.877802+0000","last_clean_scrub_stamp":"2023-10-14T17:01:02.877802+0000","objects_scrubbed":4,"log_size":1510,"log_dups_size":0,"ondisk_log_size":1510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:39.956631+0000","scrub_duration":0.027352138000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1498,"num_write_kb":8967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"23'532","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:54.422302+0000","last_change":"2023-10-14T17:00:54.422271+0000","last_active":"2023-10-14T17:00:54.422302+0000","last_peered":"2023-10-14T17:00:54.422302+0000","last_clean":"2023-10-14T17:00:54.422302+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T17:00:54.422302+0000","last_undegraded":"2023-10-14T17:00:54.422302+0000","last_fullsized":"2023-10-14T17:00:54.422302+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'532","last_scrub_stamp":"2023-10-14T17:00:54.422176+0000","last_deep_scrub":"23'532","last_deep_scrub_stamp":"2023-10-14T17:00:54.422176+0000","last_clean_scrub_stamp":"2023-10-14T17:00:54.422176+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:27.394683+0000","scrub_duration":0.0019774229999999999,"objects_trimmed":0,"snaptrim_duration":0.047574827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"22'3","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:36.699025+0000","last_change":"2023-10-14T17:00:36.698989+0000","last_active":"2023-10-14T17:00:36.699025+0000","last_peered":"2023-10-14T17:00:36.699025+0000","last_clean":"2023-10-14T17:00:36.699025+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T17:00:36.699025+0000","last_undegraded":"2023-10-14T17:00:36.699025+0000","last_fullsized":"2023-10-14T17:00:36.699025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2023-10-14T17:00:36.698893+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2023-10-14T17:00:36.698893+0000","last_clean_scrub_stamp":"2023-10-14T17:00:36.698893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:17.764307+0000","scrub_duration":0.001518506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'546","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.859089+0000","last_change":"2023-10-14T17:00:21.859059+0000","last_active":"2023-10-14T17:00:21.859089+0000","last_peered":"2023-10-14T17:00:21.859089+0000","last_clean":"2023-10-14T17:00:21.859089+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T17:00:21.859089+0000","last_undegraded":"2023-10-14T17:00:21.859089+0000","last_fullsized":"2023-10-14T17:00:21.859089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'546","last_scrub_stamp":"2023-10-14T17:00:21.858971+0000","last_deep_scrub":"23'546","last_deep_scrub_stamp":"2023-10-14T17:00:21.858971+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.858971+0000","objects_scrubbed":3,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:47.102060+0000","scrub_duration":0.0040357489999999999,"objects_trimmed":0,"snaptrim_duration":0.057513697000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"22'5","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:27.799109+0000","last_change":"2023-10-14T17:00:27.799084+0000","last_active":"2023-10-14T17:00:27.799109+0000","last_peered":"2023-10-14T17:00:27.799109+0000","last_clean":"2023-10-14T17:00:27.799109+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T17:00:27.799109+0000","last_undegraded":"2023-10-14T17:00:27.799109+0000","last_fullsized":"2023-10-14T17:00:27.799109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2023-10-14T17:00:27.798994+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2023-10-14T17:00:27.798994+0000","last_clean_scrub_stamp":"2023-10-14T17:00:27.798994+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:07.088613+0000","scrub_duration":0.0014250129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"23'1019","reported_seq":1096,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:10.548287+0000","last_change":"2023-10-14T17:00:10.548242+0000","last_active":"2023-10-14T17:00:10.548287+0000","last_peered":"2023-10-14T17:00:10.548287+0000","last_clean":"2023-10-14T17:00:10.548287+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T17:00:10.548287+0000","last_undegraded":"2023-10-14T17:00:10.548287+0000","last_fullsized":"2023-10-14T17:00:10.548287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1019","last_scrub_stamp":"2023-10-14T17:00:10.548118+0000","last_deep_scrub":"23'1019","last_deep_scrub_stamp":"2023-10-14T17:00:10.548118+0000","last_clean_scrub_stamp":"2023-10-14T17:00:10.548118+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:10.896871+0000","scrub_duration":0.0023116510000000001,"objects_trimmed":0,"snaptrim_duration":0.07026193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'1517","reported_seq":1545,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:33.925606+0000","last_change":"2023-10-14T17:00:33.925560+0000","last_active":"2023-10-14T17:00:33.925606+0000","last_peered":"2023-10-14T17:00:33.925606+0000","last_clean":"2023-10-14T17:00:33.925606+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T17:00:33.925606+0000","last_undegraded":"2023-10-14T17:00:33.925606+0000","last_fullsized":"2023-10-14T17:00:33.925606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1517","last_scrub_stamp":"2023-10-14T17:00:33.925467+0000","last_deep_scrub":"23'1517","last_deep_scrub_stamp":"2023-10-14T17:00:33.925467+0000","last_clean_scrub_stamp":"2023-10-14T17:00:33.925467+0000","objects_scrubbed":6,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:10.164969+0000","scrub_duration":0.024970293000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1507,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'585","reported_seq":662,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.585569+0000","last_change":"2023-10-14T17:00:14.585538+0000","last_active":"2023-10-14T17:00:14.585569+0000","last_peered":"2023-10-14T17:00:14.585569+0000","last_clean":"2023-10-14T17:00:14.585569+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T17:00:14.585569+0000","last_undegraded":"2023-10-14T17:00:14.585569+0000","last_fullsized":"2023-10-14T17:00:14.585569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'585","last_scrub_stamp":"2023-10-14T17:00:14.585421+0000","last_deep_scrub":"23'585","last_deep_scrub_stamp":"2023-10-14T17:00:14.585421+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.585421+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:54.815066+0000","scrub_duration":0.0018524399999999999,"objects_trimmed":0,"snaptrim_duration":0.071266745000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"23'757","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:30.436241+0000","last_change":"2023-10-14T17:00:30.436214+0000","last_active":"2023-10-14T17:00:30.436241+0000","last_peered":"2023-10-14T17:00:30.436241+0000","last_clean":"2023-10-14T17:00:30.436241+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T17:00:30.436241+0000","last_undegraded":"2023-10-14T17:00:30.436241+0000","last_fullsized":"2023-10-14T17:00:30.436241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'757","last_scrub_stamp":"2023-10-14T17:00:30.436119+0000","last_deep_scrub":"23'757","last_deep_scrub_stamp":"2023-10-14T17:00:30.436119+0000","last_clean_scrub_stamp":"2023-10-14T17:00:30.436119+0000","objects_scrubbed":2,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:55.679208+0000","scrub_duration":0.014880749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"23'815","reported_seq":892,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:06.672554+0000","last_change":"2023-10-14T17:00:06.672525+0000","last_active":"2023-10-14T17:00:06.672554+0000","last_peered":"2023-10-14T17:00:06.672554+0000","last_clean":"2023-10-14T17:00:06.672554+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T17:00:06.672554+0000","last_undegraded":"2023-10-14T17:00:06.672554+0000","last_fullsized":"2023-10-14T17:00:06.672554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'815","last_scrub_stamp":"2023-10-14T17:00:06.672437+0000","last_deep_scrub":"23'815","last_deep_scrub_stamp":"2023-10-14T17:00:06.672437+0000","last_clean_scrub_stamp":"2023-10-14T17:00:06.672437+0000","objects_scrubbed":2,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:45.321460+0000","scrub_duration":0.0042146179999999998,"objects_trimmed":0,"snaptrim_duration":0.057360406000000003,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"23'758","reported_seq":786,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:51.370885+0000","last_change":"2023-10-14T17:00:51.370858+0000","last_active":"2023-10-14T17:00:51.370885+0000","last_peered":"2023-10-14T17:00:51.370885+0000","last_clean":"2023-10-14T17:00:51.370885+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T17:00:51.370885+0000","last_undegraded":"2023-10-14T17:00:51.370885+0000","last_fullsized":"2023-10-14T17:00:51.370885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'758","last_scrub_stamp":"2023-10-14T17:00:51.370768+0000","last_deep_scrub":"23'758","last_deep_scrub_stamp":"2023-10-14T17:00:51.370768+0000","last_clean_scrub_stamp":"2023-10-14T17:00:51.370768+0000","objects_scrubbed":2,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:36.735490+0000","scrub_duration":0.012859822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'595","reported_seq":671,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:18.436040+0000","last_change":"2023-10-14T17:00:18.436003+0000","last_active":"2023-10-14T17:00:18.436040+0000","last_peered":"2023-10-14T17:00:18.436040+0000","last_clean":"2023-10-14T17:00:18.436040+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T17:00:18.436040+0000","last_undegraded":"2023-10-14T17:00:18.436040+0000","last_fullsized":"2023-10-14T17:00:18.436040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'595","last_scrub_stamp":"2023-10-14T17:00:18.435878+0000","last_deep_scrub":"23'595","last_deep_scrub_stamp":"2023-10-14T17:00:18.435878+0000","last_clean_scrub_stamp":"2023-10-14T17:00:18.435878+0000","objects_scrubbed":2,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:26.316085+0000","scrub_duration":0.0045224619999999997,"objects_trimmed":0,"snaptrim_duration":0.039029367000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'757","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:46.800593+0000","last_change":"2023-10-14T17:00:46.800567+0000","last_active":"2023-10-14T17:00:46.800593+0000","last_peered":"2023-10-14T17:00:46.800593+0000","last_clean":"2023-10-14T17:00:46.800593+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T17:00:46.800593+0000","last_undegraded":"2023-10-14T17:00:46.800593+0000","last_fullsized":"2023-10-14T17:00:46.800593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'757","last_scrub_stamp":"2023-10-14T17:00:46.800478+0000","last_deep_scrub":"23'757","last_deep_scrub_stamp":"2023-10-14T17:00:46.800478+0000","last_clean_scrub_stamp":"2023-10-14T17:00:46.800478+0000","objects_scrubbed":2,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:19.772985+0000","scrub_duration":0.013316553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'445","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:17.439396+0000","last_change":"2023-10-14T17:00:17.439352+0000","last_active":"2023-10-14T17:00:17.439396+0000","last_peered":"2023-10-14T17:00:17.439396+0000","last_clean":"2023-10-14T17:00:17.439396+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T17:00:17.439396+0000","last_undegraded":"2023-10-14T17:00:17.439396+0000","last_fullsized":"2023-10-14T17:00:17.439396+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'445","last_scrub_stamp":"2023-10-14T17:00:17.439252+0000","last_deep_scrub":"23'445","last_deep_scrub_stamp":"2023-10-14T17:00:17.439252+0000","last_clean_scrub_stamp":"2023-10-14T17:00:17.439252+0000","objects_scrubbed":5,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:56.088275+0000","scrub_duration":0.0049452009999999998,"objects_trimmed":0,"snaptrim_duration":0.036384234000000001,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"23'11","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:06.898747+0000","last_change":"2023-10-14T17:01:06.898722+0000","last_active":"2023-10-14T17:01:06.898747+0000","last_peered":"2023-10-14T17:01:06.898747+0000","last_clean":"2023-10-14T17:01:06.898747+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T17:01:06.898747+0000","last_undegraded":"2023-10-14T17:01:06.898747+0000","last_fullsized":"2023-10-14T17:01:06.898747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2023-10-14T17:01:06.898620+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2023-10-14T17:01:06.898620+0000","last_clean_scrub_stamp":"2023-10-14T17:01:06.898620+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:32.376838+0000","scrub_duration":0.0083792199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"23'731","reported_seq":808,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:20.695393+0000","last_change":"2023-10-14T17:00:20.695362+0000","last_active":"2023-10-14T17:00:20.695393+0000","last_peered":"2023-10-14T17:00:20.695393+0000","last_clean":"2023-10-14T17:00:20.695393+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T17:00:20.695393+0000","last_undegraded":"2023-10-14T17:00:20.695393+0000","last_fullsized":"2023-10-14T17:00:20.695393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'731","last_scrub_stamp":"2023-10-14T17:00:20.695264+0000","last_deep_scrub":"23'731","last_deep_scrub_stamp":"2023-10-14T17:00:20.695264+0000","last_clean_scrub_stamp":"2023-10-14T17:00:20.695264+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:05.017140+0000","scrub_duration":0.001565271,"objects_trimmed":0,"snaptrim_duration":0.070178661000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'1502","reported_seq":1530,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:36.331783+0000","last_change":"2023-10-14T17:00:36.331735+0000","last_active":"2023-10-14T17:00:36.331783+0000","last_peered":"2023-10-14T17:00:36.331783+0000","last_clean":"2023-10-14T17:00:36.331783+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T17:00:36.331783+0000","last_undegraded":"2023-10-14T17:00:36.331783+0000","last_fullsized":"2023-10-14T17:00:36.331783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1502","last_scrub_stamp":"2023-10-14T17:00:36.331637+0000","last_deep_scrub":"23'1502","last_deep_scrub_stamp":"2023-10-14T17:00:36.331637+0000","last_clean_scrub_stamp":"2023-10-14T17:00:36.331637+0000","objects_scrubbed":4,"log_size":1502,"log_dups_size":0,"ondisk_log_size":1502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:15.621256+0000","scrub_duration":0.027209761999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":12977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"23'732","reported_seq":809,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:07.636144+0000","last_change":"2023-10-14T17:00:07.636098+0000","last_active":"2023-10-14T17:00:07.636144+0000","last_peered":"2023-10-14T17:00:07.636144+0000","last_clean":"2023-10-14T17:00:07.636144+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T17:00:07.636144+0000","last_undegraded":"2023-10-14T17:00:07.636144+0000","last_fullsized":"2023-10-14T17:00:07.636144+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'732","last_scrub_stamp":"2023-10-14T17:00:07.635986+0000","last_deep_scrub":"23'732","last_deep_scrub_stamp":"2023-10-14T17:00:07.635986+0000","last_clean_scrub_stamp":"2023-10-14T17:00:07.635986+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:15.516193+0000","scrub_duration":0.0020539740000000001,"objects_trimmed":0,"snaptrim_duration":0.034606716000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'3229","reported_seq":3257,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:39.800699+0000","last_change":"2023-10-14T17:00:39.800656+0000","last_active":"2023-10-14T17:00:39.800699+0000","last_peered":"2023-10-14T17:00:39.800699+0000","last_clean":"2023-10-14T17:00:39.800699+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T17:00:39.800699+0000","last_undegraded":"2023-10-14T17:00:39.800699+0000","last_fullsized":"2023-10-14T17:00:39.800699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3229","last_scrub_stamp":"2023-10-14T17:00:39.800562+0000","last_deep_scrub":"23'3229","last_deep_scrub_stamp":"2023-10-14T17:00:39.800562+0000","last_clean_scrub_stamp":"2023-10-14T17:00:39.800562+0000","objects_scrubbed":2,"log_size":3229,"log_dups_size":0,"ondisk_log_size":3229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:36.839625+0000","scrub_duration":0.027341382000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3218,"num_write_kb":10301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'569","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.709675+0000","last_change":"2023-10-14T17:00:14.709621+0000","last_active":"2023-10-14T17:00:14.709675+0000","last_peered":"2023-10-14T17:00:14.709675+0000","last_clean":"2023-10-14T17:00:14.709675+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T17:00:14.709675+0000","last_undegraded":"2023-10-14T17:00:14.709675+0000","last_fullsized":"2023-10-14T17:00:14.709675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'569","last_scrub_stamp":"2023-10-14T17:00:14.709530+0000","last_deep_scrub":"23'569","last_deep_scrub_stamp":"2023-10-14T17:00:14.709530+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.709530+0000","objects_scrubbed":2,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:35:59.031407+0000","scrub_duration":0.0039121779999999997,"objects_trimmed":0,"snaptrim_duration":0.057531643,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"23'651","reported_seq":679,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:58.940562+0000","last_change":"2023-10-14T17:00:58.940536+0000","last_active":"2023-10-14T17:00:58.940562+0000","last_peered":"2023-10-14T17:00:58.940562+0000","last_clean":"2023-10-14T17:00:58.940562+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T17:00:58.940562+0000","last_undegraded":"2023-10-14T17:00:58.940562+0000","last_fullsized":"2023-10-14T17:00:58.940562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'651","last_scrub_stamp":"2023-10-14T17:00:58.940431+0000","last_deep_scrub":"23'651","last_deep_scrub_stamp":"2023-10-14T17:00:58.940431+0000","last_clean_scrub_stamp":"2023-10-14T17:00:58.940431+0000","objects_scrubbed":1,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:49.082334+0000","scrub_duration":0.012391549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'610","reported_seq":708,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:15.396589+0000","last_change":"2023-10-14T17:00:15.396562+0000","last_active":"2023-10-14T17:00:15.396589+0000","last_peered":"2023-10-14T17:00:15.396589+0000","last_clean":"2023-10-14T17:00:15.396589+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T17:00:15.396589+0000","last_undegraded":"2023-10-14T17:00:15.396589+0000","last_fullsized":"2023-10-14T17:00:15.396589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'610","last_scrub_stamp":"2023-10-14T17:00:15.396476+0000","last_deep_scrub":"23'610","last_deep_scrub_stamp":"2023-10-14T17:00:15.396476+0000","last_clean_scrub_stamp":"2023-10-14T17:00:15.396476+0000","objects_scrubbed":10,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:15.745229+0000","scrub_duration":0.0089952309999999994,"objects_trimmed":0,"snaptrim_duration":0.038477224999999997,"stat_sum":{"num_bytes":16395,"num_objects":10,"num_object_clones":4,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":32,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"23'758","reported_seq":786,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:35.288431+0000","last_change":"2023-10-14T17:00:35.288382+0000","last_active":"2023-10-14T17:00:35.288431+0000","last_peered":"2023-10-14T17:00:35.288431+0000","last_clean":"2023-10-14T17:00:35.288431+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T17:00:35.288431+0000","last_undegraded":"2023-10-14T17:00:35.288431+0000","last_fullsized":"2023-10-14T17:00:35.288431+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'758","last_scrub_stamp":"2023-10-14T17:00:35.288276+0000","last_deep_scrub":"23'758","last_deep_scrub_stamp":"2023-10-14T17:00:35.288276+0000","last_clean_scrub_stamp":"2023-10-14T17:00:35.288276+0000","objects_scrubbed":1,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:38.977356+0000","scrub_duration":0.013787259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'595","reported_seq":660,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.930520+0000","last_change":"2023-10-14T16:59:40.048170+0000","last_active":"2023-10-14T16:59:54.930520+0000","last_peered":"2023-10-14T16:59:54.930520+0000","last_clean":"2023-10-14T16:59:54.930520+0000","last_became_active":"2023-10-14T16:55:45.058862+0000","last_became_peered":"2023-10-14T16:55:45.058862+0000","last_unstale":"2023-10-14T16:59:54.930520+0000","last_undegraded":"2023-10-14T16:59:54.930520+0000","last_fullsized":"2023-10-14T16:59:54.930520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071388894999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'773","reported_seq":801,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:25.221455+0000","last_change":"2023-10-14T17:00:25.221425+0000","last_active":"2023-10-14T17:00:25.221455+0000","last_peered":"2023-10-14T17:00:25.221455+0000","last_clean":"2023-10-14T17:00:25.221455+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T17:00:25.221455+0000","last_undegraded":"2023-10-14T17:00:25.221455+0000","last_fullsized":"2023-10-14T17:00:25.221455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'773","last_scrub_stamp":"2023-10-14T17:00:25.221335+0000","last_deep_scrub":"23'773","last_deep_scrub_stamp":"2023-10-14T17:00:25.221335+0000","last_clean_scrub_stamp":"2023-10-14T17:00:25.221335+0000","objects_scrubbed":2,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:38.876887+0000","scrub_duration":0.013685787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:36.456601+0000","last_change":"2023-10-14T17:00:36.456573+0000","last_active":"2023-10-14T17:00:36.456601+0000","last_peered":"2023-10-14T17:00:36.456601+0000","last_clean":"2023-10-14T17:00:36.456601+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T17:00:36.456601+0000","last_undegraded":"2023-10-14T17:00:36.456601+0000","last_fullsized":"2023-10-14T17:00:36.456601+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:36.456470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:36.456470+0000","last_clean_scrub_stamp":"2023-10-14T17:00:36.456470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:40.145551+0000","scrub_duration":0.0018203920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"23'520","reported_seq":597,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:51.598491+0000","last_change":"2023-10-14T17:00:51.598463+0000","last_active":"2023-10-14T17:00:51.598491+0000","last_peered":"2023-10-14T17:00:51.598491+0000","last_clean":"2023-10-14T17:00:51.598491+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T17:00:51.598491+0000","last_undegraded":"2023-10-14T17:00:51.598491+0000","last_fullsized":"2023-10-14T17:00:51.598491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'520","last_scrub_stamp":"2023-10-14T17:00:51.598362+0000","last_deep_scrub":"23'520","last_deep_scrub_stamp":"2023-10-14T17:00:51.598362+0000","last_clean_scrub_stamp":"2023-10-14T17:00:51.598362+0000","objects_scrubbed":2,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:00:50.039779+0000","scrub_duration":0.0040435319999999999,"objects_trimmed":0,"snaptrim_duration":0.061999158999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:24.168089+0000","last_change":"2023-10-14T17:00:24.168059+0000","last_active":"2023-10-14T17:00:24.168089+0000","last_peered":"2023-10-14T17:00:24.168089+0000","last_clean":"2023-10-14T17:00:24.168089+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T17:00:24.168089+0000","last_undegraded":"2023-10-14T17:00:24.168089+0000","last_fullsized":"2023-10-14T17:00:24.168089+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:24.167949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:24.167949+0000","last_clean_scrub_stamp":"2023-10-14T17:00:24.167949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:08.489825+0000","scrub_duration":0.0018258009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"23'50","reported_seq":78,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:32.698034+0000","last_change":"2023-10-14T17:00:32.697997+0000","last_active":"2023-10-14T17:00:32.698034+0000","last_peered":"2023-10-14T17:00:32.698034+0000","last_clean":"2023-10-14T17:00:32.698034+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T17:00:32.698034+0000","last_undegraded":"2023-10-14T17:00:32.698034+0000","last_fullsized":"2023-10-14T17:00:32.698034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'50","last_scrub_stamp":"2023-10-14T17:00:32.697897+0000","last_deep_scrub":"23'50","last_deep_scrub_stamp":"2023-10-14T17:00:32.697897+0000","last_clean_scrub_stamp":"2023-10-14T17:00:32.697897+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:11.987516+0000","scrub_duration":0.0026746600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'517","reported_seq":594,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.446285+0000","last_change":"2023-10-14T17:00:21.446258+0000","last_active":"2023-10-14T17:00:21.446285+0000","last_peered":"2023-10-14T17:00:21.446285+0000","last_clean":"2023-10-14T17:00:21.446285+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T17:00:21.446285+0000","last_undegraded":"2023-10-14T17:00:21.446285+0000","last_fullsized":"2023-10-14T17:00:21.446285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'517","last_scrub_stamp":"2023-10-14T17:00:21.446154+0000","last_deep_scrub":"23'517","last_deep_scrub_stamp":"2023-10-14T17:00:21.446154+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.446154+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:45.918009+0000","scrub_duration":0.0014583549999999999,"objects_trimmed":0,"snaptrim_duration":0.038513458,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:20.098656+0000","last_change":"2023-10-14T17:00:20.098627+0000","last_active":"2023-10-14T17:00:20.098656+0000","last_peered":"2023-10-14T17:00:20.098656+0000","last_clean":"2023-10-14T17:00:20.098656+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T17:00:20.098656+0000","last_undegraded":"2023-10-14T17:00:20.098656+0000","last_fullsized":"2023-10-14T17:00:20.098656+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:20.098523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:20.098523+0000","last_clean_scrub_stamp":"2023-10-14T17:00:20.098523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:44.570379+0000","scrub_duration":0.0018044700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"23'119","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:55.944842+0000","last_change":"2023-10-14T17:00:55.944816+0000","last_active":"2023-10-14T17:00:55.944842+0000","last_peered":"2023-10-14T17:00:55.944842+0000","last_clean":"2023-10-14T17:00:55.944842+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T17:00:55.944842+0000","last_undegraded":"2023-10-14T17:00:55.944842+0000","last_fullsized":"2023-10-14T17:00:55.944842+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2023-10-14T17:00:55.944732+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2023-10-14T17:00:55.944732+0000","last_clean_scrub_stamp":"2023-10-14T17:00:55.944732+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:56.400894+0000","scrub_duration":0.0044312520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'77","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:44.621788+0000","last_change":"2023-10-14T17:00:44.621759+0000","last_active":"2023-10-14T17:00:44.621788+0000","last_peered":"2023-10-14T17:00:44.621788+0000","last_clean":"2023-10-14T17:00:44.621788+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T17:00:44.621788+0000","last_undegraded":"2023-10-14T17:00:44.621788+0000","last_fullsized":"2023-10-14T17:00:44.621788+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'77","last_scrub_stamp":"2023-10-14T17:00:44.621662+0000","last_deep_scrub":"23'77","last_deep_scrub_stamp":"2023-10-14T17:00:44.621662+0000","last_clean_scrub_stamp":"2023-10-14T17:00:44.621662+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:41.660725+0000","scrub_duration":0.004793645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":646501,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":64,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'755","reported_seq":833,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:24.676945+0000","last_change":"2023-10-14T17:00:24.676899+0000","last_active":"2023-10-14T17:00:24.676945+0000","last_peered":"2023-10-14T17:00:24.676945+0000","last_clean":"2023-10-14T17:00:24.676945+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T17:00:24.676945+0000","last_undegraded":"2023-10-14T17:00:24.676945+0000","last_fullsized":"2023-10-14T17:00:24.676945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'755","last_scrub_stamp":"2023-10-14T17:00:24.676790+0000","last_deep_scrub":"23'755","last_deep_scrub_stamp":"2023-10-14T17:00:24.676790+0000","last_clean_scrub_stamp":"2023-10-14T17:00:24.676790+0000","objects_scrubbed":1,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:13.281090+0000","scrub_duration":0.0031994969999999999,"objects_trimmed":0,"snaptrim_duration":0.069884818000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:34.403364+0000","last_change":"2023-10-14T17:00:34.403336+0000","last_active":"2023-10-14T17:00:34.403364+0000","last_peered":"2023-10-14T17:00:34.403364+0000","last_clean":"2023-10-14T17:00:34.403364+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T17:00:34.403364+0000","last_undegraded":"2023-10-14T17:00:34.403364+0000","last_fullsized":"2023-10-14T17:00:34.403364+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:34.403232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:34.403232+0000","last_clean_scrub_stamp":"2023-10-14T17:00:34.403232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:05.118380+0000","scrub_duration":0.0023433809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'2238","reported_seq":2266,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:28.231608+0000","last_change":"2023-10-14T17:00:28.231580+0000","last_active":"2023-10-14T17:00:28.231608+0000","last_peered":"2023-10-14T17:00:28.231608+0000","last_clean":"2023-10-14T17:00:28.231608+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T17:00:28.231608+0000","last_undegraded":"2023-10-14T17:00:28.231608+0000","last_fullsized":"2023-10-14T17:00:28.231608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2238","last_scrub_stamp":"2023-10-14T17:00:28.231497+0000","last_deep_scrub":"23'2238","last_deep_scrub_stamp":"2023-10-14T17:00:28.231497+0000","last_clean_scrub_stamp":"2023-10-14T17:00:28.231497+0000","objects_scrubbed":3,"log_size":2238,"log_dups_size":0,"ondisk_log_size":2238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:16.835797+0000","scrub_duration":0.028927609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2227,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'634","reported_seq":711,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:45.357063+0000","last_change":"2023-10-14T17:00:45.357021+0000","last_active":"2023-10-14T17:00:45.357063+0000","last_peered":"2023-10-14T17:00:45.357063+0000","last_clean":"2023-10-14T17:00:45.357063+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T17:00:45.357063+0000","last_undegraded":"2023-10-14T17:00:45.357063+0000","last_fullsized":"2023-10-14T17:00:45.357063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'634","last_scrub_stamp":"2023-10-14T17:00:45.356915+0000","last_deep_scrub":"23'634","last_deep_scrub_stamp":"2023-10-14T17:00:45.356915+0000","last_clean_scrub_stamp":"2023-10-14T17:00:45.356915+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:26.594547+0000","scrub_duration":0.0020193810000000002,"objects_trimmed":0,"snaptrim_duration":0.047771027000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:50.829740+0000","last_change":"2023-10-14T17:00:50.829711+0000","last_active":"2023-10-14T17:00:50.829740+0000","last_peered":"2023-10-14T17:00:50.829740+0000","last_clean":"2023-10-14T17:00:50.829740+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T17:00:50.829740+0000","last_undegraded":"2023-10-14T17:00:50.829740+0000","last_fullsized":"2023-10-14T17:00:50.829740+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:50.829611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:50.829611+0000","last_clean_scrub_stamp":"2023-10-14T17:00:50.829611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:56.383252+0000","scrub_duration":0.0020121000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'1505","reported_seq":1533,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:33.281438+0000","last_change":"2023-10-14T17:00:33.281411+0000","last_active":"2023-10-14T17:00:33.281438+0000","last_peered":"2023-10-14T17:00:33.281438+0000","last_clean":"2023-10-14T17:00:33.281438+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T17:00:33.281438+0000","last_undegraded":"2023-10-14T17:00:33.281438+0000","last_fullsized":"2023-10-14T17:00:33.281438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1505","last_scrub_stamp":"2023-10-14T17:00:33.281327+0000","last_deep_scrub":"23'1505","last_deep_scrub_stamp":"2023-10-14T17:00:33.281327+0000","last_clean_scrub_stamp":"2023-10-14T17:00:33.281327+0000","objects_scrubbed":2,"log_size":1505,"log_dups_size":0,"ondisk_log_size":1505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:03.996475+0000","scrub_duration":0.022221726000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"23'761","reported_seq":837,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:08.665128+0000","last_change":"2023-10-14T17:00:08.665100+0000","last_active":"2023-10-14T17:00:08.665128+0000","last_peered":"2023-10-14T17:00:08.665128+0000","last_clean":"2023-10-14T17:00:08.665128+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T17:00:08.665128+0000","last_undegraded":"2023-10-14T17:00:08.665128+0000","last_fullsized":"2023-10-14T17:00:08.665128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'761","last_scrub_stamp":"2023-10-14T17:00:08.665003+0000","last_deep_scrub":"23'761","last_deep_scrub_stamp":"2023-10-14T17:00:08.665003+0000","last_clean_scrub_stamp":"2023-10-14T17:00:08.665003+0000","objects_scrubbed":2,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:48.894648+0000","scrub_duration":0.0039251659999999999,"objects_trimmed":0,"snaptrim_duration":0.057422879000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:53.939685+0000","last_change":"2023-10-14T17:00:53.939655+0000","last_active":"2023-10-14T17:00:53.939685+0000","last_peered":"2023-10-14T17:00:53.939685+0000","last_clean":"2023-10-14T17:00:53.939685+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T17:00:53.939685+0000","last_undegraded":"2023-10-14T17:00:53.939685+0000","last_fullsized":"2023-10-14T17:00:53.939685+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:53.939560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:53.939560+0000","last_clean_scrub_stamp":"2023-10-14T17:00:53.939560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:13.158089+0000","scrub_duration":0.001768836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'742","reported_seq":770,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:37.452608+0000","last_change":"2023-10-14T17:00:37.452579+0000","last_active":"2023-10-14T17:00:37.452608+0000","last_peered":"2023-10-14T17:00:37.452608+0000","last_clean":"2023-10-14T17:00:37.452608+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T17:00:37.452608+0000","last_undegraded":"2023-10-14T17:00:37.452608+0000","last_fullsized":"2023-10-14T17:00:37.452608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'742","last_scrub_stamp":"2023-10-14T17:00:37.452486+0000","last_deep_scrub":"23'742","last_deep_scrub_stamp":"2023-10-14T17:00:37.452486+0000","last_clean_scrub_stamp":"2023-10-14T17:00:37.452486+0000","objects_scrubbed":1,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:16.742105+0000","scrub_duration":0.012675855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'580","reported_seq":657,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:57.496266+0000","last_change":"2023-10-14T17:00:57.496233+0000","last_active":"2023-10-14T17:00:57.496266+0000","last_peered":"2023-10-14T17:00:57.496266+0000","last_clean":"2023-10-14T17:00:57.496266+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T17:00:57.496266+0000","last_undegraded":"2023-10-14T17:00:57.496266+0000","last_fullsized":"2023-10-14T17:00:57.496266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'580","last_scrub_stamp":"2023-10-14T17:00:57.496127+0000","last_deep_scrub":"23'580","last_deep_scrub_stamp":"2023-10-14T17:00:57.496127+0000","last_clean_scrub_stamp":"2023-10-14T17:00:57.496127+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:53:46.107876+0000","scrub_duration":0.001658896,"objects_trimmed":0,"snaptrim_duration":0.047665379000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:51.873706+0000","last_change":"2023-10-14T17:00:51.873678+0000","last_active":"2023-10-14T17:00:51.873706+0000","last_peered":"2023-10-14T17:00:51.873706+0000","last_clean":"2023-10-14T17:00:51.873706+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T17:00:51.873706+0000","last_undegraded":"2023-10-14T17:00:51.873706+0000","last_fullsized":"2023-10-14T17:00:51.873706+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:51.873575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:51.873575+0000","last_clean_scrub_stamp":"2023-10-14T17:00:51.873575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:16.724807+0000","scrub_duration":0.0018907679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'738","reported_seq":766,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:29.244189+0000","last_change":"2023-10-14T17:00:29.244159+0000","last_active":"2023-10-14T17:00:29.244189+0000","last_peered":"2023-10-14T17:00:29.244189+0000","last_clean":"2023-10-14T17:00:29.244189+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T17:00:29.244189+0000","last_undegraded":"2023-10-14T17:00:29.244189+0000","last_fullsized":"2023-10-14T17:00:29.244189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'738","last_scrub_stamp":"2023-10-14T17:00:29.244076+0000","last_deep_scrub":"23'738","last_deep_scrub_stamp":"2023-10-14T17:00:29.244076+0000","last_clean_scrub_stamp":"2023-10-14T17:00:29.244076+0000","objects_scrubbed":1,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:54.487165+0000","scrub_duration":0.012834883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'698","reported_seq":775,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:29.644827+0000","last_change":"2023-10-14T17:00:29.644796+0000","last_active":"2023-10-14T17:00:29.644827+0000","last_peered":"2023-10-14T17:00:29.644827+0000","last_clean":"2023-10-14T17:00:29.644827+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T17:00:29.644827+0000","last_undegraded":"2023-10-14T17:00:29.644827+0000","last_fullsized":"2023-10-14T17:00:29.644827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'698","last_scrub_stamp":"2023-10-14T17:00:29.644709+0000","last_deep_scrub":"23'698","last_deep_scrub_stamp":"2023-10-14T17:00:29.644709+0000","last_clean_scrub_stamp":"2023-10-14T17:00:29.644709+0000","objects_scrubbed":1,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:00.359857+0000","scrub_duration":0.0037276449999999999,"objects_trimmed":0,"snaptrim_duration":0.068678344000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:56.895608+0000","last_change":"2023-10-14T17:00:56.895584+0000","last_active":"2023-10-14T17:00:56.895608+0000","last_peered":"2023-10-14T17:00:56.895608+0000","last_clean":"2023-10-14T17:00:56.895608+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T17:00:56.895608+0000","last_undegraded":"2023-10-14T17:00:56.895608+0000","last_fullsized":"2023-10-14T17:00:56.895608+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:56.895495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:56.895495+0000","last_clean_scrub_stamp":"2023-10-14T17:00:56.895495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:49.998334+0000","scrub_duration":0.001570407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"23'1042","reported_seq":1070,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:43.521284+0000","last_change":"2023-10-14T17:00:43.521256+0000","last_active":"2023-10-14T17:00:43.521284+0000","last_peered":"2023-10-14T17:00:43.521284+0000","last_clean":"2023-10-14T17:00:43.521284+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T17:00:43.521284+0000","last_undegraded":"2023-10-14T17:00:43.521284+0000","last_fullsized":"2023-10-14T17:00:43.521284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1042","last_scrub_stamp":"2023-10-14T17:00:43.521155+0000","last_deep_scrub":"23'1042","last_deep_scrub_stamp":"2023-10-14T17:00:43.521155+0000","last_clean_scrub_stamp":"2023-10-14T17:00:43.521155+0000","objects_scrubbed":2,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:19.760658+0000","scrub_duration":0.021131402000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":8695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"23'755","reported_seq":832,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:39.294771+0000","last_change":"2023-10-14T17:00:39.294739+0000","last_active":"2023-10-14T17:00:39.294771+0000","last_peered":"2023-10-14T17:00:39.294771+0000","last_clean":"2023-10-14T17:00:39.294771+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T17:00:39.294771+0000","last_undegraded":"2023-10-14T17:00:39.294771+0000","last_fullsized":"2023-10-14T17:00:39.294771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'755","last_scrub_stamp":"2023-10-14T17:00:39.294633+0000","last_deep_scrub":"23'755","last_deep_scrub_stamp":"2023-10-14T17:00:39.294633+0000","last_clean_scrub_stamp":"2023-10-14T17:00:39.294633+0000","objects_scrubbed":1,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:20.360047+0000","scrub_duration":0.0038686810000000001,"objects_trimmed":0,"snaptrim_duration":0.015859669999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'741","reported_seq":769,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:46.615464+0000","last_change":"2023-10-14T17:00:46.615433+0000","last_active":"2023-10-14T17:00:46.615464+0000","last_peered":"2023-10-14T17:00:46.615464+0000","last_clean":"2023-10-14T17:00:46.615464+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T17:00:46.615464+0000","last_undegraded":"2023-10-14T17:00:46.615464+0000","last_fullsized":"2023-10-14T17:00:46.615464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'741","last_scrub_stamp":"2023-10-14T17:00:46.615342+0000","last_deep_scrub":"23'741","last_deep_scrub_stamp":"2023-10-14T17:00:46.615342+0000","last_clean_scrub_stamp":"2023-10-14T17:00:46.615342+0000","objects_scrubbed":1,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:31.980064+0000","scrub_duration":0.012945305000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'628","reported_seq":705,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:37.264296+0000","last_change":"2023-10-14T17:00:37.264268+0000","last_active":"2023-10-14T17:00:37.264296+0000","last_peered":"2023-10-14T17:00:37.264296+0000","last_clean":"2023-10-14T17:00:37.264296+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T17:00:37.264296+0000","last_undegraded":"2023-10-14T17:00:37.264296+0000","last_fullsized":"2023-10-14T17:00:37.264296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'628","last_scrub_stamp":"2023-10-14T17:00:37.264178+0000","last_deep_scrub":"23'628","last_deep_scrub_stamp":"2023-10-14T17:00:37.264178+0000","last_clean_scrub_stamp":"2023-10-14T17:00:37.264178+0000","objects_scrubbed":1,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:56.886434+0000","scrub_duration":0.0030037409999999999,"objects_trimmed":0,"snaptrim_duration":0.048042644000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'756","reported_seq":784,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:41.497508+0000","last_change":"2023-10-14T17:00:41.497480+0000","last_active":"2023-10-14T17:00:41.497508+0000","last_peered":"2023-10-14T17:00:41.497508+0000","last_clean":"2023-10-14T17:00:41.497508+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T17:00:41.497508+0000","last_undegraded":"2023-10-14T17:00:41.497508+0000","last_fullsized":"2023-10-14T17:00:41.497508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'756","last_scrub_stamp":"2023-10-14T17:00:41.497391+0000","last_deep_scrub":"23'756","last_deep_scrub_stamp":"2023-10-14T17:00:41.497391+0000","last_clean_scrub_stamp":"2023-10-14T17:00:41.497391+0000","objects_scrubbed":2,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:22.562805+0000","scrub_duration":0.014326548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"23'834","reported_seq":911,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:56.297998+0000","last_change":"2023-10-14T17:00:56.297971+0000","last_active":"2023-10-14T17:00:56.297998+0000","last_peered":"2023-10-14T17:00:56.297998+0000","last_clean":"2023-10-14T17:00:56.297998+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T17:00:56.297998+0000","last_undegraded":"2023-10-14T17:00:56.297998+0000","last_fullsized":"2023-10-14T17:00:56.297998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'834","last_scrub_stamp":"2023-10-14T17:00:56.297867+0000","last_deep_scrub":"23'834","last_deep_scrub_stamp":"2023-10-14T17:00:56.297867+0000","last_clean_scrub_stamp":"2023-10-14T17:00:56.297867+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:00:54.739284+0000","scrub_duration":0.0021536770000000001,"objects_trimmed":0,"snaptrim_duration":0.038542571999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2260","reported_seq":2288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:19.853834+0000","last_change":"2023-10-14T17:00:19.853808+0000","last_active":"2023-10-14T17:00:19.853834+0000","last_peered":"2023-10-14T17:00:19.853834+0000","last_clean":"2023-10-14T17:00:19.853834+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T17:00:19.853834+0000","last_undegraded":"2023-10-14T17:00:19.853834+0000","last_fullsized":"2023-10-14T17:00:19.853834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2260","last_scrub_stamp":"2023-10-14T17:00:19.853728+0000","last_deep_scrub":"23'2260","last_deep_scrub_stamp":"2023-10-14T17:00:19.853728+0000","last_clean_scrub_stamp":"2023-10-14T17:00:19.853728+0000","objects_scrubbed":4,"log_size":2260,"log_dups_size":0,"ondisk_log_size":2260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:08.458027+0000","scrub_duration":0.035936590999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2245,"num_write_kb":13441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"23'673","reported_seq":750,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:29.414546+0000","last_change":"2023-10-14T17:00:29.414519+0000","last_active":"2023-10-14T17:00:29.414546+0000","last_peered":"2023-10-14T17:00:29.414546+0000","last_clean":"2023-10-14T17:00:29.414546+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T17:00:29.414546+0000","last_undegraded":"2023-10-14T17:00:29.414546+0000","last_fullsized":"2023-10-14T17:00:29.414546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'673","last_scrub_stamp":"2023-10-14T17:00:29.414416+0000","last_deep_scrub":"23'673","last_deep_scrub_stamp":"2023-10-14T17:00:29.414416+0000","last_clean_scrub_stamp":"2023-10-14T17:00:29.414416+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:18.018716+0000","scrub_duration":0.0018134749999999999,"objects_trimmed":0,"snaptrim_duration":0.038619158000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3075","reported_seq":3103,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:42.686548+0000","last_change":"2023-10-14T17:00:42.686498+0000","last_active":"2023-10-14T17:00:42.686548+0000","last_peered":"2023-10-14T17:00:42.686548+0000","last_clean":"2023-10-14T17:00:42.686548+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T17:00:42.686548+0000","last_undegraded":"2023-10-14T17:00:42.686548+0000","last_fullsized":"2023-10-14T17:00:42.686548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3075","last_scrub_stamp":"2023-10-14T17:00:42.686353+0000","last_deep_scrub":"23'3075","last_deep_scrub_stamp":"2023-10-14T17:00:42.686353+0000","last_clean_scrub_stamp":"2023-10-14T17:00:42.686353+0000","objects_scrubbed":2,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:23.923986+0000","scrub_duration":0.017120115000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5336939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3065,"num_write_kb":7243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"23'767","reported_seq":844,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:13.628534+0000","last_change":"2023-10-14T17:00:13.628505+0000","last_active":"2023-10-14T17:00:13.628534+0000","last_peered":"2023-10-14T17:00:13.628534+0000","last_clean":"2023-10-14T17:00:13.628534+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T17:00:13.628534+0000","last_undegraded":"2023-10-14T17:00:13.628534+0000","last_fullsized":"2023-10-14T17:00:13.628534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'767","last_scrub_stamp":"2023-10-14T17:00:13.628407+0000","last_deep_scrub":"23'767","last_deep_scrub_stamp":"2023-10-14T17:00:13.628407+0000","last_clean_scrub_stamp":"2023-10-14T17:00:13.628407+0000","objects_scrubbed":1,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:21.508614+0000","scrub_duration":0.0032656299999999998,"objects_trimmed":0,"snaptrim_duration":0.068737623999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'788","reported_seq":816,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:38.718974+0000","last_change":"2023-10-14T17:00:38.718944+0000","last_active":"2023-10-14T17:00:38.718974+0000","last_peered":"2023-10-14T17:00:38.718974+0000","last_clean":"2023-10-14T17:00:38.718974+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T17:00:38.718974+0000","last_undegraded":"2023-10-14T17:00:38.718974+0000","last_fullsized":"2023-10-14T17:00:38.718974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'788","last_scrub_stamp":"2023-10-14T17:00:38.718839+0000","last_deep_scrub":"23'788","last_deep_scrub_stamp":"2023-10-14T17:00:38.718839+0000","last_clean_scrub_stamp":"2023-10-14T17:00:38.718839+0000","objects_scrubbed":4,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:14.958342+0000","scrub_duration":0.020417911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389162,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'697","reported_seq":772,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:25.463530+0000","last_change":"2023-10-14T17:00:25.463505+0000","last_active":"2023-10-14T17:00:25.463530+0000","last_peered":"2023-10-14T17:00:25.463530+0000","last_clean":"2023-10-14T17:00:25.463530+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T17:00:25.463530+0000","last_undegraded":"2023-10-14T17:00:25.463530+0000","last_fullsized":"2023-10-14T17:00:25.463530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'697","last_scrub_stamp":"2023-10-14T17:00:25.463404+0000","last_deep_scrub":"23'697","last_deep_scrub_stamp":"2023-10-14T17:00:25.463404+0000","last_clean_scrub_stamp":"2023-10-14T17:00:25.463404+0000","objects_scrubbed":4,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:09.785280+0000","scrub_duration":0.0057845700000000002,"objects_trimmed":0,"snaptrim_duration":0.026701018,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"23'673","reported_seq":749,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:59.255258+0000","last_change":"2023-10-14T17:00:59.255217+0000","last_active":"2023-10-14T17:00:59.255258+0000","last_peered":"2023-10-14T17:00:59.255258+0000","last_clean":"2023-10-14T17:00:59.255258+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T17:00:59.255258+0000","last_undegraded":"2023-10-14T17:00:59.255258+0000","last_fullsized":"2023-10-14T17:00:59.255258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'673","last_scrub_stamp":"2023-10-14T17:00:59.255080+0000","last_deep_scrub":"23'673","last_deep_scrub_stamp":"2023-10-14T17:00:59.255080+0000","last_clean_scrub_stamp":"2023-10-14T17:00:59.255080+0000","objects_scrubbed":4,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:04.808721+0000","scrub_duration":0.0063237620000000001,"objects_trimmed":0,"snaptrim_duration":0.01972498,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"23'709","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:07.161938+0000","last_change":"2023-10-14T17:00:07.161914+0000","last_active":"2023-10-14T17:00:07.161938+0000","last_peered":"2023-10-14T17:00:07.161938+0000","last_clean":"2023-10-14T17:00:07.161938+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T17:00:07.161938+0000","last_undegraded":"2023-10-14T17:00:07.161938+0000","last_fullsized":"2023-10-14T17:00:07.161938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'709","last_scrub_stamp":"2023-10-14T17:00:07.161847+0000","last_deep_scrub":"23'709","last_deep_scrub_stamp":"2023-10-14T17:00:07.161847+0000","last_clean_scrub_stamp":"2023-10-14T17:00:07.161847+0000","objects_scrubbed":3,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:33:35.683711+0000","scrub_duration":0.003594294,"objects_trimmed":0,"snaptrim_duration":0.012044934,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"23'777","reported_seq":853,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:31.885442+0000","last_change":"2023-10-14T17:00:31.885415+0000","last_active":"2023-10-14T17:00:31.885442+0000","last_peered":"2023-10-14T17:00:31.885442+0000","last_clean":"2023-10-14T17:00:31.885442+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T17:00:31.885442+0000","last_undegraded":"2023-10-14T17:00:31.885442+0000","last_fullsized":"2023-10-14T17:00:31.885442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'777","last_scrub_stamp":"2023-10-14T17:00:31.885334+0000","last_deep_scrub":"23'777","last_deep_scrub_stamp":"2023-10-14T17:00:31.885334+0000","last_clean_scrub_stamp":"2023-10-14T17:00:31.885334+0000","objects_scrubbed":2,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:12.950748+0000","scrub_duration":0.0045303030000000003,"objects_trimmed":0,"snaptrim_duration":0.058085603999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"23'606","reported_seq":682,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.715441+0000","last_change":"2023-10-14T17:00:21.715409+0000","last_active":"2023-10-14T17:00:21.715441+0000","last_peered":"2023-10-14T17:00:21.715441+0000","last_clean":"2023-10-14T17:00:21.715441+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T17:00:21.715441+0000","last_undegraded":"2023-10-14T17:00:21.715441+0000","last_fullsized":"2023-10-14T17:00:21.715441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'606","last_scrub_stamp":"2023-10-14T17:00:21.715312+0000","last_deep_scrub":"23'606","last_deep_scrub_stamp":"2023-10-14T17:00:21.715312+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.715312+0000","objects_scrubbed":6,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:35.370865+0000","scrub_duration":0.0068255670000000003,"objects_trimmed":0,"snaptrim_duration":0.070423702000000005,"stat_sum":{"num_bytes":8224,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"23'396","reported_seq":472,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.082031+0000","last_change":"2023-10-14T17:00:14.081988+0000","last_active":"2023-10-14T17:00:14.082031+0000","last_peered":"2023-10-14T17:00:14.082031+0000","last_clean":"2023-10-14T17:00:14.082031+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T17:00:14.082031+0000","last_undegraded":"2023-10-14T17:00:14.082031+0000","last_fullsized":"2023-10-14T17:00:14.082031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'396","last_scrub_stamp":"2023-10-14T17:00:14.081897+0000","last_deep_scrub":"23'396","last_deep_scrub_stamp":"2023-10-14T17:00:14.081897+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.081897+0000","objects_scrubbed":2,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:21:14.426123+0000","scrub_duration":0.0038898180000000002,"objects_trimmed":0,"snaptrim_duration":0.048708460000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":30,"num_read_kb":20,"num_write":108,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41438,"ondisk_log_size":41438,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":190534230,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":33641,"num_write_kb":203675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381124608,"data_stored":381068460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33908,"ondisk_log_size":33908,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705744,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396524,"kb_used_data":86948,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93975316,"statfs":{"total":96636764160,"available":96230723584,"internally_reserved":0,"allocated":89034752,"data_stored":88829719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 17:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39300000000000002,"15min":0.41699999999999998},"min":{"1min":0.33000000000000002,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.62},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.39400000000000002,"15min":0.42499999999999999},"min":{"1min":0.28499999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56299999999999994}]},{"osd":1,"last update":"Sat Oct 14 17:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.82399999999999995,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.44900000000000001,"15min":0.47099999999999997},"min":{"1min":0.29699999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.79700000000000004,"5min":2.194,"15min":2.194},"last":0.70199999999999996}]},{"osd":2,"last update":"Sat Oct 14 17:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.28799999999999998,"15min":0.33600000000000002},"min":{"1min":0.245,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.442,"5min":0.45200000000000001,"15min":0.47699999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.34300000000000003},"min":{"1min":0.26700000000000002,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.49299999999999999},"last":0.35999999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705744,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426368,"kb_used_data":116792,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93945472,"statfs":{"total":96636764160,"available":96200163328,"internally_reserved":0,"allocated":119595008,"data_stored":119367674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 17:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47299999999999998,"15min":0.45300000000000001},"min":{"1min":0.32900000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66400000000000003,"5min":5.992,"15min":5.992},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51000000000000001,"15min":0.46400000000000002},"min":{"1min":0.35999999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.60299999999999998,"5min":9.2620000000000005,"15min":9.2620000000000005},"last":0.41999999999999998}]},{"osd":1,"last update":"Sat Oct 14 17:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.34799999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61299999999999999,"5min":6.266,"15min":6.266},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.496},"min":{"1min":0.38900000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64100000000000001,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Sat Oct 14 17:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32300000000000001},"min":{"1min":0.27500000000000002,"5min":0.16,"15min":0.16},"max":{"1min":0.61199999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.35999999999999999},"min":{"1min":0.29499999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.56699999999999995,"5min":6.3170000000000002,"15min":6.3170000000000002},"last":0.52300000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397668,"kb_used_data":92188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":93974172,"statfs":{"total":96636764160,"available":96229552128,"internally_reserved":0,"allocated":94400512,"data_stored":94213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.27000000000000002,"15min":0.29499999999999998},"min":{"1min":0.23200000000000001,"5min":0.153,"15min":0.153},"max":{"1min":0.40699999999999997,"5min":0.443,"15min":0.443},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.28299999999999997,"15min":0.30599999999999999},"min":{"1min":0.22800000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.39500000000000002,"5min":0.50800000000000001,"15min":0.53100000000000003},"last":0.29499999999999998}]},{"osd":2,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59899999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.46300000000000002},"min":{"1min":0.34999999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41499999999999998,"15min":0.46800000000000003},"min":{"1min":0.36299999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68999999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42199999999999999,"15min":0.47499999999999998},"min":{"1min":0.375,"5min":0.25,"15min":0.25},"max":{"1min":0.63900000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.52600000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705743,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388312,"kb_used_data":78736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93983528,"statfs":{"total":96636764160,"available":96239132672,"internally_reserved":0,"allocated":80625664,"data_stored":80427560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.27600000000000002},"min":{"1min":0.20499999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.42799999999999999,"5min":0.441,"15min":0.441},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.30099999999999999},"min":{"1min":0.23799999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.25700000000000001}]},{"osd":2,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.443,"15min":0.46300000000000002},"min":{"1min":0.37,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.42899999999999999,"15min":0.46300000000000002},"min":{"1min":0.32600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.68400000000000005},"last":0.34799999999999998}]},{"osd":3,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.434,"15min":0.45800000000000002},"min":{"1min":0.39200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.48899999999999999},"min":{"1min":0.36599999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69199999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.38500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94076928,"data_stored":94064538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":79691776,"data_stored":79691776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":119250944,"data_stored":119230438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88104960,"data_stored":88081708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":53391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":73798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T17:01:08.191 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:08.192 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:08.192 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:08.193 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:08.193 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:08.194 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:08.194 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:08.195 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:08.195 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:08.195 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:08.196 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:08.197 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T17:01:16.073 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:16.076 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:16.080 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:28.201 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T17:01:28.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.332+0000 7f5f14c27700 1 Processor -- start 2023-10-14T17:01:28.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.332+0000 7f5f14c27700 1 -- start start 2023-10-14T17:01:28.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f14c27700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100a25c0 0x7f5f100a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:28.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f14c27700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5f1013c1a0 0x7f5f1013e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:28.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f14c27700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f100a2df0 con 0x7f5f100a6940 2023-10-14T17:01:28.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f14c27700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f101338f0 con 0x7f5f1013c1a0 2023-10-14T17:01:28.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f14c27700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f10133ae0 con 0x7f5f100a25c0 2023-10-14T17:01:28.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f0dd9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100a25c0 0x7f5f100a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f0ed9d700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5f1013c1a0 0x7f5f1013e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f0dd9b700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100a25c0 0x7f5f100a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.8:58524/0 (socket says 172.21.15.8:58524) 2023-10-14T17:01:28.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f0dd9b700 1 -- 172.21.15.8:0/4268385572 learned_addr learned my addr 172.21.15.8:0/4268385572 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:28.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f0e59c700 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5f100a6940 0x7f5f10133f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.8:47198/0 (socket says 172.21.15.8:47198) 2023-10-14T17:01:28.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f0dd9b700 1 -- 172.21.15.8:0/4268385572 >> v2:172.21.15.155:3300/0 conn(0x7f5f1013c1a0 msgr2=0x7f5f1013e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:28.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f0dd9b700 1 --2- 172.21.15.8:0/4268385572 >> v2:172.21.15.155:3300/0 conn(0x7f5f1013c1a0 0x7f5f1013e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:28.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.333+0000 7f5f0dd9b700 1 -- 172.21.15.8:0/4268385572 >> v1:172.21.15.155:6789/0 conn(0x7f5f100a6940 legacy=0x7f5f10133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:28.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.334+0000 7f5f0dd9b700 1 -- 172.21.15.8:0/4268385572 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f100a1b90 con 0x7f5f100a25c0 2023-10-14T17:01:28.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.334+0000 7f5f0ed9d700 1 --2- 172.21.15.8:0/4268385572 >> v2:172.21.15.155:3300/0 conn(0x7f5f1013c1a0 0x7f5f1013e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T17:01:28.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.334+0000 7f5f0dd9b700 1 --2- 172.21.15.8:0/4268385572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100a25c0 0x7f5f100a1310 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80099b0 tx=0x7f5ef8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3559b3fd530979cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:28.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.334+0000 7f5f0d59a700 1 -- 172.21.15.8:0/4268385572 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8009ea0 con 0x7f5f100a25c0 2023-10-14T17:01:28.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.334+0000 7f5f0d59a700 1 -- 172.21.15.8:0/4268385572 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef800b760 con 0x7f5f100a25c0 2023-10-14T17:01:28.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.334+0000 7f5f0d59a700 1 -- 172.21.15.8:0/4268385572 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800bb20 con 0x7f5f100a25c0 2023-10-14T17:01:28.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.334+0000 7f5f14c27700 1 -- 172.21.15.8:0/4268385572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100a25c0 msgr2=0x7f5f100a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:28.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.334+0000 7f5f14c27700 1 --2- 172.21.15.8:0/4268385572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100a25c0 0x7f5f100a1310 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80099b0 tx=0x7f5ef8009250 comp rx=0 tx=0).stop 2023-10-14T17:01:28.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.335+0000 7f5f14c27700 1 -- 172.21.15.8:0/4268385572 shutdown_connections 2023-10-14T17:01:28.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.335+0000 7f5f14c27700 1 --2- 172.21.15.8:0/4268385572 >> v2:172.21.15.155:3300/0 conn(0x7f5f1013c1a0 0x7f5f1013e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.335+0000 7f5f14c27700 1 --2- 172.21.15.8:0/4268385572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f100a25c0 0x7f5f100a1310 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.335+0000 7f5f14c27700 1 -- 172.21.15.8:0/4268385572 >> 172.21.15.8:0/4268385572 conn(0x7f5f1006acd0 msgr2=0x7f5f100701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.335+0000 7f5f14c27700 1 -- 172.21.15.8:0/4268385572 shutdown_connections 2023-10-14T17:01:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.335+0000 7f5f14c27700 1 -- 172.21.15.8:0/4268385572 wait complete. 2023-10-14T17:01:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.335+0000 7f5f14c27700 1 Processor -- start 2023-10-14T17:01:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.335+0000 7f5f14c27700 1 -- start start 2023-10-14T17:01:28.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f14c27700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f100a25c0 0x7f5f1013b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:28.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f14c27700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f1013c1a0 0x7f5f10095c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:28.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f14c27700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f10143da0 0x7f5f10144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:28.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f14c27700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f10143ae0 con 0x7f5f100a25c0 2023-10-14T17:01:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f14c27700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f10096620 con 0x7f5f1013c1a0 2023-10-14T17:01:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f14c27700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f101315c0 con 0x7f5f10143da0 2023-10-14T17:01:28.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f0e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f100a25c0 0x7f5f1013b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:28.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f0e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f100a25c0 0x7f5f1013b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37112/0 (socket says 172.21.15.8:37112) 2023-10-14T17:01:28.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f0e59c700 1 -- 172.21.15.8:0/775821235 learned_addr learned my addr 172.21.15.8:0/775821235 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:28.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f0dd9b700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f1013c1a0 0x7f5f10095c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:28.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f0ed9d700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f10143da0 0x7f5f10144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:28.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f0e59c700 1 -- 172.21.15.8:0/775821235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f10143da0 msgr2=0x7f5f10144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:28.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f0e59c700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f10143da0 0x7f5f10144200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:28.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f0e59c700 1 -- 172.21.15.8:0/775821235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f1013c1a0 msgr2=0x7f5f10095c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f0e59c700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f1013c1a0 0x7f5f10095c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f0e59c700 1 -- 172.21.15.8:0/775821235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f08009420 con 0x7f5f100a25c0 2023-10-14T17:01:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f0dd9b700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f1013c1a0 0x7f5f10095c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:01:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.336+0000 7f5f0ed9d700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f10143da0 0x7f5f10144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:01:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.337+0000 7f5f0e59c700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f100a25c0 0x7f5f1013b5a0 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000cf40 tx=0x7f5f00001ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.337+0000 7f5f067fc700 1 -- 172.21.15.8:0/775821235 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f00005df0 con 0x7f5f100a25c0 2023-10-14T17:01:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.337+0000 7f5f067fc700 1 -- 172.21.15.8:0/775821235 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0000aaa0 con 0x7f5f100a25c0 2023-10-14T17:01:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.337+0000 7f5f14c27700 1 -- 172.21.15.8:0/775821235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef80094f0 con 0x7f5f100a25c0 2023-10-14T17:01:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.337+0000 7f5f067fc700 1 -- 172.21.15.8:0/775821235 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0000ae60 con 0x7f5f100a25c0 2023-10-14T17:01:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.337+0000 7f5f14c27700 1 -- 172.21.15.8:0/775821235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1013a650 con 0x7f5f100a25c0 2023-10-14T17:01:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.338+0000 7f5f14c27700 1 -- 172.21.15.8:0/775821235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f100961c0 con 0x7f5f100a25c0 2023-10-14T17:01:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.338+0000 7f5f067fc700 1 -- 172.21.15.8:0/775821235 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f00007300 con 0x7f5f100a25c0 2023-10-14T17:01:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.339+0000 7f5f067fc700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5ef0066f30 0x7f5ef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.339+0000 7f5f067fc700 1 -- 172.21.15.8:0/775821235 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f5f000843a0 con 0x7f5f100a25c0 2023-10-14T17:01:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.339+0000 7f5f0dd9b700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5ef0066f30 0x7f5ef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.339+0000 7f5f0dd9b700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5ef0066f30 0x7f5ef00693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80099b0 tx=0x7f5ef8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.343+0000 7f5f067fc700 1 -- 172.21.15.8:0/775821235 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f100961c0 con 0x7f5f100a25c0 2023-10-14T17:01:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.531+0000 7f5f14c27700 1 -- 172.21.15.8:0/775821235 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f100964b0 con 0x7f5ef0066f30 2023-10-14T17:01:28.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.538+0000 7f5f067fc700 1 -- 172.21.15.8:0/775821235 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281279 (secure 0 0 0) 0x7f5f100964b0 con 0x7f5ef0066f30 2023-10-14T17:01:28.543 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:01:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.542+0000 7f5f14c27700 1 -- 172.21.15.8:0/775821235 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5ef0066f30 msgr2=0x7f5ef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.542+0000 7f5f14c27700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5ef0066f30 0x7f5ef00693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80099b0 tx=0x7f5ef8016000 comp rx=0 tx=0).stop 2023-10-14T17:01:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.542+0000 7f5f14c27700 1 -- 172.21.15.8:0/775821235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f100a25c0 msgr2=0x7f5f1013b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.542+0000 7f5f14c27700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f100a25c0 0x7f5f1013b5a0 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000cf40 tx=0x7f5f00001ce0 comp rx=0 tx=0).stop 2023-10-14T17:01:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.542+0000 7f5f14c27700 1 -- 172.21.15.8:0/775821235 shutdown_connections 2023-10-14T17:01:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.542+0000 7f5f14c27700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f5ef0066f30 0x7f5ef00693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:28.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.542+0000 7f5f14c27700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f10143da0 0x7f5f10144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:28.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.542+0000 7f5f14c27700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f100a25c0 0x7f5f1013b5a0 unknown :-1 s=CLOSED pgs=2496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:28.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.542+0000 7f5f14c27700 1 --2- 172.21.15.8:0/775821235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f1013c1a0 0x7f5f10095c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:28.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.542+0000 7f5f14c27700 1 -- 172.21.15.8:0/775821235 >> 172.21.15.8:0/775821235 conn(0x7f5f1006acd0 msgr2=0x7f5f10130c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:28.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.542+0000 7f5f14c27700 1 -- 172.21.15.8:0/775821235 shutdown_connections 2023-10-14T17:01:28.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:28.542+0000 7f5f14c27700 1 -- 172.21.15.8:0/775821235 wait complete. 2023-10-14T17:01:28.550 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T17:01:28.554 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2023-10-14T17:01:28.072146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":191251786,"num_objects":152,"num_object_clones":21,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":8,"num_read":210,"num_read_kb":798,"num_write":33908,"num_write_kb":206280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75474,"ondisk_log_size":75474,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1608872,"kb_used_data":374664,"kb_used_omap":0,"kb_used_meta":1234176,"kb_avail":375878488,"statfs":{"total":386547056640,"available":384899571712,"internally_reserved":0,"allocated":383655936,"data_stored":382838952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1263796224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002918"},"pg_stats":[{"pgid":"4.3f","version":"23'645","reported_seq":722,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:06.455532+0000","last_change":"2023-10-14T17:01:06.455487+0000","last_active":"2023-10-14T17:01:06.455532+0000","last_peered":"2023-10-14T17:01:06.455532+0000","last_clean":"2023-10-14T17:01:06.455532+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T17:01:06.455532+0000","last_undegraded":"2023-10-14T17:01:06.455532+0000","last_fullsized":"2023-10-14T17:01:06.455532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'645","last_scrub_stamp":"2023-10-14T17:01:06.455340+0000","last_deep_scrub":"23'645","last_deep_scrub_stamp":"2023-10-14T17:01:06.455340+0000","last_clean_scrub_stamp":"2023-10-14T17:01:06.455340+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:43.534168+0000","scrub_duration":0.001558242,"objects_trimmed":0,"snaptrim_duration":0.070427155000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"23'746","reported_seq":823,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:07.117624+0000","last_change":"2023-10-14T17:01:07.117586+0000","last_active":"2023-10-14T17:01:07.117624+0000","last_peered":"2023-10-14T17:01:07.117624+0000","last_clean":"2023-10-14T17:01:07.117624+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T17:01:07.117624+0000","last_undegraded":"2023-10-14T17:01:07.117624+0000","last_fullsized":"2023-10-14T17:01:07.117624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'746","last_scrub_stamp":"2023-10-14T17:01:07.117423+0000","last_deep_scrub":"23'746","last_deep_scrub_stamp":"2023-10-14T17:01:07.117423+0000","last_clean_scrub_stamp":"2023-10-14T17:01:07.117423+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:57.259326+0000","scrub_duration":0.002078969,"objects_trimmed":0,"snaptrim_duration":0.038749005000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'628","reported_seq":695,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.933938+0000","last_change":"2023-10-14T16:59:40.031831+0000","last_active":"2023-10-14T16:59:54.933938+0000","last_peered":"2023-10-14T16:59:54.933938+0000","last_clean":"2023-10-14T16:59:54.933938+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T16:59:54.933938+0000","last_undegraded":"2023-10-14T16:59:54.933938+0000","last_fullsized":"2023-10-14T16:59:54.933938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058152503000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"23'646","reported_seq":723,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:04.212672+0000","last_change":"2023-10-14T17:01:04.212641+0000","last_active":"2023-10-14T17:01:04.212672+0000","last_peered":"2023-10-14T17:01:04.212672+0000","last_clean":"2023-10-14T17:01:04.212672+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T17:01:04.212672+0000","last_undegraded":"2023-10-14T17:01:04.212672+0000","last_fullsized":"2023-10-14T17:01:04.212672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'646","last_scrub_stamp":"2023-10-14T17:01:04.212545+0000","last_deep_scrub":"23'646","last_deep_scrub_stamp":"2023-10-14T17:01:04.212545+0000","last_clean_scrub_stamp":"2023-10-14T17:01:04.212545+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:17:04.668707+0000","scrub_duration":0.0018472569999999999,"objects_trimmed":0,"snaptrim_duration":0.033834213000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"23'522","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:02.501798+0000","last_change":"2023-10-14T17:01:02.501748+0000","last_active":"2023-10-14T17:01:02.501798+0000","last_peered":"2023-10-14T17:01:02.501798+0000","last_clean":"2023-10-14T17:01:02.501798+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T17:01:02.501798+0000","last_undegraded":"2023-10-14T17:01:02.501798+0000","last_fullsized":"2023-10-14T17:01:02.501798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'522","last_scrub_stamp":"2023-10-14T17:01:02.501640+0000","last_deep_scrub":"23'522","last_deep_scrub_stamp":"2023-10-14T17:01:02.501640+0000","last_clean_scrub_stamp":"2023-10-14T17:01:02.501640+0000","objects_scrubbed":1,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:52.643543+0000","scrub_duration":0.0031778309999999999,"objects_trimmed":0,"snaptrim_duration":0.070258685000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'532","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T16:59:54.918368+0000","last_change":"2023-10-14T16:59:40.032103+0000","last_active":"2023-10-14T16:59:54.918368+0000","last_peered":"2023-10-14T16:59:54.918368+0000","last_clean":"2023-10-14T16:59:54.918368+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T16:59:54.918368+0000","last_undegraded":"2023-10-14T16:59:54.918368+0000","last_fullsized":"2023-10-14T16:59:54.918368+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T16:54:54.072525+0000","last_clean_scrub_stamp":"2023-10-14T16:54:54.072525+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058053194000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'963","reported_seq":1040,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:27.083377+0000","last_change":"2023-10-14T17:01:27.083347+0000","last_active":"2023-10-14T17:01:27.083377+0000","last_peered":"2023-10-14T17:01:27.083377+0000","last_clean":"2023-10-14T17:01:27.083377+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T17:01:27.083377+0000","last_undegraded":"2023-10-14T17:01:27.083377+0000","last_fullsized":"2023-10-14T17:01:27.083377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'963","last_scrub_stamp":"2023-10-14T17:01:27.083249+0000","last_deep_scrub":"23'963","last_deep_scrub_stamp":"2023-10-14T17:01:27.083249+0000","last_clean_scrub_stamp":"2023-10-14T17:01:27.083249+0000","objects_scrubbed":1,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:46.485470+0000","scrub_duration":0.003211719,"objects_trimmed":0,"snaptrim_duration":0.058433710999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'666","reported_seq":743,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:19.991041+0000","last_change":"2023-10-14T17:01:19.990994+0000","last_active":"2023-10-14T17:01:19.991041+0000","last_peered":"2023-10-14T17:01:19.991041+0000","last_clean":"2023-10-14T17:01:19.991041+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T17:01:19.991041+0000","last_undegraded":"2023-10-14T17:01:19.991041+0000","last_fullsized":"2023-10-14T17:01:19.991041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'666","last_scrub_stamp":"2023-10-14T17:01:19.990847+0000","last_deep_scrub":"23'666","last_deep_scrub_stamp":"2023-10-14T17:01:19.990847+0000","last_clean_scrub_stamp":"2023-10-14T17:01:19.990847+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:39:38.364521+0000","scrub_duration":0.0018583849999999999,"objects_trimmed":0,"snaptrim_duration":0.057530364000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"23'727","reported_seq":804,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:00.537609+0000","last_change":"2023-10-14T17:01:00.537582+0000","last_active":"2023-10-14T17:01:00.537609+0000","last_peered":"2023-10-14T17:01:00.537609+0000","last_clean":"2023-10-14T17:01:00.537609+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T17:01:00.537609+0000","last_undegraded":"2023-10-14T17:01:00.537609+0000","last_fullsized":"2023-10-14T17:01:00.537609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'727","last_scrub_stamp":"2023-10-14T17:01:00.537474+0000","last_deep_scrub":"23'727","last_deep_scrub_stamp":"2023-10-14T17:01:00.537474+0000","last_clean_scrub_stamp":"2023-10-14T17:01:00.537474+0000","objects_scrubbed":1,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:53.640313+0000","scrub_duration":0.0032466209999999999,"objects_trimmed":0,"snaptrim_duration":0.070350251000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'592","reported_seq":669,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:18.981743+0000","last_change":"2023-10-14T17:01:18.981700+0000","last_active":"2023-10-14T17:01:18.981743+0000","last_peered":"2023-10-14T17:01:18.981743+0000","last_clean":"2023-10-14T17:01:18.981743+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T17:01:18.981743+0000","last_undegraded":"2023-10-14T17:01:18.981743+0000","last_fullsized":"2023-10-14T17:01:18.981743+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'592","last_scrub_stamp":"2023-10-14T17:01:18.981601+0000","last_deep_scrub":"23'592","last_deep_scrub_stamp":"2023-10-14T17:01:18.981601+0000","last_clean_scrub_stamp":"2023-10-14T17:01:18.981601+0000","objects_scrubbed":1,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:28.399675+0000","scrub_duration":0.0037309090000000001,"objects_trimmed":0,"snaptrim_duration":0.057828565999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"23'506","reported_seq":582,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:02.265952+0000","last_change":"2023-10-14T17:01:02.265922+0000","last_active":"2023-10-14T17:01:02.265952+0000","last_peered":"2023-10-14T17:01:02.265952+0000","last_clean":"2023-10-14T17:01:02.265952+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T17:01:02.265952+0000","last_undegraded":"2023-10-14T17:01:02.265952+0000","last_fullsized":"2023-10-14T17:01:02.265952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'506","last_scrub_stamp":"2023-10-14T17:01:02.265830+0000","last_deep_scrub":"23'506","last_deep_scrub_stamp":"2023-10-14T17:01:02.265830+0000","last_clean_scrub_stamp":"2023-10-14T17:01:02.265830+0000","objects_scrubbed":2,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:21.484359+0000","scrub_duration":0.0038646399999999999,"objects_trimmed":0,"snaptrim_duration":0.039012109000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"23'511","reported_seq":588,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:58.478777+0000","last_change":"2023-10-14T17:00:58.478747+0000","last_active":"2023-10-14T17:00:58.478777+0000","last_peered":"2023-10-14T17:00:58.478777+0000","last_clean":"2023-10-14T17:00:58.478777+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T17:00:58.478777+0000","last_undegraded":"2023-10-14T17:00:58.478777+0000","last_fullsized":"2023-10-14T17:00:58.478777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'511","last_scrub_stamp":"2023-10-14T17:00:58.478655+0000","last_deep_scrub":"23'511","last_deep_scrub_stamp":"2023-10-14T17:00:58.478655+0000","last_clean_scrub_stamp":"2023-10-14T17:00:58.478655+0000","objects_scrubbed":1,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:05.432324+0000","scrub_duration":0.0037711939999999998,"objects_trimmed":0,"snaptrim_duration":0.047436036000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"23'513","reported_seq":590,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:55.535325+0000","last_change":"2023-10-14T17:00:55.535277+0000","last_active":"2023-10-14T17:00:55.535325+0000","last_peered":"2023-10-14T17:00:55.535325+0000","last_clean":"2023-10-14T17:00:55.535325+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T17:00:55.535325+0000","last_undegraded":"2023-10-14T17:00:55.535325+0000","last_fullsized":"2023-10-14T17:00:55.535325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'513","last_scrub_stamp":"2023-10-14T17:00:55.535176+0000","last_deep_scrub":"23'513","last_deep_scrub_stamp":"2023-10-14T17:00:55.535176+0000","last_clean_scrub_stamp":"2023-10-14T17:00:55.535176+0000","objects_scrubbed":1,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:20.386408+0000","scrub_duration":0.0042822859999999997,"objects_trimmed":0,"snaptrim_duration":0.070191972000000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"23'760","reported_seq":836,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:00.231581+0000","last_change":"2023-10-14T17:01:00.231548+0000","last_active":"2023-10-14T17:01:00.231581+0000","last_peered":"2023-10-14T17:01:00.231581+0000","last_clean":"2023-10-14T17:01:00.231581+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T17:01:00.231581+0000","last_undegraded":"2023-10-14T17:01:00.231581+0000","last_fullsized":"2023-10-14T17:01:00.231581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'760","last_scrub_stamp":"2023-10-14T17:01:00.231450+0000","last_deep_scrub":"23'760","last_deep_scrub_stamp":"2023-10-14T17:01:00.231450+0000","last_clean_scrub_stamp":"2023-10-14T17:01:00.231450+0000","objects_scrubbed":3,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:25.082681+0000","scrub_duration":0.0049133129999999999,"objects_trimmed":0,"snaptrim_duration":0.036605058000000003,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"23'657","reported_seq":734,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:05.190463+0000","last_change":"2023-10-14T17:01:05.190436+0000","last_active":"2023-10-14T17:01:05.190463+0000","last_peered":"2023-10-14T17:01:05.190463+0000","last_clean":"2023-10-14T17:01:05.190463+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T17:01:05.190463+0000","last_undegraded":"2023-10-14T17:01:05.190463+0000","last_fullsized":"2023-10-14T17:01:05.190463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'657","last_scrub_stamp":"2023-10-14T17:01:05.190351+0000","last_deep_scrub":"23'657","last_deep_scrub_stamp":"2023-10-14T17:01:05.190351+0000","last_clean_scrub_stamp":"2023-10-14T17:01:05.190351+0000","objects_scrubbed":2,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:58.293190+0000","scrub_duration":0.0042399380000000004,"objects_trimmed":0,"snaptrim_duration":0.038947427,"stat_sum":{"num_bytes":4105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"23'748","reported_seq":824,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:17.932535+0000","last_change":"2023-10-14T17:01:17.932506+0000","last_active":"2023-10-14T17:01:17.932535+0000","last_peered":"2023-10-14T17:01:17.932535+0000","last_clean":"2023-10-14T17:01:17.932535+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T17:01:17.932535+0000","last_undegraded":"2023-10-14T17:01:17.932535+0000","last_fullsized":"2023-10-14T17:01:17.932535+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'748","last_scrub_stamp":"2023-10-14T17:01:17.932419+0000","last_deep_scrub":"23'748","last_deep_scrub_stamp":"2023-10-14T17:01:17.932419+0000","last_clean_scrub_stamp":"2023-10-14T17:01:17.932419+0000","objects_scrubbed":3,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:13:59.793011+0000","scrub_duration":0.0045884510000000003,"objects_trimmed":0,"snaptrim_duration":0.058345898,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'595","reported_seq":672,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:59.555851+0000","last_change":"2023-10-14T17:00:59.555819+0000","last_active":"2023-10-14T17:00:59.555851+0000","last_peered":"2023-10-14T17:00:59.555851+0000","last_clean":"2023-10-14T17:00:59.555851+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T17:00:59.555851+0000","last_undegraded":"2023-10-14T17:00:59.555851+0000","last_fullsized":"2023-10-14T17:00:59.555851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'595","last_scrub_stamp":"2023-10-14T17:00:59.555722+0000","last_deep_scrub":"23'595","last_deep_scrub_stamp":"2023-10-14T17:00:59.555722+0000","last_clean_scrub_stamp":"2023-10-14T17:00:59.555722+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:17:00.011883+0000","scrub_duration":0.0014926679999999999,"objects_trimmed":0,"snaptrim_duration":0.071573409000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'694","reported_seq":771,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:14.909381+0000","last_change":"2023-10-14T17:01:14.909338+0000","last_active":"2023-10-14T17:01:14.909381+0000","last_peered":"2023-10-14T17:01:14.909381+0000","last_clean":"2023-10-14T17:01:14.909381+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T17:01:14.909381+0000","last_undegraded":"2023-10-14T17:01:14.909381+0000","last_fullsized":"2023-10-14T17:01:14.909381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'694","last_scrub_stamp":"2023-10-14T17:01:14.909187+0000","last_deep_scrub":"23'694","last_deep_scrub_stamp":"2023-10-14T17:01:14.909187+0000","last_clean_scrub_stamp":"2023-10-14T17:01:14.909187+0000","objects_scrubbed":1,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:05.126837+0000","scrub_duration":0.0039831490000000001,"objects_trimmed":0,"snaptrim_duration":0.057407435999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"23'574","reported_seq":652,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:57.611618+0000","last_change":"2023-10-14T17:00:57.611589+0000","last_active":"2023-10-14T17:00:57.611618+0000","last_peered":"2023-10-14T17:00:57.611618+0000","last_clean":"2023-10-14T17:00:57.611618+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T17:00:57.611618+0000","last_undegraded":"2023-10-14T17:00:57.611618+0000","last_fullsized":"2023-10-14T17:00:57.611618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'574","last_scrub_stamp":"2023-10-14T17:00:57.611471+0000","last_deep_scrub":"23'574","last_deep_scrub_stamp":"2023-10-14T17:00:57.611471+0000","last_clean_scrub_stamp":"2023-10-14T17:00:57.611471+0000","objects_scrubbed":2,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:16.830000+0000","scrub_duration":0.004107383,"objects_trimmed":0,"snaptrim_duration":0.070060102999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"23'761","reported_seq":838,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:11.932288+0000","last_change":"2023-10-14T17:01:11.932262+0000","last_active":"2023-10-14T17:01:11.932288+0000","last_peered":"2023-10-14T17:01:11.932288+0000","last_clean":"2023-10-14T17:01:11.932288+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T17:01:11.932288+0000","last_undegraded":"2023-10-14T17:01:11.932288+0000","last_fullsized":"2023-10-14T17:01:11.932288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'761","last_scrub_stamp":"2023-10-14T17:01:11.932160+0000","last_deep_scrub":"23'761","last_deep_scrub_stamp":"2023-10-14T17:01:11.932160+0000","last_clean_scrub_stamp":"2023-10-14T17:01:11.932160+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:48.819858+0000","scrub_duration":0.0019223389999999999,"objects_trimmed":0,"snaptrim_duration":0.056633790000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"23'812","reported_seq":889,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:10.102647+0000","last_change":"2023-10-14T17:01:10.102605+0000","last_active":"2023-10-14T17:01:10.102647+0000","last_peered":"2023-10-14T17:01:10.102647+0000","last_clean":"2023-10-14T17:01:10.102647+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T17:01:10.102647+0000","last_undegraded":"2023-10-14T17:01:10.102647+0000","last_fullsized":"2023-10-14T17:01:10.102647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'812","last_scrub_stamp":"2023-10-14T17:01:10.102501+0000","last_deep_scrub":"23'812","last_deep_scrub_stamp":"2023-10-14T17:01:10.102501+0000","last_clean_scrub_stamp":"2023-10-14T17:01:10.102501+0000","objects_scrubbed":2,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:31.475803+0000","scrub_duration":0.004387068,"objects_trimmed":0,"snaptrim_duration":0.038418550000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"23'695","reported_seq":772,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:54.580738+0000","last_change":"2023-10-14T17:00:54.580711+0000","last_active":"2023-10-14T17:00:54.580738+0000","last_peered":"2023-10-14T17:00:54.580738+0000","last_clean":"2023-10-14T17:00:54.580738+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T17:00:54.580738+0000","last_undegraded":"2023-10-14T17:00:54.580738+0000","last_fullsized":"2023-10-14T17:00:54.580738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'695","last_scrub_stamp":"2023-10-14T17:00:54.580623+0000","last_deep_scrub":"23'695","last_deep_scrub_stamp":"2023-10-14T17:00:54.580623+0000","last_clean_scrub_stamp":"2023-10-14T17:00:54.580623+0000","objects_scrubbed":1,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:00.134264+0000","scrub_duration":0.0030110179999999999,"objects_trimmed":0,"snaptrim_duration":0.065688290999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'638","reported_seq":715,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:41.237813+0000","last_change":"2023-10-14T17:00:41.237783+0000","last_active":"2023-10-14T17:00:41.237813+0000","last_peered":"2023-10-14T17:00:41.237813+0000","last_clean":"2023-10-14T17:00:41.237813+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T17:00:41.237813+0000","last_undegraded":"2023-10-14T17:00:41.237813+0000","last_fullsized":"2023-10-14T17:00:41.237813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'638","last_scrub_stamp":"2023-10-14T17:00:41.237668+0000","last_deep_scrub":"23'638","last_deep_scrub_stamp":"2023-10-14T17:00:41.237668+0000","last_clean_scrub_stamp":"2023-10-14T17:00:41.237668+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:17.477170+0000","scrub_duration":0.0015379790000000001,"objects_trimmed":0,"snaptrim_duration":0.011260075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"23'846","reported_seq":923,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:37.816280+0000","last_change":"2023-10-14T17:00:37.816253+0000","last_active":"2023-10-14T17:00:37.816280+0000","last_peered":"2023-10-14T17:00:37.816280+0000","last_clean":"2023-10-14T17:00:37.816280+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T17:00:37.816280+0000","last_undegraded":"2023-10-14T17:00:37.816280+0000","last_fullsized":"2023-10-14T17:00:37.816280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'846","last_scrub_stamp":"2023-10-14T17:00:37.816136+0000","last_deep_scrub":"23'846","last_deep_scrub_stamp":"2023-10-14T17:00:37.816136+0000","last_clean_scrub_stamp":"2023-10-14T17:00:37.816136+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:19.053769+0000","scrub_duration":0.001974478,"objects_trimmed":0,"snaptrim_duration":0.058152492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"23'636","reported_seq":713,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:47.417925+0000","last_change":"2023-10-14T17:00:47.417893+0000","last_active":"2023-10-14T17:00:47.417925+0000","last_peered":"2023-10-14T17:00:47.417925+0000","last_clean":"2023-10-14T17:00:47.417925+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T17:00:47.417925+0000","last_undegraded":"2023-10-14T17:00:47.417925+0000","last_fullsized":"2023-10-14T17:00:47.417925+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'636","last_scrub_stamp":"2023-10-14T17:00:47.417788+0000","last_deep_scrub":"23'636","last_deep_scrub_stamp":"2023-10-14T17:00:47.417788+0000","last_clean_scrub_stamp":"2023-10-14T17:00:47.417788+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:44.456851+0000","scrub_duration":0.002011554,"objects_trimmed":0,"snaptrim_duration":0.048983802,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'679","reported_seq":756,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:17.045500+0000","last_change":"2023-10-14T17:00:17.045457+0000","last_active":"2023-10-14T17:00:17.045500+0000","last_peered":"2023-10-14T17:00:17.045500+0000","last_clean":"2023-10-14T17:00:17.045500+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T17:00:17.045500+0000","last_undegraded":"2023-10-14T17:00:17.045500+0000","last_fullsized":"2023-10-14T17:00:17.045500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'679","last_scrub_stamp":"2023-10-14T17:00:17.045319+0000","last_deep_scrub":"23'679","last_deep_scrub_stamp":"2023-10-14T17:00:17.045319+0000","last_clean_scrub_stamp":"2023-10-14T17:00:17.045319+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:24.925526+0000","scrub_duration":0.0014699489999999999,"objects_trimmed":0,"snaptrim_duration":0.047799974000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'513","reported_seq":590,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:42.696392+0000","last_change":"2023-10-14T17:00:42.696361+0000","last_active":"2023-10-14T17:00:42.696392+0000","last_peered":"2023-10-14T17:00:42.696392+0000","last_clean":"2023-10-14T17:00:42.696392+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T17:00:42.696392+0000","last_undegraded":"2023-10-14T17:00:42.696392+0000","last_fullsized":"2023-10-14T17:00:42.696392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'513","last_scrub_stamp":"2023-10-14T17:00:42.696267+0000","last_deep_scrub":"23'513","last_deep_scrub_stamp":"2023-10-14T17:00:42.696267+0000","last_clean_scrub_stamp":"2023-10-14T17:00:42.696267+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:28.060990+0000","scrub_duration":0.0019776569999999999,"objects_trimmed":0,"snaptrim_duration":0.058565578,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1535","reported_seq":1563,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:49.427466+0000","last_change":"2023-10-14T17:00:49.427436+0000","last_active":"2023-10-14T17:00:49.427466+0000","last_peered":"2023-10-14T17:00:49.427466+0000","last_clean":"2023-10-14T17:00:49.427466+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T17:00:49.427466+0000","last_undegraded":"2023-10-14T17:00:49.427466+0000","last_fullsized":"2023-10-14T17:00:49.427466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1535","last_scrub_stamp":"2023-10-14T17:00:49.427350+0000","last_deep_scrub":"23'1535","last_deep_scrub_stamp":"2023-10-14T17:00:49.427350+0000","last_clean_scrub_stamp":"2023-10-14T17:00:49.427350+0000","objects_scrubbed":3,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:46.466413+0000","scrub_duration":0.028509313000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1524,"num_write_kb":13073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"23'655","reported_seq":733,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:25.725868+0000","last_change":"2023-10-14T17:00:25.725836+0000","last_active":"2023-10-14T17:00:25.725868+0000","last_peered":"2023-10-14T17:00:25.725868+0000","last_clean":"2023-10-14T17:00:25.725868+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T17:00:25.725868+0000","last_undegraded":"2023-10-14T17:00:25.725868+0000","last_fullsized":"2023-10-14T17:00:25.725868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'655","last_scrub_stamp":"2023-10-14T17:00:25.725747+0000","last_deep_scrub":"23'655","last_deep_scrub_stamp":"2023-10-14T17:00:25.725747+0000","last_clean_scrub_stamp":"2023-10-14T17:00:25.725747+0000","objects_scrubbed":2,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:50.968836+0000","scrub_duration":0.0036407990000000001,"objects_trimmed":0,"snaptrim_duration":0.067459389999999994,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"23'756","reported_seq":784,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:16.095374+0000","last_change":"2023-10-14T17:00:16.095338+0000","last_active":"2023-10-14T17:00:16.095374+0000","last_peered":"2023-10-14T17:00:16.095374+0000","last_clean":"2023-10-14T17:00:16.095374+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T17:00:16.095374+0000","last_undegraded":"2023-10-14T17:00:16.095374+0000","last_fullsized":"2023-10-14T17:00:16.095374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'756","last_scrub_stamp":"2023-10-14T17:00:16.095246+0000","last_deep_scrub":"23'756","last_deep_scrub_stamp":"2023-10-14T17:00:16.095246+0000","last_clean_scrub_stamp":"2023-10-14T17:00:16.095246+0000","objects_scrubbed":1,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:54.744269+0000","scrub_duration":0.013423025999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'585","reported_seq":662,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:16.588712+0000","last_change":"2023-10-14T17:00:16.588677+0000","last_active":"2023-10-14T17:00:16.588712+0000","last_peered":"2023-10-14T17:00:16.588712+0000","last_clean":"2023-10-14T17:00:16.588712+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T17:00:16.588712+0000","last_undegraded":"2023-10-14T17:00:16.588712+0000","last_fullsized":"2023-10-14T17:00:16.588712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'585","last_scrub_stamp":"2023-10-14T17:00:16.588581+0000","last_deep_scrub":"23'585","last_deep_scrub_stamp":"2023-10-14T17:00:16.588581+0000","last_clean_scrub_stamp":"2023-10-14T17:00:16.588581+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:41.060437+0000","scrub_duration":0.0019550330000000001,"objects_trimmed":0,"snaptrim_duration":0.070886901000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1509","reported_seq":1537,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:18.073307+0000","last_change":"2023-10-14T17:00:18.073275+0000","last_active":"2023-10-14T17:00:18.073307+0000","last_peered":"2023-10-14T17:00:18.073307+0000","last_clean":"2023-10-14T17:00:18.073307+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T17:00:18.073307+0000","last_undegraded":"2023-10-14T17:00:18.073307+0000","last_fullsized":"2023-10-14T17:00:18.073307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1509","last_scrub_stamp":"2023-10-14T17:00:18.073180+0000","last_deep_scrub":"23'1509","last_deep_scrub_stamp":"2023-10-14T17:00:18.073180+0000","last_clean_scrub_stamp":"2023-10-14T17:00:18.073180+0000","objects_scrubbed":3,"log_size":1509,"log_dups_size":0,"ondisk_log_size":1509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:58.302825+0000","scrub_duration":0.026462619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"23'595","reported_seq":672,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:26.833140+0000","last_change":"2023-10-14T17:00:26.833112+0000","last_active":"2023-10-14T17:00:26.833140+0000","last_peered":"2023-10-14T17:00:26.833140+0000","last_clean":"2023-10-14T17:00:26.833140+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T17:00:26.833140+0000","last_undegraded":"2023-10-14T17:00:26.833140+0000","last_fullsized":"2023-10-14T17:00:26.833140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'595","last_scrub_stamp":"2023-10-14T17:00:26.833028+0000","last_deep_scrub":"23'595","last_deep_scrub_stamp":"2023-10-14T17:00:26.833028+0000","last_clean_scrub_stamp":"2023-10-14T17:00:26.833028+0000","objects_scrubbed":2,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:30.522108+0000","scrub_duration":0.0043885740000000001,"objects_trimmed":0,"snaptrim_duration":0.058803686000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"22'4","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:31.648411+0000","last_change":"2023-10-14T17:00:31.648376+0000","last_active":"2023-10-14T17:00:31.648411+0000","last_peered":"2023-10-14T17:00:31.648411+0000","last_clean":"2023-10-14T17:00:31.648411+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T17:00:31.648411+0000","last_undegraded":"2023-10-14T17:00:31.648411+0000","last_fullsized":"2023-10-14T17:00:31.648411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2023-10-14T17:00:31.648277+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2023-10-14T17:00:31.648277+0000","last_clean_scrub_stamp":"2023-10-14T17:00:31.648277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:35.337357+0000","scrub_duration":0.0020350590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'583","reported_seq":660,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:12.106374+0000","last_change":"2023-10-14T17:00:12.106339+0000","last_active":"2023-10-14T17:00:12.106374+0000","last_peered":"2023-10-14T17:00:12.106374+0000","last_clean":"2023-10-14T17:00:12.106374+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T17:00:12.106374+0000","last_undegraded":"2023-10-14T17:00:12.106374+0000","last_fullsized":"2023-10-14T17:00:12.106374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'583","last_scrub_stamp":"2023-10-14T17:00:12.106239+0000","last_deep_scrub":"23'583","last_deep_scrub_stamp":"2023-10-14T17:00:12.106239+0000","last_clean_scrub_stamp":"2023-10-14T17:00:12.106239+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:53:48.745008+0000","scrub_duration":0.0023297560000000001,"objects_trimmed":0,"snaptrim_duration":0.024750503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'757","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:26.505195+0000","last_change":"2023-10-14T17:00:26.505158+0000","last_active":"2023-10-14T17:00:26.505195+0000","last_peered":"2023-10-14T17:00:26.505195+0000","last_clean":"2023-10-14T17:00:26.505195+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T17:00:26.505195+0000","last_undegraded":"2023-10-14T17:00:26.505195+0000","last_fullsized":"2023-10-14T17:00:26.505195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'757","last_scrub_stamp":"2023-10-14T17:00:26.505033+0000","last_deep_scrub":"23'757","last_deep_scrub_stamp":"2023-10-14T17:00:26.505033+0000","last_clean_scrub_stamp":"2023-10-14T17:00:26.505033+0000","objects_scrubbed":1,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:40.160585+0000","scrub_duration":0.014321274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'570","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:12.612196+0000","last_change":"2023-10-14T17:00:12.612165+0000","last_active":"2023-10-14T17:00:12.612196+0000","last_peered":"2023-10-14T17:00:12.612196+0000","last_clean":"2023-10-14T17:00:12.612196+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T17:00:12.612196+0000","last_undegraded":"2023-10-14T17:00:12.612196+0000","last_fullsized":"2023-10-14T17:00:12.612196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'570","last_scrub_stamp":"2023-10-14T17:00:12.612058+0000","last_deep_scrub":"23'570","last_deep_scrub_stamp":"2023-10-14T17:00:12.612058+0000","last_clean_scrub_stamp":"2023-10-14T17:00:12.612058+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:51.261080+0000","scrub_duration":0.001901631,"objects_trimmed":0,"snaptrim_duration":0.067572238000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"23'801","reported_seq":829,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:47.460594+0000","last_change":"2023-10-14T17:00:47.460567+0000","last_active":"2023-10-14T17:00:47.460594+0000","last_peered":"2023-10-14T17:00:47.460594+0000","last_clean":"2023-10-14T17:00:47.460594+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T17:00:47.460594+0000","last_undegraded":"2023-10-14T17:00:47.460594+0000","last_fullsized":"2023-10-14T17:00:47.460594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'801","last_scrub_stamp":"2023-10-14T17:00:47.460484+0000","last_deep_scrub":"23'801","last_deep_scrub_stamp":"2023-10-14T17:00:47.460484+0000","last_clean_scrub_stamp":"2023-10-14T17:00:47.460484+0000","objects_scrubbed":3,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:28.698116+0000","scrub_duration":0.01328207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"23'414","reported_seq":491,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:09.150688+0000","last_change":"2023-10-14T17:00:09.150657+0000","last_active":"2023-10-14T17:00:09.150688+0000","last_peered":"2023-10-14T17:00:09.150688+0000","last_clean":"2023-10-14T17:00:09.150688+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T17:00:09.150688+0000","last_undegraded":"2023-10-14T17:00:09.150688+0000","last_fullsized":"2023-10-14T17:00:09.150688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'414","last_scrub_stamp":"2023-10-14T17:00:09.150551+0000","last_deep_scrub":"23'414","last_deep_scrub_stamp":"2023-10-14T17:00:09.150551+0000","last_clean_scrub_stamp":"2023-10-14T17:00:09.150551+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:38.484247+0000","scrub_duration":0.0020073140000000001,"objects_trimmed":0,"snaptrim_duration":0.013962693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'2303","reported_seq":2331,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:24.855552+0000","last_change":"2023-10-14T17:00:24.855526+0000","last_active":"2023-10-14T17:00:24.855552+0000","last_peered":"2023-10-14T17:00:24.855552+0000","last_clean":"2023-10-14T17:00:24.855552+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T17:00:24.855552+0000","last_undegraded":"2023-10-14T17:00:24.855552+0000","last_fullsized":"2023-10-14T17:00:24.855552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2303","last_scrub_stamp":"2023-10-14T17:00:24.855445+0000","last_deep_scrub":"23'2303","last_deep_scrub_stamp":"2023-10-14T17:00:24.855445+0000","last_clean_scrub_stamp":"2023-10-14T17:00:24.855445+0000","objects_scrubbed":6,"log_size":2303,"log_dups_size":0,"ondisk_log_size":2303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:55.570593+0000","scrub_duration":0.039868383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2289,"num_write_kb":13405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"23'485","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:19.481760+0000","last_change":"2023-10-14T17:00:19.481720+0000","last_active":"2023-10-14T17:00:19.481760+0000","last_peered":"2023-10-14T17:00:19.481760+0000","last_clean":"2023-10-14T17:00:19.481760+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T17:00:19.481760+0000","last_undegraded":"2023-10-14T17:00:19.481760+0000","last_fullsized":"2023-10-14T17:00:19.481760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'485","last_scrub_stamp":"2023-10-14T17:00:19.481628+0000","last_deep_scrub":"23'485","last_deep_scrub_stamp":"2023-10-14T17:00:19.481628+0000","last_clean_scrub_stamp":"2023-10-14T17:00:19.481628+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:59.711273+0000","scrub_duration":0.001552152,"objects_trimmed":0,"snaptrim_duration":0.038441039000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"23'1510","reported_seq":1538,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:02.877946+0000","last_change":"2023-10-14T17:01:02.877898+0000","last_active":"2023-10-14T17:01:02.877946+0000","last_peered":"2023-10-14T17:01:02.877946+0000","last_clean":"2023-10-14T17:01:02.877946+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T17:01:02.877946+0000","last_undegraded":"2023-10-14T17:01:02.877946+0000","last_fullsized":"2023-10-14T17:01:02.877946+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1510","last_scrub_stamp":"2023-10-14T17:01:02.877802+0000","last_deep_scrub":"23'1510","last_deep_scrub_stamp":"2023-10-14T17:01:02.877802+0000","last_clean_scrub_stamp":"2023-10-14T17:01:02.877802+0000","objects_scrubbed":4,"log_size":1510,"log_dups_size":0,"ondisk_log_size":1510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:39.956631+0000","scrub_duration":0.027352138000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1498,"num_write_kb":8967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"23'532","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:54.422302+0000","last_change":"2023-10-14T17:00:54.422271+0000","last_active":"2023-10-14T17:00:54.422302+0000","last_peered":"2023-10-14T17:00:54.422302+0000","last_clean":"2023-10-14T17:00:54.422302+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T17:00:54.422302+0000","last_undegraded":"2023-10-14T17:00:54.422302+0000","last_fullsized":"2023-10-14T17:00:54.422302+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'532","last_scrub_stamp":"2023-10-14T17:00:54.422176+0000","last_deep_scrub":"23'532","last_deep_scrub_stamp":"2023-10-14T17:00:54.422176+0000","last_clean_scrub_stamp":"2023-10-14T17:00:54.422176+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:27.394683+0000","scrub_duration":0.0019774229999999999,"objects_trimmed":0,"snaptrim_duration":0.047574827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"22'3","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:36.699025+0000","last_change":"2023-10-14T17:00:36.698989+0000","last_active":"2023-10-14T17:00:36.699025+0000","last_peered":"2023-10-14T17:00:36.699025+0000","last_clean":"2023-10-14T17:00:36.699025+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T17:00:36.699025+0000","last_undegraded":"2023-10-14T17:00:36.699025+0000","last_fullsized":"2023-10-14T17:00:36.699025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2023-10-14T17:00:36.698893+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2023-10-14T17:00:36.698893+0000","last_clean_scrub_stamp":"2023-10-14T17:00:36.698893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:17.764307+0000","scrub_duration":0.001518506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'546","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.859089+0000","last_change":"2023-10-14T17:00:21.859059+0000","last_active":"2023-10-14T17:00:21.859089+0000","last_peered":"2023-10-14T17:00:21.859089+0000","last_clean":"2023-10-14T17:00:21.859089+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T17:00:21.859089+0000","last_undegraded":"2023-10-14T17:00:21.859089+0000","last_fullsized":"2023-10-14T17:00:21.859089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'546","last_scrub_stamp":"2023-10-14T17:00:21.858971+0000","last_deep_scrub":"23'546","last_deep_scrub_stamp":"2023-10-14T17:00:21.858971+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.858971+0000","objects_scrubbed":3,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:47.102060+0000","scrub_duration":0.0040357489999999999,"objects_trimmed":0,"snaptrim_duration":0.057513697000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"22'5","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:27.799109+0000","last_change":"2023-10-14T17:00:27.799084+0000","last_active":"2023-10-14T17:00:27.799109+0000","last_peered":"2023-10-14T17:00:27.799109+0000","last_clean":"2023-10-14T17:00:27.799109+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T17:00:27.799109+0000","last_undegraded":"2023-10-14T17:00:27.799109+0000","last_fullsized":"2023-10-14T17:00:27.799109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2023-10-14T17:00:27.798994+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2023-10-14T17:00:27.798994+0000","last_clean_scrub_stamp":"2023-10-14T17:00:27.798994+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:07.088613+0000","scrub_duration":0.0014250129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"23'1019","reported_seq":1096,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:10.548287+0000","last_change":"2023-10-14T17:00:10.548242+0000","last_active":"2023-10-14T17:00:10.548287+0000","last_peered":"2023-10-14T17:00:10.548287+0000","last_clean":"2023-10-14T17:00:10.548287+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T17:00:10.548287+0000","last_undegraded":"2023-10-14T17:00:10.548287+0000","last_fullsized":"2023-10-14T17:00:10.548287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1019","last_scrub_stamp":"2023-10-14T17:00:10.548118+0000","last_deep_scrub":"23'1019","last_deep_scrub_stamp":"2023-10-14T17:00:10.548118+0000","last_clean_scrub_stamp":"2023-10-14T17:00:10.548118+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:10.896871+0000","scrub_duration":0.0023116510000000001,"objects_trimmed":0,"snaptrim_duration":0.07026193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'1517","reported_seq":1545,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:33.925606+0000","last_change":"2023-10-14T17:00:33.925560+0000","last_active":"2023-10-14T17:00:33.925606+0000","last_peered":"2023-10-14T17:00:33.925606+0000","last_clean":"2023-10-14T17:00:33.925606+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T17:00:33.925606+0000","last_undegraded":"2023-10-14T17:00:33.925606+0000","last_fullsized":"2023-10-14T17:00:33.925606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1517","last_scrub_stamp":"2023-10-14T17:00:33.925467+0000","last_deep_scrub":"23'1517","last_deep_scrub_stamp":"2023-10-14T17:00:33.925467+0000","last_clean_scrub_stamp":"2023-10-14T17:00:33.925467+0000","objects_scrubbed":6,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:10.164969+0000","scrub_duration":0.024970293000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1507,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'585","reported_seq":662,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.585569+0000","last_change":"2023-10-14T17:00:14.585538+0000","last_active":"2023-10-14T17:00:14.585569+0000","last_peered":"2023-10-14T17:00:14.585569+0000","last_clean":"2023-10-14T17:00:14.585569+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T17:00:14.585569+0000","last_undegraded":"2023-10-14T17:00:14.585569+0000","last_fullsized":"2023-10-14T17:00:14.585569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'585","last_scrub_stamp":"2023-10-14T17:00:14.585421+0000","last_deep_scrub":"23'585","last_deep_scrub_stamp":"2023-10-14T17:00:14.585421+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.585421+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:54.815066+0000","scrub_duration":0.0018524399999999999,"objects_trimmed":0,"snaptrim_duration":0.071266745000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"23'757","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:30.436241+0000","last_change":"2023-10-14T17:00:30.436214+0000","last_active":"2023-10-14T17:00:30.436241+0000","last_peered":"2023-10-14T17:00:30.436241+0000","last_clean":"2023-10-14T17:00:30.436241+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T17:00:30.436241+0000","last_undegraded":"2023-10-14T17:00:30.436241+0000","last_fullsized":"2023-10-14T17:00:30.436241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'757","last_scrub_stamp":"2023-10-14T17:00:30.436119+0000","last_deep_scrub":"23'757","last_deep_scrub_stamp":"2023-10-14T17:00:30.436119+0000","last_clean_scrub_stamp":"2023-10-14T17:00:30.436119+0000","objects_scrubbed":2,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:55.679208+0000","scrub_duration":0.014880749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"23'815","reported_seq":892,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:06.672554+0000","last_change":"2023-10-14T17:00:06.672525+0000","last_active":"2023-10-14T17:00:06.672554+0000","last_peered":"2023-10-14T17:00:06.672554+0000","last_clean":"2023-10-14T17:00:06.672554+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T17:00:06.672554+0000","last_undegraded":"2023-10-14T17:00:06.672554+0000","last_fullsized":"2023-10-14T17:00:06.672554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'815","last_scrub_stamp":"2023-10-14T17:00:06.672437+0000","last_deep_scrub":"23'815","last_deep_scrub_stamp":"2023-10-14T17:00:06.672437+0000","last_clean_scrub_stamp":"2023-10-14T17:00:06.672437+0000","objects_scrubbed":2,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:45.321460+0000","scrub_duration":0.0042146179999999998,"objects_trimmed":0,"snaptrim_duration":0.057360406000000003,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"23'758","reported_seq":786,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:51.370885+0000","last_change":"2023-10-14T17:00:51.370858+0000","last_active":"2023-10-14T17:00:51.370885+0000","last_peered":"2023-10-14T17:00:51.370885+0000","last_clean":"2023-10-14T17:00:51.370885+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T17:00:51.370885+0000","last_undegraded":"2023-10-14T17:00:51.370885+0000","last_fullsized":"2023-10-14T17:00:51.370885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'758","last_scrub_stamp":"2023-10-14T17:00:51.370768+0000","last_deep_scrub":"23'758","last_deep_scrub_stamp":"2023-10-14T17:00:51.370768+0000","last_clean_scrub_stamp":"2023-10-14T17:00:51.370768+0000","objects_scrubbed":2,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:36.735490+0000","scrub_duration":0.012859822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'595","reported_seq":671,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:18.436040+0000","last_change":"2023-10-14T17:00:18.436003+0000","last_active":"2023-10-14T17:00:18.436040+0000","last_peered":"2023-10-14T17:00:18.436040+0000","last_clean":"2023-10-14T17:00:18.436040+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T17:00:18.436040+0000","last_undegraded":"2023-10-14T17:00:18.436040+0000","last_fullsized":"2023-10-14T17:00:18.436040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'595","last_scrub_stamp":"2023-10-14T17:00:18.435878+0000","last_deep_scrub":"23'595","last_deep_scrub_stamp":"2023-10-14T17:00:18.435878+0000","last_clean_scrub_stamp":"2023-10-14T17:00:18.435878+0000","objects_scrubbed":2,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:26.316085+0000","scrub_duration":0.0045224619999999997,"objects_trimmed":0,"snaptrim_duration":0.039029367000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'757","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:46.800593+0000","last_change":"2023-10-14T17:00:46.800567+0000","last_active":"2023-10-14T17:00:46.800593+0000","last_peered":"2023-10-14T17:00:46.800593+0000","last_clean":"2023-10-14T17:00:46.800593+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T17:00:46.800593+0000","last_undegraded":"2023-10-14T17:00:46.800593+0000","last_fullsized":"2023-10-14T17:00:46.800593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'757","last_scrub_stamp":"2023-10-14T17:00:46.800478+0000","last_deep_scrub":"23'757","last_deep_scrub_stamp":"2023-10-14T17:00:46.800478+0000","last_clean_scrub_stamp":"2023-10-14T17:00:46.800478+0000","objects_scrubbed":2,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:19.772985+0000","scrub_duration":0.013316553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'445","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:17.439396+0000","last_change":"2023-10-14T17:00:17.439352+0000","last_active":"2023-10-14T17:00:17.439396+0000","last_peered":"2023-10-14T17:00:17.439396+0000","last_clean":"2023-10-14T17:00:17.439396+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T17:00:17.439396+0000","last_undegraded":"2023-10-14T17:00:17.439396+0000","last_fullsized":"2023-10-14T17:00:17.439396+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'445","last_scrub_stamp":"2023-10-14T17:00:17.439252+0000","last_deep_scrub":"23'445","last_deep_scrub_stamp":"2023-10-14T17:00:17.439252+0000","last_clean_scrub_stamp":"2023-10-14T17:00:17.439252+0000","objects_scrubbed":5,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:56.088275+0000","scrub_duration":0.0049452009999999998,"objects_trimmed":0,"snaptrim_duration":0.036384234000000001,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"23'11","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:06.898747+0000","last_change":"2023-10-14T17:01:06.898722+0000","last_active":"2023-10-14T17:01:06.898747+0000","last_peered":"2023-10-14T17:01:06.898747+0000","last_clean":"2023-10-14T17:01:06.898747+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T17:01:06.898747+0000","last_undegraded":"2023-10-14T17:01:06.898747+0000","last_fullsized":"2023-10-14T17:01:06.898747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2023-10-14T17:01:06.898620+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2023-10-14T17:01:06.898620+0000","last_clean_scrub_stamp":"2023-10-14T17:01:06.898620+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:32.376838+0000","scrub_duration":0.0083792199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"23'731","reported_seq":808,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:20.695393+0000","last_change":"2023-10-14T17:00:20.695362+0000","last_active":"2023-10-14T17:00:20.695393+0000","last_peered":"2023-10-14T17:00:20.695393+0000","last_clean":"2023-10-14T17:00:20.695393+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T17:00:20.695393+0000","last_undegraded":"2023-10-14T17:00:20.695393+0000","last_fullsized":"2023-10-14T17:00:20.695393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'731","last_scrub_stamp":"2023-10-14T17:00:20.695264+0000","last_deep_scrub":"23'731","last_deep_scrub_stamp":"2023-10-14T17:00:20.695264+0000","last_clean_scrub_stamp":"2023-10-14T17:00:20.695264+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:05.017140+0000","scrub_duration":0.001565271,"objects_trimmed":0,"snaptrim_duration":0.070178661000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'1502","reported_seq":1530,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:36.331783+0000","last_change":"2023-10-14T17:00:36.331735+0000","last_active":"2023-10-14T17:00:36.331783+0000","last_peered":"2023-10-14T17:00:36.331783+0000","last_clean":"2023-10-14T17:00:36.331783+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T17:00:36.331783+0000","last_undegraded":"2023-10-14T17:00:36.331783+0000","last_fullsized":"2023-10-14T17:00:36.331783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1502","last_scrub_stamp":"2023-10-14T17:00:36.331637+0000","last_deep_scrub":"23'1502","last_deep_scrub_stamp":"2023-10-14T17:00:36.331637+0000","last_clean_scrub_stamp":"2023-10-14T17:00:36.331637+0000","objects_scrubbed":4,"log_size":1502,"log_dups_size":0,"ondisk_log_size":1502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:15.621256+0000","scrub_duration":0.027209761999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":12977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"23'732","reported_seq":809,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:07.636144+0000","last_change":"2023-10-14T17:00:07.636098+0000","last_active":"2023-10-14T17:00:07.636144+0000","last_peered":"2023-10-14T17:00:07.636144+0000","last_clean":"2023-10-14T17:00:07.636144+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T17:00:07.636144+0000","last_undegraded":"2023-10-14T17:00:07.636144+0000","last_fullsized":"2023-10-14T17:00:07.636144+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'732","last_scrub_stamp":"2023-10-14T17:00:07.635986+0000","last_deep_scrub":"23'732","last_deep_scrub_stamp":"2023-10-14T17:00:07.635986+0000","last_clean_scrub_stamp":"2023-10-14T17:00:07.635986+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:15.516193+0000","scrub_duration":0.0020539740000000001,"objects_trimmed":0,"snaptrim_duration":0.034606716000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'3229","reported_seq":3257,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:39.800699+0000","last_change":"2023-10-14T17:00:39.800656+0000","last_active":"2023-10-14T17:00:39.800699+0000","last_peered":"2023-10-14T17:00:39.800699+0000","last_clean":"2023-10-14T17:00:39.800699+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T17:00:39.800699+0000","last_undegraded":"2023-10-14T17:00:39.800699+0000","last_fullsized":"2023-10-14T17:00:39.800699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3229","last_scrub_stamp":"2023-10-14T17:00:39.800562+0000","last_deep_scrub":"23'3229","last_deep_scrub_stamp":"2023-10-14T17:00:39.800562+0000","last_clean_scrub_stamp":"2023-10-14T17:00:39.800562+0000","objects_scrubbed":2,"log_size":3229,"log_dups_size":0,"ondisk_log_size":3229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:36.839625+0000","scrub_duration":0.027341382000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3218,"num_write_kb":10301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'569","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.709675+0000","last_change":"2023-10-14T17:00:14.709621+0000","last_active":"2023-10-14T17:00:14.709675+0000","last_peered":"2023-10-14T17:00:14.709675+0000","last_clean":"2023-10-14T17:00:14.709675+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T17:00:14.709675+0000","last_undegraded":"2023-10-14T17:00:14.709675+0000","last_fullsized":"2023-10-14T17:00:14.709675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'569","last_scrub_stamp":"2023-10-14T17:00:14.709530+0000","last_deep_scrub":"23'569","last_deep_scrub_stamp":"2023-10-14T17:00:14.709530+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.709530+0000","objects_scrubbed":2,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:35:59.031407+0000","scrub_duration":0.0039121779999999997,"objects_trimmed":0,"snaptrim_duration":0.057531643,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"23'651","reported_seq":679,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:58.940562+0000","last_change":"2023-10-14T17:00:58.940536+0000","last_active":"2023-10-14T17:00:58.940562+0000","last_peered":"2023-10-14T17:00:58.940562+0000","last_clean":"2023-10-14T17:00:58.940562+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T17:00:58.940562+0000","last_undegraded":"2023-10-14T17:00:58.940562+0000","last_fullsized":"2023-10-14T17:00:58.940562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'651","last_scrub_stamp":"2023-10-14T17:00:58.940431+0000","last_deep_scrub":"23'651","last_deep_scrub_stamp":"2023-10-14T17:00:58.940431+0000","last_clean_scrub_stamp":"2023-10-14T17:00:58.940431+0000","objects_scrubbed":1,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:49.082334+0000","scrub_duration":0.012391549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'610","reported_seq":708,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:15.396589+0000","last_change":"2023-10-14T17:00:15.396562+0000","last_active":"2023-10-14T17:00:15.396589+0000","last_peered":"2023-10-14T17:00:15.396589+0000","last_clean":"2023-10-14T17:00:15.396589+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T17:00:15.396589+0000","last_undegraded":"2023-10-14T17:00:15.396589+0000","last_fullsized":"2023-10-14T17:00:15.396589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'610","last_scrub_stamp":"2023-10-14T17:00:15.396476+0000","last_deep_scrub":"23'610","last_deep_scrub_stamp":"2023-10-14T17:00:15.396476+0000","last_clean_scrub_stamp":"2023-10-14T17:00:15.396476+0000","objects_scrubbed":10,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:15.745229+0000","scrub_duration":0.0089952309999999994,"objects_trimmed":0,"snaptrim_duration":0.038477224999999997,"stat_sum":{"num_bytes":16395,"num_objects":10,"num_object_clones":4,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":32,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"23'758","reported_seq":786,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:35.288431+0000","last_change":"2023-10-14T17:00:35.288382+0000","last_active":"2023-10-14T17:00:35.288431+0000","last_peered":"2023-10-14T17:00:35.288431+0000","last_clean":"2023-10-14T17:00:35.288431+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T17:00:35.288431+0000","last_undegraded":"2023-10-14T17:00:35.288431+0000","last_fullsized":"2023-10-14T17:00:35.288431+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'758","last_scrub_stamp":"2023-10-14T17:00:35.288276+0000","last_deep_scrub":"23'758","last_deep_scrub_stamp":"2023-10-14T17:00:35.288276+0000","last_clean_scrub_stamp":"2023-10-14T17:00:35.288276+0000","objects_scrubbed":1,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:38.977356+0000","scrub_duration":0.013787259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'596","reported_seq":671,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:10.429861+0000","last_change":"2023-10-14T17:01:10.429830+0000","last_active":"2023-10-14T17:01:10.429861+0000","last_peered":"2023-10-14T17:01:10.429861+0000","last_clean":"2023-10-14T17:01:10.429861+0000","last_became_active":"2023-10-14T16:55:45.058862+0000","last_became_peered":"2023-10-14T16:55:45.058862+0000","last_unstale":"2023-10-14T17:01:10.429861+0000","last_undegraded":"2023-10-14T17:01:10.429861+0000","last_fullsized":"2023-10-14T17:01:10.429861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'596","last_scrub_stamp":"2023-10-14T17:01:10.429726+0000","last_deep_scrub":"23'596","last_deep_scrub_stamp":"2023-10-14T17:01:10.429726+0000","last_clean_scrub_stamp":"2023-10-14T17:01:10.429726+0000","objects_scrubbed":1,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:35.907944+0000","scrub_duration":0.0038904870000000002,"objects_trimmed":0,"snaptrim_duration":0.071388894999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'773","reported_seq":801,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:25.221455+0000","last_change":"2023-10-14T17:00:25.221425+0000","last_active":"2023-10-14T17:00:25.221455+0000","last_peered":"2023-10-14T17:00:25.221455+0000","last_clean":"2023-10-14T17:00:25.221455+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T17:00:25.221455+0000","last_undegraded":"2023-10-14T17:00:25.221455+0000","last_fullsized":"2023-10-14T17:00:25.221455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'773","last_scrub_stamp":"2023-10-14T17:00:25.221335+0000","last_deep_scrub":"23'773","last_deep_scrub_stamp":"2023-10-14T17:00:25.221335+0000","last_clean_scrub_stamp":"2023-10-14T17:00:25.221335+0000","objects_scrubbed":2,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:38.876887+0000","scrub_duration":0.013685787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:36.456601+0000","last_change":"2023-10-14T17:00:36.456573+0000","last_active":"2023-10-14T17:00:36.456601+0000","last_peered":"2023-10-14T17:00:36.456601+0000","last_clean":"2023-10-14T17:00:36.456601+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T17:00:36.456601+0000","last_undegraded":"2023-10-14T17:00:36.456601+0000","last_fullsized":"2023-10-14T17:00:36.456601+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:36.456470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:36.456470+0000","last_clean_scrub_stamp":"2023-10-14T17:00:36.456470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:40.145551+0000","scrub_duration":0.0018203920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"23'520","reported_seq":597,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:51.598491+0000","last_change":"2023-10-14T17:00:51.598463+0000","last_active":"2023-10-14T17:00:51.598491+0000","last_peered":"2023-10-14T17:00:51.598491+0000","last_clean":"2023-10-14T17:00:51.598491+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T17:00:51.598491+0000","last_undegraded":"2023-10-14T17:00:51.598491+0000","last_fullsized":"2023-10-14T17:00:51.598491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'520","last_scrub_stamp":"2023-10-14T17:00:51.598362+0000","last_deep_scrub":"23'520","last_deep_scrub_stamp":"2023-10-14T17:00:51.598362+0000","last_clean_scrub_stamp":"2023-10-14T17:00:51.598362+0000","objects_scrubbed":2,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:00:50.039779+0000","scrub_duration":0.0040435319999999999,"objects_trimmed":0,"snaptrim_duration":0.061999158999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:24.168089+0000","last_change":"2023-10-14T17:00:24.168059+0000","last_active":"2023-10-14T17:00:24.168089+0000","last_peered":"2023-10-14T17:00:24.168089+0000","last_clean":"2023-10-14T17:00:24.168089+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T17:00:24.168089+0000","last_undegraded":"2023-10-14T17:00:24.168089+0000","last_fullsized":"2023-10-14T17:00:24.168089+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:24.167949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:24.167949+0000","last_clean_scrub_stamp":"2023-10-14T17:00:24.167949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:08.489825+0000","scrub_duration":0.0018258009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"23'50","reported_seq":78,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:32.698034+0000","last_change":"2023-10-14T17:00:32.697997+0000","last_active":"2023-10-14T17:00:32.698034+0000","last_peered":"2023-10-14T17:00:32.698034+0000","last_clean":"2023-10-14T17:00:32.698034+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T17:00:32.698034+0000","last_undegraded":"2023-10-14T17:00:32.698034+0000","last_fullsized":"2023-10-14T17:00:32.698034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'50","last_scrub_stamp":"2023-10-14T17:00:32.697897+0000","last_deep_scrub":"23'50","last_deep_scrub_stamp":"2023-10-14T17:00:32.697897+0000","last_clean_scrub_stamp":"2023-10-14T17:00:32.697897+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:11.987516+0000","scrub_duration":0.0026746600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'517","reported_seq":594,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.446285+0000","last_change":"2023-10-14T17:00:21.446258+0000","last_active":"2023-10-14T17:00:21.446285+0000","last_peered":"2023-10-14T17:00:21.446285+0000","last_clean":"2023-10-14T17:00:21.446285+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T17:00:21.446285+0000","last_undegraded":"2023-10-14T17:00:21.446285+0000","last_fullsized":"2023-10-14T17:00:21.446285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'517","last_scrub_stamp":"2023-10-14T17:00:21.446154+0000","last_deep_scrub":"23'517","last_deep_scrub_stamp":"2023-10-14T17:00:21.446154+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.446154+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:45.918009+0000","scrub_duration":0.0014583549999999999,"objects_trimmed":0,"snaptrim_duration":0.038513458,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:20.098656+0000","last_change":"2023-10-14T17:00:20.098627+0000","last_active":"2023-10-14T17:00:20.098656+0000","last_peered":"2023-10-14T17:00:20.098656+0000","last_clean":"2023-10-14T17:00:20.098656+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T17:00:20.098656+0000","last_undegraded":"2023-10-14T17:00:20.098656+0000","last_fullsized":"2023-10-14T17:00:20.098656+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:20.098523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:20.098523+0000","last_clean_scrub_stamp":"2023-10-14T17:00:20.098523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:44.570379+0000","scrub_duration":0.0018044700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"23'119","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:55.944842+0000","last_change":"2023-10-14T17:00:55.944816+0000","last_active":"2023-10-14T17:00:55.944842+0000","last_peered":"2023-10-14T17:00:55.944842+0000","last_clean":"2023-10-14T17:00:55.944842+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T17:00:55.944842+0000","last_undegraded":"2023-10-14T17:00:55.944842+0000","last_fullsized":"2023-10-14T17:00:55.944842+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2023-10-14T17:00:55.944732+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2023-10-14T17:00:55.944732+0000","last_clean_scrub_stamp":"2023-10-14T17:00:55.944732+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:56.400894+0000","scrub_duration":0.0044312520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'77","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:44.621788+0000","last_change":"2023-10-14T17:00:44.621759+0000","last_active":"2023-10-14T17:00:44.621788+0000","last_peered":"2023-10-14T17:00:44.621788+0000","last_clean":"2023-10-14T17:00:44.621788+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T17:00:44.621788+0000","last_undegraded":"2023-10-14T17:00:44.621788+0000","last_fullsized":"2023-10-14T17:00:44.621788+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'77","last_scrub_stamp":"2023-10-14T17:00:44.621662+0000","last_deep_scrub":"23'77","last_deep_scrub_stamp":"2023-10-14T17:00:44.621662+0000","last_clean_scrub_stamp":"2023-10-14T17:00:44.621662+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:41.660725+0000","scrub_duration":0.004793645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":646501,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":64,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'755","reported_seq":833,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:24.676945+0000","last_change":"2023-10-14T17:00:24.676899+0000","last_active":"2023-10-14T17:00:24.676945+0000","last_peered":"2023-10-14T17:00:24.676945+0000","last_clean":"2023-10-14T17:00:24.676945+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T17:00:24.676945+0000","last_undegraded":"2023-10-14T17:00:24.676945+0000","last_fullsized":"2023-10-14T17:00:24.676945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'755","last_scrub_stamp":"2023-10-14T17:00:24.676790+0000","last_deep_scrub":"23'755","last_deep_scrub_stamp":"2023-10-14T17:00:24.676790+0000","last_clean_scrub_stamp":"2023-10-14T17:00:24.676790+0000","objects_scrubbed":1,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:13.281090+0000","scrub_duration":0.0031994969999999999,"objects_trimmed":0,"snaptrim_duration":0.069884818000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:34.403364+0000","last_change":"2023-10-14T17:00:34.403336+0000","last_active":"2023-10-14T17:00:34.403364+0000","last_peered":"2023-10-14T17:00:34.403364+0000","last_clean":"2023-10-14T17:00:34.403364+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T17:00:34.403364+0000","last_undegraded":"2023-10-14T17:00:34.403364+0000","last_fullsized":"2023-10-14T17:00:34.403364+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:34.403232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:34.403232+0000","last_clean_scrub_stamp":"2023-10-14T17:00:34.403232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:05.118380+0000","scrub_duration":0.0023433809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'2238","reported_seq":2266,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:28.231608+0000","last_change":"2023-10-14T17:00:28.231580+0000","last_active":"2023-10-14T17:00:28.231608+0000","last_peered":"2023-10-14T17:00:28.231608+0000","last_clean":"2023-10-14T17:00:28.231608+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T17:00:28.231608+0000","last_undegraded":"2023-10-14T17:00:28.231608+0000","last_fullsized":"2023-10-14T17:00:28.231608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2238","last_scrub_stamp":"2023-10-14T17:00:28.231497+0000","last_deep_scrub":"23'2238","last_deep_scrub_stamp":"2023-10-14T17:00:28.231497+0000","last_clean_scrub_stamp":"2023-10-14T17:00:28.231497+0000","objects_scrubbed":3,"log_size":2238,"log_dups_size":0,"ondisk_log_size":2238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:16.835797+0000","scrub_duration":0.028927609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2227,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'634","reported_seq":711,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:45.357063+0000","last_change":"2023-10-14T17:00:45.357021+0000","last_active":"2023-10-14T17:00:45.357063+0000","last_peered":"2023-10-14T17:00:45.357063+0000","last_clean":"2023-10-14T17:00:45.357063+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T17:00:45.357063+0000","last_undegraded":"2023-10-14T17:00:45.357063+0000","last_fullsized":"2023-10-14T17:00:45.357063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'634","last_scrub_stamp":"2023-10-14T17:00:45.356915+0000","last_deep_scrub":"23'634","last_deep_scrub_stamp":"2023-10-14T17:00:45.356915+0000","last_clean_scrub_stamp":"2023-10-14T17:00:45.356915+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:26.594547+0000","scrub_duration":0.0020193810000000002,"objects_trimmed":0,"snaptrim_duration":0.047771027000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:50.829740+0000","last_change":"2023-10-14T17:00:50.829711+0000","last_active":"2023-10-14T17:00:50.829740+0000","last_peered":"2023-10-14T17:00:50.829740+0000","last_clean":"2023-10-14T17:00:50.829740+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T17:00:50.829740+0000","last_undegraded":"2023-10-14T17:00:50.829740+0000","last_fullsized":"2023-10-14T17:00:50.829740+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:50.829611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:50.829611+0000","last_clean_scrub_stamp":"2023-10-14T17:00:50.829611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:56.383252+0000","scrub_duration":0.0020121000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'1505","reported_seq":1533,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:33.281438+0000","last_change":"2023-10-14T17:00:33.281411+0000","last_active":"2023-10-14T17:00:33.281438+0000","last_peered":"2023-10-14T17:00:33.281438+0000","last_clean":"2023-10-14T17:00:33.281438+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T17:00:33.281438+0000","last_undegraded":"2023-10-14T17:00:33.281438+0000","last_fullsized":"2023-10-14T17:00:33.281438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1505","last_scrub_stamp":"2023-10-14T17:00:33.281327+0000","last_deep_scrub":"23'1505","last_deep_scrub_stamp":"2023-10-14T17:00:33.281327+0000","last_clean_scrub_stamp":"2023-10-14T17:00:33.281327+0000","objects_scrubbed":2,"log_size":1505,"log_dups_size":0,"ondisk_log_size":1505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:03.996475+0000","scrub_duration":0.022221726000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"23'761","reported_seq":837,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:08.665128+0000","last_change":"2023-10-14T17:00:08.665100+0000","last_active":"2023-10-14T17:00:08.665128+0000","last_peered":"2023-10-14T17:00:08.665128+0000","last_clean":"2023-10-14T17:00:08.665128+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T17:00:08.665128+0000","last_undegraded":"2023-10-14T17:00:08.665128+0000","last_fullsized":"2023-10-14T17:00:08.665128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'761","last_scrub_stamp":"2023-10-14T17:00:08.665003+0000","last_deep_scrub":"23'761","last_deep_scrub_stamp":"2023-10-14T17:00:08.665003+0000","last_clean_scrub_stamp":"2023-10-14T17:00:08.665003+0000","objects_scrubbed":2,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:48.894648+0000","scrub_duration":0.0039251659999999999,"objects_trimmed":0,"snaptrim_duration":0.057422879000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:53.939685+0000","last_change":"2023-10-14T17:00:53.939655+0000","last_active":"2023-10-14T17:00:53.939685+0000","last_peered":"2023-10-14T17:00:53.939685+0000","last_clean":"2023-10-14T17:00:53.939685+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T17:00:53.939685+0000","last_undegraded":"2023-10-14T17:00:53.939685+0000","last_fullsized":"2023-10-14T17:00:53.939685+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:53.939560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:53.939560+0000","last_clean_scrub_stamp":"2023-10-14T17:00:53.939560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:13.158089+0000","scrub_duration":0.001768836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'742","reported_seq":770,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:37.452608+0000","last_change":"2023-10-14T17:00:37.452579+0000","last_active":"2023-10-14T17:00:37.452608+0000","last_peered":"2023-10-14T17:00:37.452608+0000","last_clean":"2023-10-14T17:00:37.452608+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T17:00:37.452608+0000","last_undegraded":"2023-10-14T17:00:37.452608+0000","last_fullsized":"2023-10-14T17:00:37.452608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'742","last_scrub_stamp":"2023-10-14T17:00:37.452486+0000","last_deep_scrub":"23'742","last_deep_scrub_stamp":"2023-10-14T17:00:37.452486+0000","last_clean_scrub_stamp":"2023-10-14T17:00:37.452486+0000","objects_scrubbed":1,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:16.742105+0000","scrub_duration":0.012675855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'580","reported_seq":657,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:57.496266+0000","last_change":"2023-10-14T17:00:57.496233+0000","last_active":"2023-10-14T17:00:57.496266+0000","last_peered":"2023-10-14T17:00:57.496266+0000","last_clean":"2023-10-14T17:00:57.496266+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T17:00:57.496266+0000","last_undegraded":"2023-10-14T17:00:57.496266+0000","last_fullsized":"2023-10-14T17:00:57.496266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'580","last_scrub_stamp":"2023-10-14T17:00:57.496127+0000","last_deep_scrub":"23'580","last_deep_scrub_stamp":"2023-10-14T17:00:57.496127+0000","last_clean_scrub_stamp":"2023-10-14T17:00:57.496127+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:53:46.107876+0000","scrub_duration":0.001658896,"objects_trimmed":0,"snaptrim_duration":0.047665379000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:51.873706+0000","last_change":"2023-10-14T17:00:51.873678+0000","last_active":"2023-10-14T17:00:51.873706+0000","last_peered":"2023-10-14T17:00:51.873706+0000","last_clean":"2023-10-14T17:00:51.873706+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T17:00:51.873706+0000","last_undegraded":"2023-10-14T17:00:51.873706+0000","last_fullsized":"2023-10-14T17:00:51.873706+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:51.873575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:51.873575+0000","last_clean_scrub_stamp":"2023-10-14T17:00:51.873575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:16.724807+0000","scrub_duration":0.0018907679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'738","reported_seq":766,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:29.244189+0000","last_change":"2023-10-14T17:00:29.244159+0000","last_active":"2023-10-14T17:00:29.244189+0000","last_peered":"2023-10-14T17:00:29.244189+0000","last_clean":"2023-10-14T17:00:29.244189+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T17:00:29.244189+0000","last_undegraded":"2023-10-14T17:00:29.244189+0000","last_fullsized":"2023-10-14T17:00:29.244189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'738","last_scrub_stamp":"2023-10-14T17:00:29.244076+0000","last_deep_scrub":"23'738","last_deep_scrub_stamp":"2023-10-14T17:00:29.244076+0000","last_clean_scrub_stamp":"2023-10-14T17:00:29.244076+0000","objects_scrubbed":1,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:54.487165+0000","scrub_duration":0.012834883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'698","reported_seq":775,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:29.644827+0000","last_change":"2023-10-14T17:00:29.644796+0000","last_active":"2023-10-14T17:00:29.644827+0000","last_peered":"2023-10-14T17:00:29.644827+0000","last_clean":"2023-10-14T17:00:29.644827+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T17:00:29.644827+0000","last_undegraded":"2023-10-14T17:00:29.644827+0000","last_fullsized":"2023-10-14T17:00:29.644827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'698","last_scrub_stamp":"2023-10-14T17:00:29.644709+0000","last_deep_scrub":"23'698","last_deep_scrub_stamp":"2023-10-14T17:00:29.644709+0000","last_clean_scrub_stamp":"2023-10-14T17:00:29.644709+0000","objects_scrubbed":1,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:00.359857+0000","scrub_duration":0.0037276449999999999,"objects_trimmed":0,"snaptrim_duration":0.068678344000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:56.895608+0000","last_change":"2023-10-14T17:00:56.895584+0000","last_active":"2023-10-14T17:00:56.895608+0000","last_peered":"2023-10-14T17:00:56.895608+0000","last_clean":"2023-10-14T17:00:56.895608+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T17:00:56.895608+0000","last_undegraded":"2023-10-14T17:00:56.895608+0000","last_fullsized":"2023-10-14T17:00:56.895608+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:56.895495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:56.895495+0000","last_clean_scrub_stamp":"2023-10-14T17:00:56.895495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:49.998334+0000","scrub_duration":0.001570407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"23'1042","reported_seq":1070,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:43.521284+0000","last_change":"2023-10-14T17:00:43.521256+0000","last_active":"2023-10-14T17:00:43.521284+0000","last_peered":"2023-10-14T17:00:43.521284+0000","last_clean":"2023-10-14T17:00:43.521284+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T17:00:43.521284+0000","last_undegraded":"2023-10-14T17:00:43.521284+0000","last_fullsized":"2023-10-14T17:00:43.521284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1042","last_scrub_stamp":"2023-10-14T17:00:43.521155+0000","last_deep_scrub":"23'1042","last_deep_scrub_stamp":"2023-10-14T17:00:43.521155+0000","last_clean_scrub_stamp":"2023-10-14T17:00:43.521155+0000","objects_scrubbed":2,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:19.760658+0000","scrub_duration":0.021131402000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":8695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"23'755","reported_seq":832,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:39.294771+0000","last_change":"2023-10-14T17:00:39.294739+0000","last_active":"2023-10-14T17:00:39.294771+0000","last_peered":"2023-10-14T17:00:39.294771+0000","last_clean":"2023-10-14T17:00:39.294771+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T17:00:39.294771+0000","last_undegraded":"2023-10-14T17:00:39.294771+0000","last_fullsized":"2023-10-14T17:00:39.294771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'755","last_scrub_stamp":"2023-10-14T17:00:39.294633+0000","last_deep_scrub":"23'755","last_deep_scrub_stamp":"2023-10-14T17:00:39.294633+0000","last_clean_scrub_stamp":"2023-10-14T17:00:39.294633+0000","objects_scrubbed":1,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:20.360047+0000","scrub_duration":0.0038686810000000001,"objects_trimmed":0,"snaptrim_duration":0.015859669999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'741","reported_seq":769,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:46.615464+0000","last_change":"2023-10-14T17:00:46.615433+0000","last_active":"2023-10-14T17:00:46.615464+0000","last_peered":"2023-10-14T17:00:46.615464+0000","last_clean":"2023-10-14T17:00:46.615464+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T17:00:46.615464+0000","last_undegraded":"2023-10-14T17:00:46.615464+0000","last_fullsized":"2023-10-14T17:00:46.615464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'741","last_scrub_stamp":"2023-10-14T17:00:46.615342+0000","last_deep_scrub":"23'741","last_deep_scrub_stamp":"2023-10-14T17:00:46.615342+0000","last_clean_scrub_stamp":"2023-10-14T17:00:46.615342+0000","objects_scrubbed":1,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:31.980064+0000","scrub_duration":0.012945305000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'628","reported_seq":705,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:37.264296+0000","last_change":"2023-10-14T17:00:37.264268+0000","last_active":"2023-10-14T17:00:37.264296+0000","last_peered":"2023-10-14T17:00:37.264296+0000","last_clean":"2023-10-14T17:00:37.264296+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T17:00:37.264296+0000","last_undegraded":"2023-10-14T17:00:37.264296+0000","last_fullsized":"2023-10-14T17:00:37.264296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'628","last_scrub_stamp":"2023-10-14T17:00:37.264178+0000","last_deep_scrub":"23'628","last_deep_scrub_stamp":"2023-10-14T17:00:37.264178+0000","last_clean_scrub_stamp":"2023-10-14T17:00:37.264178+0000","objects_scrubbed":1,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:56.886434+0000","scrub_duration":0.0030037409999999999,"objects_trimmed":0,"snaptrim_duration":0.048042644000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'756","reported_seq":784,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:41.497508+0000","last_change":"2023-10-14T17:00:41.497480+0000","last_active":"2023-10-14T17:00:41.497508+0000","last_peered":"2023-10-14T17:00:41.497508+0000","last_clean":"2023-10-14T17:00:41.497508+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T17:00:41.497508+0000","last_undegraded":"2023-10-14T17:00:41.497508+0000","last_fullsized":"2023-10-14T17:00:41.497508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'756","last_scrub_stamp":"2023-10-14T17:00:41.497391+0000","last_deep_scrub":"23'756","last_deep_scrub_stamp":"2023-10-14T17:00:41.497391+0000","last_clean_scrub_stamp":"2023-10-14T17:00:41.497391+0000","objects_scrubbed":2,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:22.562805+0000","scrub_duration":0.014326548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"23'834","reported_seq":911,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:56.297998+0000","last_change":"2023-10-14T17:00:56.297971+0000","last_active":"2023-10-14T17:00:56.297998+0000","last_peered":"2023-10-14T17:00:56.297998+0000","last_clean":"2023-10-14T17:00:56.297998+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T17:00:56.297998+0000","last_undegraded":"2023-10-14T17:00:56.297998+0000","last_fullsized":"2023-10-14T17:00:56.297998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'834","last_scrub_stamp":"2023-10-14T17:00:56.297867+0000","last_deep_scrub":"23'834","last_deep_scrub_stamp":"2023-10-14T17:00:56.297867+0000","last_clean_scrub_stamp":"2023-10-14T17:00:56.297867+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:00:54.739284+0000","scrub_duration":0.0021536770000000001,"objects_trimmed":0,"snaptrim_duration":0.038542571999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2260","reported_seq":2288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:19.853834+0000","last_change":"2023-10-14T17:00:19.853808+0000","last_active":"2023-10-14T17:00:19.853834+0000","last_peered":"2023-10-14T17:00:19.853834+0000","last_clean":"2023-10-14T17:00:19.853834+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T17:00:19.853834+0000","last_undegraded":"2023-10-14T17:00:19.853834+0000","last_fullsized":"2023-10-14T17:00:19.853834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2260","last_scrub_stamp":"2023-10-14T17:00:19.853728+0000","last_deep_scrub":"23'2260","last_deep_scrub_stamp":"2023-10-14T17:00:19.853728+0000","last_clean_scrub_stamp":"2023-10-14T17:00:19.853728+0000","objects_scrubbed":4,"log_size":2260,"log_dups_size":0,"ondisk_log_size":2260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:08.458027+0000","scrub_duration":0.035936590999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2245,"num_write_kb":13441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"23'673","reported_seq":750,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:29.414546+0000","last_change":"2023-10-14T17:00:29.414519+0000","last_active":"2023-10-14T17:00:29.414546+0000","last_peered":"2023-10-14T17:00:29.414546+0000","last_clean":"2023-10-14T17:00:29.414546+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T17:00:29.414546+0000","last_undegraded":"2023-10-14T17:00:29.414546+0000","last_fullsized":"2023-10-14T17:00:29.414546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'673","last_scrub_stamp":"2023-10-14T17:00:29.414416+0000","last_deep_scrub":"23'673","last_deep_scrub_stamp":"2023-10-14T17:00:29.414416+0000","last_clean_scrub_stamp":"2023-10-14T17:00:29.414416+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:18.018716+0000","scrub_duration":0.0018134749999999999,"objects_trimmed":0,"snaptrim_duration":0.038619158000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3075","reported_seq":3103,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:42.686548+0000","last_change":"2023-10-14T17:00:42.686498+0000","last_active":"2023-10-14T17:00:42.686548+0000","last_peered":"2023-10-14T17:00:42.686548+0000","last_clean":"2023-10-14T17:00:42.686548+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T17:00:42.686548+0000","last_undegraded":"2023-10-14T17:00:42.686548+0000","last_fullsized":"2023-10-14T17:00:42.686548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3075","last_scrub_stamp":"2023-10-14T17:00:42.686353+0000","last_deep_scrub":"23'3075","last_deep_scrub_stamp":"2023-10-14T17:00:42.686353+0000","last_clean_scrub_stamp":"2023-10-14T17:00:42.686353+0000","objects_scrubbed":2,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:23.923986+0000","scrub_duration":0.017120115000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5336939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3065,"num_write_kb":7243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"23'767","reported_seq":844,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:13.628534+0000","last_change":"2023-10-14T17:00:13.628505+0000","last_active":"2023-10-14T17:00:13.628534+0000","last_peered":"2023-10-14T17:00:13.628534+0000","last_clean":"2023-10-14T17:00:13.628534+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T17:00:13.628534+0000","last_undegraded":"2023-10-14T17:00:13.628534+0000","last_fullsized":"2023-10-14T17:00:13.628534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'767","last_scrub_stamp":"2023-10-14T17:00:13.628407+0000","last_deep_scrub":"23'767","last_deep_scrub_stamp":"2023-10-14T17:00:13.628407+0000","last_clean_scrub_stamp":"2023-10-14T17:00:13.628407+0000","objects_scrubbed":1,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:21.508614+0000","scrub_duration":0.0032656299999999998,"objects_trimmed":0,"snaptrim_duration":0.068737623999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'788","reported_seq":816,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:38.718974+0000","last_change":"2023-10-14T17:00:38.718944+0000","last_active":"2023-10-14T17:00:38.718974+0000","last_peered":"2023-10-14T17:00:38.718974+0000","last_clean":"2023-10-14T17:00:38.718974+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T17:00:38.718974+0000","last_undegraded":"2023-10-14T17:00:38.718974+0000","last_fullsized":"2023-10-14T17:00:38.718974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'788","last_scrub_stamp":"2023-10-14T17:00:38.718839+0000","last_deep_scrub":"23'788","last_deep_scrub_stamp":"2023-10-14T17:00:38.718839+0000","last_clean_scrub_stamp":"2023-10-14T17:00:38.718839+0000","objects_scrubbed":4,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:14.958342+0000","scrub_duration":0.020417911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389162,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'697","reported_seq":772,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:25.463530+0000","last_change":"2023-10-14T17:00:25.463505+0000","last_active":"2023-10-14T17:00:25.463530+0000","last_peered":"2023-10-14T17:00:25.463530+0000","last_clean":"2023-10-14T17:00:25.463530+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T17:00:25.463530+0000","last_undegraded":"2023-10-14T17:00:25.463530+0000","last_fullsized":"2023-10-14T17:00:25.463530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'697","last_scrub_stamp":"2023-10-14T17:00:25.463404+0000","last_deep_scrub":"23'697","last_deep_scrub_stamp":"2023-10-14T17:00:25.463404+0000","last_clean_scrub_stamp":"2023-10-14T17:00:25.463404+0000","objects_scrubbed":4,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:09.785280+0000","scrub_duration":0.0057845700000000002,"objects_trimmed":0,"snaptrim_duration":0.026701018,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"23'673","reported_seq":749,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:59.255258+0000","last_change":"2023-10-14T17:00:59.255217+0000","last_active":"2023-10-14T17:00:59.255258+0000","last_peered":"2023-10-14T17:00:59.255258+0000","last_clean":"2023-10-14T17:00:59.255258+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T17:00:59.255258+0000","last_undegraded":"2023-10-14T17:00:59.255258+0000","last_fullsized":"2023-10-14T17:00:59.255258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'673","last_scrub_stamp":"2023-10-14T17:00:59.255080+0000","last_deep_scrub":"23'673","last_deep_scrub_stamp":"2023-10-14T17:00:59.255080+0000","last_clean_scrub_stamp":"2023-10-14T17:00:59.255080+0000","objects_scrubbed":4,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:04.808721+0000","scrub_duration":0.0063237620000000001,"objects_trimmed":0,"snaptrim_duration":0.01972498,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"23'709","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:07.161938+0000","last_change":"2023-10-14T17:00:07.161914+0000","last_active":"2023-10-14T17:00:07.161938+0000","last_peered":"2023-10-14T17:00:07.161938+0000","last_clean":"2023-10-14T17:00:07.161938+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T17:00:07.161938+0000","last_undegraded":"2023-10-14T17:00:07.161938+0000","last_fullsized":"2023-10-14T17:00:07.161938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'709","last_scrub_stamp":"2023-10-14T17:00:07.161847+0000","last_deep_scrub":"23'709","last_deep_scrub_stamp":"2023-10-14T17:00:07.161847+0000","last_clean_scrub_stamp":"2023-10-14T17:00:07.161847+0000","objects_scrubbed":3,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:33:35.683711+0000","scrub_duration":0.003594294,"objects_trimmed":0,"snaptrim_duration":0.012044934,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"23'777","reported_seq":853,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:31.885442+0000","last_change":"2023-10-14T17:00:31.885415+0000","last_active":"2023-10-14T17:00:31.885442+0000","last_peered":"2023-10-14T17:00:31.885442+0000","last_clean":"2023-10-14T17:00:31.885442+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T17:00:31.885442+0000","last_undegraded":"2023-10-14T17:00:31.885442+0000","last_fullsized":"2023-10-14T17:00:31.885442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'777","last_scrub_stamp":"2023-10-14T17:00:31.885334+0000","last_deep_scrub":"23'777","last_deep_scrub_stamp":"2023-10-14T17:00:31.885334+0000","last_clean_scrub_stamp":"2023-10-14T17:00:31.885334+0000","objects_scrubbed":2,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:12.950748+0000","scrub_duration":0.0045303030000000003,"objects_trimmed":0,"snaptrim_duration":0.058085603999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"23'606","reported_seq":682,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.715441+0000","last_change":"2023-10-14T17:00:21.715409+0000","last_active":"2023-10-14T17:00:21.715441+0000","last_peered":"2023-10-14T17:00:21.715441+0000","last_clean":"2023-10-14T17:00:21.715441+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T17:00:21.715441+0000","last_undegraded":"2023-10-14T17:00:21.715441+0000","last_fullsized":"2023-10-14T17:00:21.715441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'606","last_scrub_stamp":"2023-10-14T17:00:21.715312+0000","last_deep_scrub":"23'606","last_deep_scrub_stamp":"2023-10-14T17:00:21.715312+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.715312+0000","objects_scrubbed":6,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:35.370865+0000","scrub_duration":0.0068255670000000003,"objects_trimmed":0,"snaptrim_duration":0.070423702000000005,"stat_sum":{"num_bytes":8224,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"23'396","reported_seq":472,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.082031+0000","last_change":"2023-10-14T17:00:14.081988+0000","last_active":"2023-10-14T17:00:14.082031+0000","last_peered":"2023-10-14T17:00:14.082031+0000","last_clean":"2023-10-14T17:00:14.082031+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T17:00:14.082031+0000","last_undegraded":"2023-10-14T17:00:14.082031+0000","last_fullsized":"2023-10-14T17:00:14.082031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'396","last_scrub_stamp":"2023-10-14T17:00:14.081897+0000","last_deep_scrub":"23'396","last_deep_scrub_stamp":"2023-10-14T17:00:14.081897+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.081897+0000","objects_scrubbed":2,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:21:14.426123+0000","scrub_duration":0.0038898180000000002,"objects_trimmed":0,"snaptrim_duration":0.048708460000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":30,"num_read_kb":20,"num_write":108,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41447,"ondisk_log_size":41447,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":190534230,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":33641,"num_write_kb":203675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381124608,"data_stored":381068460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33908,"ondisk_log_size":33908,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705748,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396524,"kb_used_data":86948,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93975316,"statfs":{"total":96636764160,"available":96230723584,"internally_reserved":0,"allocated":89034752,"data_stored":88829719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 17:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39300000000000002,"15min":0.41699999999999998},"min":{"1min":0.33000000000000002,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.39400000000000002,"15min":0.42499999999999999},"min":{"1min":0.28499999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45000000000000001}]},{"osd":1,"last update":"Sat Oct 14 17:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.82399999999999995,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.498},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.44900000000000001,"15min":0.47099999999999997},"min":{"1min":0.29699999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.79700000000000004,"5min":2.194,"15min":2.194},"last":0.48599999999999999}]},{"osd":2,"last update":"Sat Oct 14 17:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.28799999999999998,"15min":0.33600000000000002},"min":{"1min":0.245,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.442,"5min":0.45200000000000001,"15min":0.47699999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.34300000000000003},"min":{"1min":0.26700000000000002,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.49299999999999999},"last":0.42499999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705748,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426368,"kb_used_data":116792,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93945472,"statfs":{"total":96636764160,"available":96200163328,"internally_reserved":0,"allocated":119595008,"data_stored":119367674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 17:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47299999999999998,"15min":0.45300000000000001},"min":{"1min":0.32900000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66400000000000003,"5min":5.992,"15min":5.992},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51000000000000001,"15min":0.46400000000000002},"min":{"1min":0.35999999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.60299999999999998,"5min":9.2620000000000005,"15min":9.2620000000000005},"last":0.33100000000000002}]},{"osd":1,"last update":"Sat Oct 14 17:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.34799999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61299999999999999,"5min":6.266,"15min":6.266},"last":0.311},{"interface":"front","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.496},"min":{"1min":0.38900000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64100000000000001,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Sat Oct 14 17:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32300000000000001},"min":{"1min":0.27500000000000002,"5min":0.16,"15min":0.16},"max":{"1min":0.61199999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.35999999999999999},"min":{"1min":0.29499999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.56699999999999995,"5min":6.3170000000000002,"15min":6.3170000000000002},"last":0.373}]}]},{"osd":0,"up_from":9,"seq":38654705746,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397668,"kb_used_data":92188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":93974172,"statfs":{"total":96636764160,"available":96229552128,"internally_reserved":0,"allocated":94400512,"data_stored":94213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.27000000000000002,"15min":0.29499999999999998},"min":{"1min":0.23200000000000001,"5min":0.153,"15min":0.153},"max":{"1min":0.40699999999999997,"5min":0.443,"15min":0.443},"last":0.434},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.28299999999999997,"15min":0.30599999999999999},"min":{"1min":0.22800000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.39500000000000002,"5min":0.50800000000000001,"15min":0.53100000000000003},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59899999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.46300000000000002},"min":{"1min":0.34999999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.54700000000000004}]},{"osd":3,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41499999999999998,"15min":0.46800000000000003},"min":{"1min":0.36299999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68999999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42199999999999999,"15min":0.47499999999999998},"min":{"1min":0.375,"5min":0.25,"15min":0.25},"max":{"1min":0.63900000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.61699999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705747,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388312,"kb_used_data":78736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93983528,"statfs":{"total":96636764160,"available":96239132672,"internally_reserved":0,"allocated":80625664,"data_stored":80427560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.27600000000000002},"min":{"1min":0.20499999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.42799999999999999,"5min":0.441,"15min":0.441},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.30099999999999999},"min":{"1min":0.23799999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.443,"15min":0.46300000000000002},"min":{"1min":0.37,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.42899999999999999,"15min":0.46300000000000002},"min":{"1min":0.32600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.68400000000000005},"last":0.371}]},{"osd":3,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.434,"15min":0.45800000000000002},"min":{"1min":0.39200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.48899999999999999},"min":{"1min":0.36599999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69199999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.40500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94076928,"data_stored":94064538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":79691776,"data_stored":79691776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":119250944,"data_stored":119230438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88104960,"data_stored":88081708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":53391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":73798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T17:01:28.560 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:28.561 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-14T16:54:54.072525+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=16, tm_min=54, tm_sec=54, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=17, tm_min=0, tm_sec=3, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T17:01:28.562 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T17:01:46.152 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:46.156 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:46.158 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:48.563 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T17:01:48.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.696+0000 7f067f09f700 1 Processor -- start 2023-10-14T17:01:48.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.696+0000 7f067f09f700 1 -- start start 2023-10-14T17:01:48.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.696+0000 7f067f09f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f06780a6940 0x7f06780a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:48.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.696+0000 7f067f09f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06780a25c0 0x7f0678133f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:48.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.696+0000 7f067f09f700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06780a2df0 con 0x7f0678134450 2023-10-14T17:01:48.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.696+0000 7f067f09f700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06781338f0 con 0x7f06780a6940 2023-10-14T17:01:48.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.696+0000 7f067f09f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0678134890 con 0x7f06780a25c0 2023-10-14T17:01:48.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.696+0000 7f067ce3b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f06780a6940 0x7f06780a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:48.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.696+0000 7f067ce3b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f06780a6940 0x7f06780a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50184/0 (socket says 172.21.15.8:50184) 2023-10-14T17:01:48.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.696+0000 7f067d63c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0678134450 0x7f0678136e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51880/0 (socket says 172.21.15.8:51880) 2023-10-14T17:01:48.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.697+0000 7f067ce3b700 1 -- 172.21.15.8:0/2642978213 learned_addr learned my addr 172.21.15.8:0/2642978213 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:48.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.697+0000 7f0677fff700 1 --2- 172.21.15.8:0/2642978213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06780a25c0 0x7f0678133f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:48.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.697+0000 7f067ce3b700 1 -- 172.21.15.8:0/2642978213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06780a25c0 msgr2=0x7f0678133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:48.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.697+0000 7f067ce3b700 1 --2- 172.21.15.8:0/2642978213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06780a25c0 0x7f0678133f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:48.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.697+0000 7f067ce3b700 1 -- 172.21.15.8:0/2642978213 >> v1:172.21.15.8:6789/0 conn(0x7f0678134450 legacy=0x7f0678136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:48.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.697+0000 7f067ce3b700 1 -- 172.21.15.8:0/2642978213 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678133ae0 con 0x7f06780a6940 2023-10-14T17:01:48.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.697+0000 7f06777fe700 1 -- 172.21.15.8:0/2642978213 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364644281 0 0) 0x7f06780a2df0 con 0x7f0678134450 2023-10-14T17:01:48.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.697+0000 7f067ce3b700 1 --2- 172.21.15.8:0/2642978213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06780a6940 0x7f06780a1310 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7f06600099b0 tx=0x7f0660009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38631e99058f7a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:48.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.697+0000 7f06777fe700 1 -- 172.21.15.8:0/2642978213 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000b860 con 0x7f06780a6940 2023-10-14T17:01:48.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.697+0000 7f06777fe700 1 -- 172.21.15.8:0/2642978213 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066000b9c0 con 0x7f06780a6940 2023-10-14T17:01:48.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.697+0000 7f06777fe700 1 -- 172.21.15.8:0/2642978213 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000bd60 con 0x7f06780a6940 2023-10-14T17:01:48.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.698+0000 7f067f09f700 1 -- 172.21.15.8:0/2642978213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06780a6940 msgr2=0x7f06780a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:48.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.698+0000 7f067f09f700 1 --2- 172.21.15.8:0/2642978213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06780a6940 0x7f06780a1310 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7f06600099b0 tx=0x7f0660009250 comp rx=0 tx=0).stop 2023-10-14T17:01:48.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.698+0000 7f067f09f700 1 -- 172.21.15.8:0/2642978213 shutdown_connections 2023-10-14T17:01:48.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.698+0000 7f067f09f700 1 --2- 172.21.15.8:0/2642978213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06780a6940 0x7f06780a1310 unknown :-1 s=CLOSED pgs=2498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:48.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.698+0000 7f067f09f700 1 --2- 172.21.15.8:0/2642978213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06780a25c0 0x7f0678133f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:48.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.698+0000 7f067f09f700 1 -- 172.21.15.8:0/2642978213 >> 172.21.15.8:0/2642978213 conn(0x7f067806acd0 msgr2=0x7f06780701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:48.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.698+0000 7f067f09f700 1 -- 172.21.15.8:0/2642978213 shutdown_connections 2023-10-14T17:01:48.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.698+0000 7f067f09f700 1 -- 172.21.15.8:0/2642978213 wait complete. 2023-10-14T17:01:48.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.699+0000 7f067f09f700 1 Processor -- start 2023-10-14T17:01:48.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.699+0000 7f067f09f700 1 -- start start 2023-10-14T17:01:48.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.699+0000 7f067f09f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06780a25c0 0x7f0678146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.699+0000 7f067f09f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0678134450 0x7f0678146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:48.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.699+0000 7f067f09f700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f067813ac90 0x7f0678147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:48.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.699+0000 7f067f09f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0678095a70 con 0x7f06780a25c0 2023-10-14T17:01:48.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.699+0000 7f067f09f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0678099ca0 con 0x7f0678134450 2023-10-14T17:01:48.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.699+0000 7f067f09f700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0678097870 con 0x7f067813ac90 2023-10-14T17:01:48.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.699+0000 7f067ce3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06780a25c0 0x7f0678146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:48.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.699+0000 7f067ce3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06780a25c0 0x7f0678146a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50194/0 (socket says 172.21.15.8:50194) 2023-10-14T17:01:48.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.699+0000 7f067ce3b700 1 -- 172.21.15.8:0/1978910885 learned_addr learned my addr 172.21.15.8:0/1978910885 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:48.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f0677fff700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0678134450 0x7f0678146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:48.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f067d63c700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f067813ac90 0x7f0678147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:48.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f067ce3b700 1 -- 172.21.15.8:0/1978910885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f067813ac90 msgr2=0x7f0678147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:48.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f067ce3b700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f067813ac90 0x7f0678147510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:48.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f067ce3b700 1 -- 172.21.15.8:0/1978910885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0678134450 msgr2=0x7f0678146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:48.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f067ce3b700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0678134450 0x7f0678146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:48.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f067ce3b700 1 -- 172.21.15.8:0/1978910885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06600094f0 con 0x7f06780a25c0 2023-10-14T17:01:48.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f0677fff700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0678134450 0x7f0678146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:01:48.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f067ce3b700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06780a25c0 0x7f0678146a90 secure :-1 s=READY pgs=2499 cs=0 l=1 rev1=1 crypto rx=0x7f0678071120 tx=0x7f0660017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:48.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f0674ff9700 1 -- 172.21.15.8:0/1978910885 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0660024440 con 0x7f06780a25c0 2023-10-14T17:01:48.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f0674ff9700 1 -- 172.21.15.8:0/1978910885 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06600245a0 con 0x7f06780a25c0 2023-10-14T17:01:48.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f067f09f700 1 -- 172.21.15.8:0/1978910885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06780998f0 con 0x7f06780a25c0 2023-10-14T17:01:48.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f0674ff9700 1 -- 172.21.15.8:0/1978910885 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0660024960 con 0x7f06780a25c0 2023-10-14T17:01:48.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.700+0000 7f067f09f700 1 -- 172.21.15.8:0/1978910885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0678098de0 con 0x7f06780a25c0 2023-10-14T17:01:48.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.701+0000 7f067f09f700 1 -- 172.21.15.8:0/1978910885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06780708d0 con 0x7f06780a25c0 2023-10-14T17:01:48.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.702+0000 7f0674ff9700 1 -- 172.21.15.8:0/1978910885 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0660024d50 con 0x7f06780a25c0 2023-10-14T17:01:48.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.702+0000 7f0674ff9700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0658066f30 0x7f06580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:48.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.702+0000 7f0674ff9700 1 -- 172.21.15.8:0/1978910885 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f0660085b60 con 0x7f06780a25c0 2023-10-14T17:01:48.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.702+0000 7f0677fff700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0658066f30 0x7f06580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:48.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.702+0000 7f0677fff700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0658066f30 0x7f06580693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f067813b320 tx=0x7f0668008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:48.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.706+0000 7f0674ff9700 1 -- 172.21.15.8:0/1978910885 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0660053370 con 0x7f06780a25c0 2023-10-14T17:01:48.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.893+0000 7f067f09f700 1 -- 172.21.15.8:0/1978910885 --> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06781354e0 con 0x7f0658066f30 2023-10-14T17:01:48.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.901+0000 7f0674ff9700 1 -- 172.21.15.8:0/1978910885 <== mgr.4104 v2:172.21.15.8:6816/86003 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281423 (secure 0 0 0) 0x7f06781354e0 con 0x7f0658066f30 2023-10-14T17:01:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:01:48.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.904+0000 7f067f09f700 1 -- 172.21.15.8:0/1978910885 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0658066f30 msgr2=0x7f06580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:48.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.904+0000 7f067f09f700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0658066f30 0x7f06580693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f067813b320 tx=0x7f0668008040 comp rx=0 tx=0).stop 2023-10-14T17:01:48.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.904+0000 7f067f09f700 1 -- 172.21.15.8:0/1978910885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06780a25c0 msgr2=0x7f0678146a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:48.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.904+0000 7f067f09f700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06780a25c0 0x7f0678146a90 secure :-1 s=READY pgs=2499 cs=0 l=1 rev1=1 crypto rx=0x7f0678071120 tx=0x7f0660017000 comp rx=0 tx=0).stop 2023-10-14T17:01:48.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.904+0000 7f067f09f700 1 -- 172.21.15.8:0/1978910885 shutdown_connections 2023-10-14T17:01:48.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.904+0000 7f067f09f700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f0658066f30 0x7f06580693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:48.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.904+0000 7f067f09f700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f067813ac90 0x7f0678147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:48.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.904+0000 7f067f09f700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06780a25c0 0x7f0678146a90 unknown :-1 s=CLOSED pgs=2499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:48.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.904+0000 7f067f09f700 1 --2- 172.21.15.8:0/1978910885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0678134450 0x7f0678146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:48.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.904+0000 7f067f09f700 1 -- 172.21.15.8:0/1978910885 >> 172.21.15.8:0/1978910885 conn(0x7f067806acd0 msgr2=0x7f06780a9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:48.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.904+0000 7f067f09f700 1 -- 172.21.15.8:0/1978910885 shutdown_connections 2023-10-14T17:01:48.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:48.904+0000 7f067f09f700 1 -- 172.21.15.8:0/1978910885 wait complete. 2023-10-14T17:01:48.912 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-14T17:01:48.916 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2023-10-14T17:01:48.076955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":191251786,"num_objects":152,"num_object_clones":21,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":8,"num_read":210,"num_read_kb":798,"num_write":33908,"num_write_kb":206280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75475,"ondisk_log_size":75475,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1608872,"kb_used_data":374664,"kb_used_omap":0,"kb_used_meta":1234176,"kb_avail":375878488,"statfs":{"total":386547056640,"available":384899571712,"internally_reserved":0,"allocated":383655936,"data_stored":382838952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1263796224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002712"},"pg_stats":[{"pgid":"4.3f","version":"23'645","reported_seq":722,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:06.455532+0000","last_change":"2023-10-14T17:01:06.455487+0000","last_active":"2023-10-14T17:01:06.455532+0000","last_peered":"2023-10-14T17:01:06.455532+0000","last_clean":"2023-10-14T17:01:06.455532+0000","last_became_active":"2023-10-14T16:54:55.097369+0000","last_became_peered":"2023-10-14T16:54:55.097369+0000","last_unstale":"2023-10-14T17:01:06.455532+0000","last_undegraded":"2023-10-14T17:01:06.455532+0000","last_fullsized":"2023-10-14T17:01:06.455532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'645","last_scrub_stamp":"2023-10-14T17:01:06.455340+0000","last_deep_scrub":"23'645","last_deep_scrub_stamp":"2023-10-14T17:01:06.455340+0000","last_clean_scrub_stamp":"2023-10-14T17:01:06.455340+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:43.534168+0000","scrub_duration":0.001558242,"objects_trimmed":0,"snaptrim_duration":0.070427155000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"23'746","reported_seq":823,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:07.117624+0000","last_change":"2023-10-14T17:01:07.117586+0000","last_active":"2023-10-14T17:01:07.117624+0000","last_peered":"2023-10-14T17:01:07.117624+0000","last_clean":"2023-10-14T17:01:07.117624+0000","last_became_active":"2023-10-14T16:54:55.097190+0000","last_became_peered":"2023-10-14T16:54:55.097190+0000","last_unstale":"2023-10-14T17:01:07.117624+0000","last_undegraded":"2023-10-14T17:01:07.117624+0000","last_fullsized":"2023-10-14T17:01:07.117624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'746","last_scrub_stamp":"2023-10-14T17:01:07.117423+0000","last_deep_scrub":"23'746","last_deep_scrub_stamp":"2023-10-14T17:01:07.117423+0000","last_clean_scrub_stamp":"2023-10-14T17:01:07.117423+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:57.259326+0000","scrub_duration":0.002078969,"objects_trimmed":0,"snaptrim_duration":0.038749005000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"23'629","reported_seq":706,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:30.110652+0000","last_change":"2023-10-14T17:01:30.110615+0000","last_active":"2023-10-14T17:01:30.110652+0000","last_peered":"2023-10-14T17:01:30.110652+0000","last_clean":"2023-10-14T17:01:30.110652+0000","last_became_active":"2023-10-14T16:54:55.103121+0000","last_became_peered":"2023-10-14T16:54:55.103121+0000","last_unstale":"2023-10-14T17:01:30.110652+0000","last_undegraded":"2023-10-14T17:01:30.110652+0000","last_fullsized":"2023-10-14T17:01:30.110652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'629","last_scrub_stamp":"2023-10-14T17:01:30.110522+0000","last_deep_scrub":"23'629","last_deep_scrub_stamp":"2023-10-14T17:01:30.110522+0000","last_clean_scrub_stamp":"2023-10-14T17:01:30.110522+0000","objects_scrubbed":1,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:55:11.627188+0000","scrub_duration":0.0038322400000000002,"objects_trimmed":0,"snaptrim_duration":0.058152503000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"23'646","reported_seq":723,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:04.212672+0000","last_change":"2023-10-14T17:01:04.212641+0000","last_active":"2023-10-14T17:01:04.212672+0000","last_peered":"2023-10-14T17:01:04.212672+0000","last_clean":"2023-10-14T17:01:04.212672+0000","last_became_active":"2023-10-14T16:54:55.094360+0000","last_became_peered":"2023-10-14T16:54:55.094360+0000","last_unstale":"2023-10-14T17:01:04.212672+0000","last_undegraded":"2023-10-14T17:01:04.212672+0000","last_fullsized":"2023-10-14T17:01:04.212672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'646","last_scrub_stamp":"2023-10-14T17:01:04.212545+0000","last_deep_scrub":"23'646","last_deep_scrub_stamp":"2023-10-14T17:01:04.212545+0000","last_clean_scrub_stamp":"2023-10-14T17:01:04.212545+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:17:04.668707+0000","scrub_duration":0.0018472569999999999,"objects_trimmed":0,"snaptrim_duration":0.033834213000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"23'522","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:02.501798+0000","last_change":"2023-10-14T17:01:02.501748+0000","last_active":"2023-10-14T17:01:02.501798+0000","last_peered":"2023-10-14T17:01:02.501798+0000","last_clean":"2023-10-14T17:01:02.501798+0000","last_became_active":"2023-10-14T16:54:55.096634+0000","last_became_peered":"2023-10-14T16:54:55.096634+0000","last_unstale":"2023-10-14T17:01:02.501798+0000","last_undegraded":"2023-10-14T17:01:02.501798+0000","last_fullsized":"2023-10-14T17:01:02.501798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'522","last_scrub_stamp":"2023-10-14T17:01:02.501640+0000","last_deep_scrub":"23'522","last_deep_scrub_stamp":"2023-10-14T17:01:02.501640+0000","last_clean_scrub_stamp":"2023-10-14T17:01:02.501640+0000","objects_scrubbed":1,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:52.643543+0000","scrub_duration":0.0031778309999999999,"objects_trimmed":0,"snaptrim_duration":0.070258685000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"23'532","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:29.100606+0000","last_change":"2023-10-14T17:01:29.100558+0000","last_active":"2023-10-14T17:01:29.100606+0000","last_peered":"2023-10-14T17:01:29.100606+0000","last_clean":"2023-10-14T17:01:29.100606+0000","last_became_active":"2023-10-14T16:54:55.093137+0000","last_became_peered":"2023-10-14T16:54:55.093137+0000","last_unstale":"2023-10-14T17:01:29.100606+0000","last_undegraded":"2023-10-14T17:01:29.100606+0000","last_fullsized":"2023-10-14T17:01:29.100606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'532","last_scrub_stamp":"2023-10-14T17:01:29.100461+0000","last_deep_scrub":"23'532","last_deep_scrub_stamp":"2023-10-14T17:01:29.100461+0000","last_clean_scrub_stamp":"2023-10-14T17:01:29.100461+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:42:53.923166+0000","scrub_duration":0.001427602,"objects_trimmed":0,"snaptrim_duration":0.058053194000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"23'963","reported_seq":1040,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:27.083377+0000","last_change":"2023-10-14T17:01:27.083347+0000","last_active":"2023-10-14T17:01:27.083377+0000","last_peered":"2023-10-14T17:01:27.083377+0000","last_clean":"2023-10-14T17:01:27.083377+0000","last_became_active":"2023-10-14T16:54:55.092877+0000","last_became_peered":"2023-10-14T16:54:55.092877+0000","last_unstale":"2023-10-14T17:01:27.083377+0000","last_undegraded":"2023-10-14T17:01:27.083377+0000","last_fullsized":"2023-10-14T17:01:27.083377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'963","last_scrub_stamp":"2023-10-14T17:01:27.083249+0000","last_deep_scrub":"23'963","last_deep_scrub_stamp":"2023-10-14T17:01:27.083249+0000","last_clean_scrub_stamp":"2023-10-14T17:01:27.083249+0000","objects_scrubbed":1,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:46.485470+0000","scrub_duration":0.003211719,"objects_trimmed":0,"snaptrim_duration":0.058433710999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"23'666","reported_seq":743,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:19.991041+0000","last_change":"2023-10-14T17:01:19.990994+0000","last_active":"2023-10-14T17:01:19.991041+0000","last_peered":"2023-10-14T17:01:19.991041+0000","last_clean":"2023-10-14T17:01:19.991041+0000","last_became_active":"2023-10-14T16:54:55.092843+0000","last_became_peered":"2023-10-14T16:54:55.092843+0000","last_unstale":"2023-10-14T17:01:19.991041+0000","last_undegraded":"2023-10-14T17:01:19.991041+0000","last_fullsized":"2023-10-14T17:01:19.991041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'666","last_scrub_stamp":"2023-10-14T17:01:19.990847+0000","last_deep_scrub":"23'666","last_deep_scrub_stamp":"2023-10-14T17:01:19.990847+0000","last_clean_scrub_stamp":"2023-10-14T17:01:19.990847+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:39:38.364521+0000","scrub_duration":0.0018583849999999999,"objects_trimmed":0,"snaptrim_duration":0.057530364000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"23'727","reported_seq":804,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:00.537609+0000","last_change":"2023-10-14T17:01:00.537582+0000","last_active":"2023-10-14T17:01:00.537609+0000","last_peered":"2023-10-14T17:01:00.537609+0000","last_clean":"2023-10-14T17:01:00.537609+0000","last_became_active":"2023-10-14T16:54:55.097652+0000","last_became_peered":"2023-10-14T16:54:55.097652+0000","last_unstale":"2023-10-14T17:01:00.537609+0000","last_undegraded":"2023-10-14T17:01:00.537609+0000","last_fullsized":"2023-10-14T17:01:00.537609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'727","last_scrub_stamp":"2023-10-14T17:01:00.537474+0000","last_deep_scrub":"23'727","last_deep_scrub_stamp":"2023-10-14T17:01:00.537474+0000","last_clean_scrub_stamp":"2023-10-14T17:01:00.537474+0000","objects_scrubbed":1,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:53.640313+0000","scrub_duration":0.0032466209999999999,"objects_trimmed":0,"snaptrim_duration":0.070350251000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"23'592","reported_seq":669,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:18.981743+0000","last_change":"2023-10-14T17:01:18.981700+0000","last_active":"2023-10-14T17:01:18.981743+0000","last_peered":"2023-10-14T17:01:18.981743+0000","last_clean":"2023-10-14T17:01:18.981743+0000","last_became_active":"2023-10-14T16:54:55.093941+0000","last_became_peered":"2023-10-14T16:54:55.093941+0000","last_unstale":"2023-10-14T17:01:18.981743+0000","last_undegraded":"2023-10-14T17:01:18.981743+0000","last_fullsized":"2023-10-14T17:01:18.981743+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'592","last_scrub_stamp":"2023-10-14T17:01:18.981601+0000","last_deep_scrub":"23'592","last_deep_scrub_stamp":"2023-10-14T17:01:18.981601+0000","last_clean_scrub_stamp":"2023-10-14T17:01:18.981601+0000","objects_scrubbed":1,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:28.399675+0000","scrub_duration":0.0037309090000000001,"objects_trimmed":0,"snaptrim_duration":0.057828565999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"23'506","reported_seq":582,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:02.265952+0000","last_change":"2023-10-14T17:01:02.265922+0000","last_active":"2023-10-14T17:01:02.265952+0000","last_peered":"2023-10-14T17:01:02.265952+0000","last_clean":"2023-10-14T17:01:02.265952+0000","last_became_active":"2023-10-14T16:54:55.097719+0000","last_became_peered":"2023-10-14T16:54:55.097719+0000","last_unstale":"2023-10-14T17:01:02.265952+0000","last_undegraded":"2023-10-14T17:01:02.265952+0000","last_fullsized":"2023-10-14T17:01:02.265952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'506","last_scrub_stamp":"2023-10-14T17:01:02.265830+0000","last_deep_scrub":"23'506","last_deep_scrub_stamp":"2023-10-14T17:01:02.265830+0000","last_clean_scrub_stamp":"2023-10-14T17:01:02.265830+0000","objects_scrubbed":2,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:21.484359+0000","scrub_duration":0.0038646399999999999,"objects_trimmed":0,"snaptrim_duration":0.039012109000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"23'511","reported_seq":588,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:58.478777+0000","last_change":"2023-10-14T17:00:58.478747+0000","last_active":"2023-10-14T17:00:58.478777+0000","last_peered":"2023-10-14T17:00:58.478777+0000","last_clean":"2023-10-14T17:00:58.478777+0000","last_became_active":"2023-10-14T16:54:55.099817+0000","last_became_peered":"2023-10-14T16:54:55.099817+0000","last_unstale":"2023-10-14T17:00:58.478777+0000","last_undegraded":"2023-10-14T17:00:58.478777+0000","last_fullsized":"2023-10-14T17:00:58.478777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'511","last_scrub_stamp":"2023-10-14T17:00:58.478655+0000","last_deep_scrub":"23'511","last_deep_scrub_stamp":"2023-10-14T17:00:58.478655+0000","last_clean_scrub_stamp":"2023-10-14T17:00:58.478655+0000","objects_scrubbed":1,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:05.432324+0000","scrub_duration":0.0037711939999999998,"objects_trimmed":0,"snaptrim_duration":0.047436036000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"23'513","reported_seq":590,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:55.535325+0000","last_change":"2023-10-14T17:00:55.535277+0000","last_active":"2023-10-14T17:00:55.535325+0000","last_peered":"2023-10-14T17:00:55.535325+0000","last_clean":"2023-10-14T17:00:55.535325+0000","last_became_active":"2023-10-14T16:54:55.092061+0000","last_became_peered":"2023-10-14T16:54:55.092061+0000","last_unstale":"2023-10-14T17:00:55.535325+0000","last_undegraded":"2023-10-14T17:00:55.535325+0000","last_fullsized":"2023-10-14T17:00:55.535325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'513","last_scrub_stamp":"2023-10-14T17:00:55.535176+0000","last_deep_scrub":"23'513","last_deep_scrub_stamp":"2023-10-14T17:00:55.535176+0000","last_clean_scrub_stamp":"2023-10-14T17:00:55.535176+0000","objects_scrubbed":1,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:20.386408+0000","scrub_duration":0.0042822859999999997,"objects_trimmed":0,"snaptrim_duration":0.070191972000000005,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"23'760","reported_seq":836,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:00.231581+0000","last_change":"2023-10-14T17:01:00.231548+0000","last_active":"2023-10-14T17:01:00.231581+0000","last_peered":"2023-10-14T17:01:00.231581+0000","last_clean":"2023-10-14T17:01:00.231581+0000","last_became_active":"2023-10-14T16:54:55.107263+0000","last_became_peered":"2023-10-14T16:54:55.107263+0000","last_unstale":"2023-10-14T17:01:00.231581+0000","last_undegraded":"2023-10-14T17:01:00.231581+0000","last_fullsized":"2023-10-14T17:01:00.231581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'760","last_scrub_stamp":"2023-10-14T17:01:00.231450+0000","last_deep_scrub":"23'760","last_deep_scrub_stamp":"2023-10-14T17:01:00.231450+0000","last_clean_scrub_stamp":"2023-10-14T17:01:00.231450+0000","objects_scrubbed":3,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:25.082681+0000","scrub_duration":0.0049133129999999999,"objects_trimmed":0,"snaptrim_duration":0.036605058000000003,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"23'657","reported_seq":734,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:05.190463+0000","last_change":"2023-10-14T17:01:05.190436+0000","last_active":"2023-10-14T17:01:05.190463+0000","last_peered":"2023-10-14T17:01:05.190463+0000","last_clean":"2023-10-14T17:01:05.190463+0000","last_became_active":"2023-10-14T16:54:55.097225+0000","last_became_peered":"2023-10-14T16:54:55.097225+0000","last_unstale":"2023-10-14T17:01:05.190463+0000","last_undegraded":"2023-10-14T17:01:05.190463+0000","last_fullsized":"2023-10-14T17:01:05.190463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'657","last_scrub_stamp":"2023-10-14T17:01:05.190351+0000","last_deep_scrub":"23'657","last_deep_scrub_stamp":"2023-10-14T17:01:05.190351+0000","last_clean_scrub_stamp":"2023-10-14T17:01:05.190351+0000","objects_scrubbed":2,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:58.293190+0000","scrub_duration":0.0042399380000000004,"objects_trimmed":0,"snaptrim_duration":0.038947427,"stat_sum":{"num_bytes":4105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"23'748","reported_seq":824,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:17.932535+0000","last_change":"2023-10-14T17:01:17.932506+0000","last_active":"2023-10-14T17:01:17.932535+0000","last_peered":"2023-10-14T17:01:17.932535+0000","last_clean":"2023-10-14T17:01:17.932535+0000","last_became_active":"2023-10-14T16:54:55.093878+0000","last_became_peered":"2023-10-14T16:54:55.093878+0000","last_unstale":"2023-10-14T17:01:17.932535+0000","last_undegraded":"2023-10-14T17:01:17.932535+0000","last_fullsized":"2023-10-14T17:01:17.932535+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'748","last_scrub_stamp":"2023-10-14T17:01:17.932419+0000","last_deep_scrub":"23'748","last_deep_scrub_stamp":"2023-10-14T17:01:17.932419+0000","last_clean_scrub_stamp":"2023-10-14T17:01:17.932419+0000","objects_scrubbed":3,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:13:59.793011+0000","scrub_duration":0.0045884510000000003,"objects_trimmed":0,"snaptrim_duration":0.058345898,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"23'595","reported_seq":672,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:59.555851+0000","last_change":"2023-10-14T17:00:59.555819+0000","last_active":"2023-10-14T17:00:59.555851+0000","last_peered":"2023-10-14T17:00:59.555851+0000","last_clean":"2023-10-14T17:00:59.555851+0000","last_became_active":"2023-10-14T16:54:55.096281+0000","last_became_peered":"2023-10-14T16:54:55.096281+0000","last_unstale":"2023-10-14T17:00:59.555851+0000","last_undegraded":"2023-10-14T17:00:59.555851+0000","last_fullsized":"2023-10-14T17:00:59.555851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'595","last_scrub_stamp":"2023-10-14T17:00:59.555722+0000","last_deep_scrub":"23'595","last_deep_scrub_stamp":"2023-10-14T17:00:59.555722+0000","last_clean_scrub_stamp":"2023-10-14T17:00:59.555722+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:17:00.011883+0000","scrub_duration":0.0014926679999999999,"objects_trimmed":0,"snaptrim_duration":0.071573409000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"23'694","reported_seq":771,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:14.909381+0000","last_change":"2023-10-14T17:01:14.909338+0000","last_active":"2023-10-14T17:01:14.909381+0000","last_peered":"2023-10-14T17:01:14.909381+0000","last_clean":"2023-10-14T17:01:14.909381+0000","last_became_active":"2023-10-14T16:54:55.100136+0000","last_became_peered":"2023-10-14T16:54:55.100136+0000","last_unstale":"2023-10-14T17:01:14.909381+0000","last_undegraded":"2023-10-14T17:01:14.909381+0000","last_fullsized":"2023-10-14T17:01:14.909381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'694","last_scrub_stamp":"2023-10-14T17:01:14.909187+0000","last_deep_scrub":"23'694","last_deep_scrub_stamp":"2023-10-14T17:01:14.909187+0000","last_clean_scrub_stamp":"2023-10-14T17:01:14.909187+0000","objects_scrubbed":1,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:05.126837+0000","scrub_duration":0.0039831490000000001,"objects_trimmed":0,"snaptrim_duration":0.057407435999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"23'574","reported_seq":652,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:57.611618+0000","last_change":"2023-10-14T17:00:57.611589+0000","last_active":"2023-10-14T17:00:57.611618+0000","last_peered":"2023-10-14T17:00:57.611618+0000","last_clean":"2023-10-14T17:00:57.611618+0000","last_became_active":"2023-10-14T16:54:55.089957+0000","last_became_peered":"2023-10-14T16:54:55.089957+0000","last_unstale":"2023-10-14T17:00:57.611618+0000","last_undegraded":"2023-10-14T17:00:57.611618+0000","last_fullsized":"2023-10-14T17:00:57.611618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'574","last_scrub_stamp":"2023-10-14T17:00:57.611471+0000","last_deep_scrub":"23'574","last_deep_scrub_stamp":"2023-10-14T17:00:57.611471+0000","last_clean_scrub_stamp":"2023-10-14T17:00:57.611471+0000","objects_scrubbed":2,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:16.830000+0000","scrub_duration":0.004107383,"objects_trimmed":0,"snaptrim_duration":0.070060102999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"23'761","reported_seq":838,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:11.932288+0000","last_change":"2023-10-14T17:01:11.932262+0000","last_active":"2023-10-14T17:01:11.932288+0000","last_peered":"2023-10-14T17:01:11.932288+0000","last_clean":"2023-10-14T17:01:11.932288+0000","last_became_active":"2023-10-14T16:54:55.100556+0000","last_became_peered":"2023-10-14T16:54:55.100556+0000","last_unstale":"2023-10-14T17:01:11.932288+0000","last_undegraded":"2023-10-14T17:01:11.932288+0000","last_fullsized":"2023-10-14T17:01:11.932288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'761","last_scrub_stamp":"2023-10-14T17:01:11.932160+0000","last_deep_scrub":"23'761","last_deep_scrub_stamp":"2023-10-14T17:01:11.932160+0000","last_clean_scrub_stamp":"2023-10-14T17:01:11.932160+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:48.819858+0000","scrub_duration":0.0019223389999999999,"objects_trimmed":0,"snaptrim_duration":0.056633790000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"23'812","reported_seq":889,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:10.102647+0000","last_change":"2023-10-14T17:01:10.102605+0000","last_active":"2023-10-14T17:01:10.102647+0000","last_peered":"2023-10-14T17:01:10.102647+0000","last_clean":"2023-10-14T17:01:10.102647+0000","last_became_active":"2023-10-14T16:54:55.107306+0000","last_became_peered":"2023-10-14T16:54:55.107306+0000","last_unstale":"2023-10-14T17:01:10.102647+0000","last_undegraded":"2023-10-14T17:01:10.102647+0000","last_fullsized":"2023-10-14T17:01:10.102647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'812","last_scrub_stamp":"2023-10-14T17:01:10.102501+0000","last_deep_scrub":"23'812","last_deep_scrub_stamp":"2023-10-14T17:01:10.102501+0000","last_clean_scrub_stamp":"2023-10-14T17:01:10.102501+0000","objects_scrubbed":2,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:31.475803+0000","scrub_duration":0.004387068,"objects_trimmed":0,"snaptrim_duration":0.038418550000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"23'695","reported_seq":772,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:54.580738+0000","last_change":"2023-10-14T17:00:54.580711+0000","last_active":"2023-10-14T17:00:54.580738+0000","last_peered":"2023-10-14T17:00:54.580738+0000","last_clean":"2023-10-14T17:00:54.580738+0000","last_became_active":"2023-10-14T16:54:55.096496+0000","last_became_peered":"2023-10-14T16:54:55.096496+0000","last_unstale":"2023-10-14T17:00:54.580738+0000","last_undegraded":"2023-10-14T17:00:54.580738+0000","last_fullsized":"2023-10-14T17:00:54.580738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'695","last_scrub_stamp":"2023-10-14T17:00:54.580623+0000","last_deep_scrub":"23'695","last_deep_scrub_stamp":"2023-10-14T17:00:54.580623+0000","last_clean_scrub_stamp":"2023-10-14T17:00:54.580623+0000","objects_scrubbed":1,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:00.134264+0000","scrub_duration":0.0030110179999999999,"objects_trimmed":0,"snaptrim_duration":0.065688290999999996,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"23'638","reported_seq":715,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:41.237813+0000","last_change":"2023-10-14T17:00:41.237783+0000","last_active":"2023-10-14T17:00:41.237813+0000","last_peered":"2023-10-14T17:00:41.237813+0000","last_clean":"2023-10-14T17:00:41.237813+0000","last_became_active":"2023-10-14T16:54:55.102500+0000","last_became_peered":"2023-10-14T16:54:55.102500+0000","last_unstale":"2023-10-14T17:00:41.237813+0000","last_undegraded":"2023-10-14T17:00:41.237813+0000","last_fullsized":"2023-10-14T17:00:41.237813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'638","last_scrub_stamp":"2023-10-14T17:00:41.237668+0000","last_deep_scrub":"23'638","last_deep_scrub_stamp":"2023-10-14T17:00:41.237668+0000","last_clean_scrub_stamp":"2023-10-14T17:00:41.237668+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:17.477170+0000","scrub_duration":0.0015379790000000001,"objects_trimmed":0,"snaptrim_duration":0.011260075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"23'846","reported_seq":923,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:37.816280+0000","last_change":"2023-10-14T17:00:37.816253+0000","last_active":"2023-10-14T17:00:37.816280+0000","last_peered":"2023-10-14T17:00:37.816280+0000","last_clean":"2023-10-14T17:00:37.816280+0000","last_became_active":"2023-10-14T16:54:55.100051+0000","last_became_peered":"2023-10-14T16:54:55.100051+0000","last_unstale":"2023-10-14T17:00:37.816280+0000","last_undegraded":"2023-10-14T17:00:37.816280+0000","last_fullsized":"2023-10-14T17:00:37.816280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'846","last_scrub_stamp":"2023-10-14T17:00:37.816136+0000","last_deep_scrub":"23'846","last_deep_scrub_stamp":"2023-10-14T17:00:37.816136+0000","last_clean_scrub_stamp":"2023-10-14T17:00:37.816136+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:19.053769+0000","scrub_duration":0.001974478,"objects_trimmed":0,"snaptrim_duration":0.058152492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"23'636","reported_seq":713,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:47.417925+0000","last_change":"2023-10-14T17:00:47.417893+0000","last_active":"2023-10-14T17:00:47.417925+0000","last_peered":"2023-10-14T17:00:47.417925+0000","last_clean":"2023-10-14T17:00:47.417925+0000","last_became_active":"2023-10-14T16:54:55.100067+0000","last_became_peered":"2023-10-14T16:54:55.100067+0000","last_unstale":"2023-10-14T17:00:47.417925+0000","last_undegraded":"2023-10-14T17:00:47.417925+0000","last_fullsized":"2023-10-14T17:00:47.417925+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'636","last_scrub_stamp":"2023-10-14T17:00:47.417788+0000","last_deep_scrub":"23'636","last_deep_scrub_stamp":"2023-10-14T17:00:47.417788+0000","last_clean_scrub_stamp":"2023-10-14T17:00:47.417788+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:44.456851+0000","scrub_duration":0.002011554,"objects_trimmed":0,"snaptrim_duration":0.048983802,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"23'679","reported_seq":756,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:17.045500+0000","last_change":"2023-10-14T17:00:17.045457+0000","last_active":"2023-10-14T17:00:17.045500+0000","last_peered":"2023-10-14T17:00:17.045500+0000","last_clean":"2023-10-14T17:00:17.045500+0000","last_became_active":"2023-10-14T16:54:55.107289+0000","last_became_peered":"2023-10-14T16:54:55.107289+0000","last_unstale":"2023-10-14T17:00:17.045500+0000","last_undegraded":"2023-10-14T17:00:17.045500+0000","last_fullsized":"2023-10-14T17:00:17.045500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'679","last_scrub_stamp":"2023-10-14T17:00:17.045319+0000","last_deep_scrub":"23'679","last_deep_scrub_stamp":"2023-10-14T17:00:17.045319+0000","last_clean_scrub_stamp":"2023-10-14T17:00:17.045319+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:24.925526+0000","scrub_duration":0.0014699489999999999,"objects_trimmed":0,"snaptrim_duration":0.047799974000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"23'513","reported_seq":590,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:42.696392+0000","last_change":"2023-10-14T17:00:42.696361+0000","last_active":"2023-10-14T17:00:42.696392+0000","last_peered":"2023-10-14T17:00:42.696392+0000","last_clean":"2023-10-14T17:00:42.696392+0000","last_became_active":"2023-10-14T16:54:55.103444+0000","last_became_peered":"2023-10-14T16:54:55.103444+0000","last_unstale":"2023-10-14T17:00:42.696392+0000","last_undegraded":"2023-10-14T17:00:42.696392+0000","last_fullsized":"2023-10-14T17:00:42.696392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'513","last_scrub_stamp":"2023-10-14T17:00:42.696267+0000","last_deep_scrub":"23'513","last_deep_scrub_stamp":"2023-10-14T17:00:42.696267+0000","last_clean_scrub_stamp":"2023-10-14T17:00:42.696267+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:28.060990+0000","scrub_duration":0.0019776569999999999,"objects_trimmed":0,"snaptrim_duration":0.058565578,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1535","reported_seq":1563,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:49.427466+0000","last_change":"2023-10-14T17:00:49.427436+0000","last_active":"2023-10-14T17:00:49.427466+0000","last_peered":"2023-10-14T17:00:49.427466+0000","last_clean":"2023-10-14T17:00:49.427466+0000","last_became_active":"2023-10-14T16:54:54.098010+0000","last_became_peered":"2023-10-14T16:54:54.098010+0000","last_unstale":"2023-10-14T17:00:49.427466+0000","last_undegraded":"2023-10-14T17:00:49.427466+0000","last_fullsized":"2023-10-14T17:00:49.427466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1535","last_scrub_stamp":"2023-10-14T17:00:49.427350+0000","last_deep_scrub":"23'1535","last_deep_scrub_stamp":"2023-10-14T17:00:49.427350+0000","last_clean_scrub_stamp":"2023-10-14T17:00:49.427350+0000","objects_scrubbed":3,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:46.466413+0000","scrub_duration":0.028509313000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1524,"num_write_kb":13073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"23'655","reported_seq":733,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:25.725868+0000","last_change":"2023-10-14T17:00:25.725836+0000","last_active":"2023-10-14T17:00:25.725868+0000","last_peered":"2023-10-14T17:00:25.725868+0000","last_clean":"2023-10-14T17:00:25.725868+0000","last_became_active":"2023-10-14T16:54:55.097186+0000","last_became_peered":"2023-10-14T16:54:55.097186+0000","last_unstale":"2023-10-14T17:00:25.725868+0000","last_undegraded":"2023-10-14T17:00:25.725868+0000","last_fullsized":"2023-10-14T17:00:25.725868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'655","last_scrub_stamp":"2023-10-14T17:00:25.725747+0000","last_deep_scrub":"23'655","last_deep_scrub_stamp":"2023-10-14T17:00:25.725747+0000","last_clean_scrub_stamp":"2023-10-14T17:00:25.725747+0000","objects_scrubbed":2,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:50.968836+0000","scrub_duration":0.0036407990000000001,"objects_trimmed":0,"snaptrim_duration":0.067459389999999994,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"23'756","reported_seq":784,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:16.095374+0000","last_change":"2023-10-14T17:00:16.095338+0000","last_active":"2023-10-14T17:00:16.095374+0000","last_peered":"2023-10-14T17:00:16.095374+0000","last_clean":"2023-10-14T17:00:16.095374+0000","last_became_active":"2023-10-14T16:54:54.096591+0000","last_became_peered":"2023-10-14T16:54:54.096591+0000","last_unstale":"2023-10-14T17:00:16.095374+0000","last_undegraded":"2023-10-14T17:00:16.095374+0000","last_fullsized":"2023-10-14T17:00:16.095374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'756","last_scrub_stamp":"2023-10-14T17:00:16.095246+0000","last_deep_scrub":"23'756","last_deep_scrub_stamp":"2023-10-14T17:00:16.095246+0000","last_clean_scrub_stamp":"2023-10-14T17:00:16.095246+0000","objects_scrubbed":1,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:54.744269+0000","scrub_duration":0.013423025999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"23'585","reported_seq":662,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:16.588712+0000","last_change":"2023-10-14T17:00:16.588677+0000","last_active":"2023-10-14T17:00:16.588712+0000","last_peered":"2023-10-14T17:00:16.588712+0000","last_clean":"2023-10-14T17:00:16.588712+0000","last_became_active":"2023-10-14T16:54:55.090573+0000","last_became_peered":"2023-10-14T16:54:55.090573+0000","last_unstale":"2023-10-14T17:00:16.588712+0000","last_undegraded":"2023-10-14T17:00:16.588712+0000","last_fullsized":"2023-10-14T17:00:16.588712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'585","last_scrub_stamp":"2023-10-14T17:00:16.588581+0000","last_deep_scrub":"23'585","last_deep_scrub_stamp":"2023-10-14T17:00:16.588581+0000","last_clean_scrub_stamp":"2023-10-14T17:00:16.588581+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:41.060437+0000","scrub_duration":0.0019550330000000001,"objects_trimmed":0,"snaptrim_duration":0.070886901000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"23'1509","reported_seq":1537,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:18.073307+0000","last_change":"2023-10-14T17:00:18.073275+0000","last_active":"2023-10-14T17:00:18.073307+0000","last_peered":"2023-10-14T17:00:18.073307+0000","last_clean":"2023-10-14T17:00:18.073307+0000","last_became_active":"2023-10-14T16:54:54.094696+0000","last_became_peered":"2023-10-14T16:54:54.094696+0000","last_unstale":"2023-10-14T17:00:18.073307+0000","last_undegraded":"2023-10-14T17:00:18.073307+0000","last_fullsized":"2023-10-14T17:00:18.073307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1509","last_scrub_stamp":"2023-10-14T17:00:18.073180+0000","last_deep_scrub":"23'1509","last_deep_scrub_stamp":"2023-10-14T17:00:18.073180+0000","last_clean_scrub_stamp":"2023-10-14T17:00:18.073180+0000","objects_scrubbed":3,"log_size":1509,"log_dups_size":0,"ondisk_log_size":1509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:58.302825+0000","scrub_duration":0.026462619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"23'595","reported_seq":672,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:26.833140+0000","last_change":"2023-10-14T17:00:26.833112+0000","last_active":"2023-10-14T17:00:26.833140+0000","last_peered":"2023-10-14T17:00:26.833140+0000","last_clean":"2023-10-14T17:00:26.833140+0000","last_became_active":"2023-10-14T16:54:55.100114+0000","last_became_peered":"2023-10-14T16:54:55.100114+0000","last_unstale":"2023-10-14T17:00:26.833140+0000","last_undegraded":"2023-10-14T17:00:26.833140+0000","last_fullsized":"2023-10-14T17:00:26.833140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'595","last_scrub_stamp":"2023-10-14T17:00:26.833028+0000","last_deep_scrub":"23'595","last_deep_scrub_stamp":"2023-10-14T17:00:26.833028+0000","last_clean_scrub_stamp":"2023-10-14T17:00:26.833028+0000","objects_scrubbed":2,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:30.522108+0000","scrub_duration":0.0043885740000000001,"objects_trimmed":0,"snaptrim_duration":0.058803686000000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"22'4","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:31.648411+0000","last_change":"2023-10-14T17:00:31.648376+0000","last_active":"2023-10-14T17:00:31.648411+0000","last_peered":"2023-10-14T17:00:31.648411+0000","last_clean":"2023-10-14T17:00:31.648411+0000","last_became_active":"2023-10-14T16:54:54.097435+0000","last_became_peered":"2023-10-14T16:54:54.097435+0000","last_unstale":"2023-10-14T17:00:31.648411+0000","last_undegraded":"2023-10-14T17:00:31.648411+0000","last_fullsized":"2023-10-14T17:00:31.648411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2023-10-14T17:00:31.648277+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2023-10-14T17:00:31.648277+0000","last_clean_scrub_stamp":"2023-10-14T17:00:31.648277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:35.337357+0000","scrub_duration":0.0020350590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"23'583","reported_seq":660,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:12.106374+0000","last_change":"2023-10-14T17:00:12.106339+0000","last_active":"2023-10-14T17:00:12.106374+0000","last_peered":"2023-10-14T17:00:12.106374+0000","last_clean":"2023-10-14T17:00:12.106374+0000","last_became_active":"2023-10-14T16:54:55.098884+0000","last_became_peered":"2023-10-14T16:54:55.098884+0000","last_unstale":"2023-10-14T17:00:12.106374+0000","last_undegraded":"2023-10-14T17:00:12.106374+0000","last_fullsized":"2023-10-14T17:00:12.106374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'583","last_scrub_stamp":"2023-10-14T17:00:12.106239+0000","last_deep_scrub":"23'583","last_deep_scrub_stamp":"2023-10-14T17:00:12.106239+0000","last_clean_scrub_stamp":"2023-10-14T17:00:12.106239+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:53:48.745008+0000","scrub_duration":0.0023297560000000001,"objects_trimmed":0,"snaptrim_duration":0.024750503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"23'757","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:26.505195+0000","last_change":"2023-10-14T17:00:26.505158+0000","last_active":"2023-10-14T17:00:26.505195+0000","last_peered":"2023-10-14T17:00:26.505195+0000","last_clean":"2023-10-14T17:00:26.505195+0000","last_became_active":"2023-10-14T16:54:54.100373+0000","last_became_peered":"2023-10-14T16:54:54.100373+0000","last_unstale":"2023-10-14T17:00:26.505195+0000","last_undegraded":"2023-10-14T17:00:26.505195+0000","last_fullsized":"2023-10-14T17:00:26.505195+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'757","last_scrub_stamp":"2023-10-14T17:00:26.505033+0000","last_deep_scrub":"23'757","last_deep_scrub_stamp":"2023-10-14T17:00:26.505033+0000","last_clean_scrub_stamp":"2023-10-14T17:00:26.505033+0000","objects_scrubbed":1,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:40.160585+0000","scrub_duration":0.014321274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"23'570","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:12.612196+0000","last_change":"2023-10-14T17:00:12.612165+0000","last_active":"2023-10-14T17:00:12.612196+0000","last_peered":"2023-10-14T17:00:12.612196+0000","last_clean":"2023-10-14T17:00:12.612196+0000","last_became_active":"2023-10-14T16:54:55.090205+0000","last_became_peered":"2023-10-14T16:54:55.090205+0000","last_unstale":"2023-10-14T17:00:12.612196+0000","last_undegraded":"2023-10-14T17:00:12.612196+0000","last_fullsized":"2023-10-14T17:00:12.612196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'570","last_scrub_stamp":"2023-10-14T17:00:12.612058+0000","last_deep_scrub":"23'570","last_deep_scrub_stamp":"2023-10-14T17:00:12.612058+0000","last_clean_scrub_stamp":"2023-10-14T17:00:12.612058+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:51.261080+0000","scrub_duration":0.001901631,"objects_trimmed":0,"snaptrim_duration":0.067572238000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"23'801","reported_seq":829,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:47.460594+0000","last_change":"2023-10-14T17:00:47.460567+0000","last_active":"2023-10-14T17:00:47.460594+0000","last_peered":"2023-10-14T17:00:47.460594+0000","last_clean":"2023-10-14T17:00:47.460594+0000","last_became_active":"2023-10-14T16:54:54.097626+0000","last_became_peered":"2023-10-14T16:54:54.097626+0000","last_unstale":"2023-10-14T17:00:47.460594+0000","last_undegraded":"2023-10-14T17:00:47.460594+0000","last_fullsized":"2023-10-14T17:00:47.460594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'801","last_scrub_stamp":"2023-10-14T17:00:47.460484+0000","last_deep_scrub":"23'801","last_deep_scrub_stamp":"2023-10-14T17:00:47.460484+0000","last_clean_scrub_stamp":"2023-10-14T17:00:47.460484+0000","objects_scrubbed":3,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:28.698116+0000","scrub_duration":0.01328207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"23'414","reported_seq":491,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:09.150688+0000","last_change":"2023-10-14T17:00:09.150657+0000","last_active":"2023-10-14T17:00:09.150688+0000","last_peered":"2023-10-14T17:00:09.150688+0000","last_clean":"2023-10-14T17:00:09.150688+0000","last_became_active":"2023-10-14T16:54:55.104122+0000","last_became_peered":"2023-10-14T16:54:55.104122+0000","last_unstale":"2023-10-14T17:00:09.150688+0000","last_undegraded":"2023-10-14T17:00:09.150688+0000","last_fullsized":"2023-10-14T17:00:09.150688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'414","last_scrub_stamp":"2023-10-14T17:00:09.150551+0000","last_deep_scrub":"23'414","last_deep_scrub_stamp":"2023-10-14T17:00:09.150551+0000","last_clean_scrub_stamp":"2023-10-14T17:00:09.150551+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:46:38.484247+0000","scrub_duration":0.0020073140000000001,"objects_trimmed":0,"snaptrim_duration":0.013962693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'2303","reported_seq":2331,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:24.855552+0000","last_change":"2023-10-14T17:00:24.855526+0000","last_active":"2023-10-14T17:00:24.855552+0000","last_peered":"2023-10-14T17:00:24.855552+0000","last_clean":"2023-10-14T17:00:24.855552+0000","last_became_active":"2023-10-14T16:54:54.098631+0000","last_became_peered":"2023-10-14T16:54:54.098631+0000","last_unstale":"2023-10-14T17:00:24.855552+0000","last_undegraded":"2023-10-14T17:00:24.855552+0000","last_fullsized":"2023-10-14T17:00:24.855552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2303","last_scrub_stamp":"2023-10-14T17:00:24.855445+0000","last_deep_scrub":"23'2303","last_deep_scrub_stamp":"2023-10-14T17:00:24.855445+0000","last_clean_scrub_stamp":"2023-10-14T17:00:24.855445+0000","objects_scrubbed":6,"log_size":2303,"log_dups_size":0,"ondisk_log_size":2303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:55.570593+0000","scrub_duration":0.039868383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2289,"num_write_kb":13405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"23'485","reported_seq":562,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:19.481760+0000","last_change":"2023-10-14T17:00:19.481720+0000","last_active":"2023-10-14T17:00:19.481760+0000","last_peered":"2023-10-14T17:00:19.481760+0000","last_clean":"2023-10-14T17:00:19.481760+0000","last_became_active":"2023-10-14T16:54:55.096374+0000","last_became_peered":"2023-10-14T16:54:55.096374+0000","last_unstale":"2023-10-14T17:00:19.481760+0000","last_undegraded":"2023-10-14T17:00:19.481760+0000","last_fullsized":"2023-10-14T17:00:19.481760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'485","last_scrub_stamp":"2023-10-14T17:00:19.481628+0000","last_deep_scrub":"23'485","last_deep_scrub_stamp":"2023-10-14T17:00:19.481628+0000","last_clean_scrub_stamp":"2023-10-14T17:00:19.481628+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:59.711273+0000","scrub_duration":0.001552152,"objects_trimmed":0,"snaptrim_duration":0.038441039000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"23'1510","reported_seq":1538,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:02.877946+0000","last_change":"2023-10-14T17:01:02.877898+0000","last_active":"2023-10-14T17:01:02.877946+0000","last_peered":"2023-10-14T17:01:02.877946+0000","last_clean":"2023-10-14T17:01:02.877946+0000","last_became_active":"2023-10-14T16:54:54.103170+0000","last_became_peered":"2023-10-14T16:54:54.103170+0000","last_unstale":"2023-10-14T17:01:02.877946+0000","last_undegraded":"2023-10-14T17:01:02.877946+0000","last_fullsized":"2023-10-14T17:01:02.877946+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1510","last_scrub_stamp":"2023-10-14T17:01:02.877802+0000","last_deep_scrub":"23'1510","last_deep_scrub_stamp":"2023-10-14T17:01:02.877802+0000","last_clean_scrub_stamp":"2023-10-14T17:01:02.877802+0000","objects_scrubbed":4,"log_size":1510,"log_dups_size":0,"ondisk_log_size":1510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:39.956631+0000","scrub_duration":0.027352138000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1498,"num_write_kb":8967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"23'532","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:54.422302+0000","last_change":"2023-10-14T17:00:54.422271+0000","last_active":"2023-10-14T17:00:54.422302+0000","last_peered":"2023-10-14T17:00:54.422302+0000","last_clean":"2023-10-14T17:00:54.422302+0000","last_became_active":"2023-10-14T16:54:55.107203+0000","last_became_peered":"2023-10-14T16:54:55.107203+0000","last_unstale":"2023-10-14T17:00:54.422302+0000","last_undegraded":"2023-10-14T17:00:54.422302+0000","last_fullsized":"2023-10-14T17:00:54.422302+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'532","last_scrub_stamp":"2023-10-14T17:00:54.422176+0000","last_deep_scrub":"23'532","last_deep_scrub_stamp":"2023-10-14T17:00:54.422176+0000","last_clean_scrub_stamp":"2023-10-14T17:00:54.422176+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:27.394683+0000","scrub_duration":0.0019774229999999999,"objects_trimmed":0,"snaptrim_duration":0.047574827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"22'3","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:36.699025+0000","last_change":"2023-10-14T17:00:36.698989+0000","last_active":"2023-10-14T17:00:36.699025+0000","last_peered":"2023-10-14T17:00:36.699025+0000","last_clean":"2023-10-14T17:00:36.699025+0000","last_became_active":"2023-10-14T16:54:54.097296+0000","last_became_peered":"2023-10-14T16:54:54.097296+0000","last_unstale":"2023-10-14T17:00:36.699025+0000","last_undegraded":"2023-10-14T17:00:36.699025+0000","last_fullsized":"2023-10-14T17:00:36.699025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2023-10-14T17:00:36.698893+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2023-10-14T17:00:36.698893+0000","last_clean_scrub_stamp":"2023-10-14T17:00:36.698893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:17.764307+0000","scrub_duration":0.001518506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'546","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.859089+0000","last_change":"2023-10-14T17:00:21.859059+0000","last_active":"2023-10-14T17:00:21.859089+0000","last_peered":"2023-10-14T17:00:21.859089+0000","last_clean":"2023-10-14T17:00:21.859089+0000","last_became_active":"2023-10-14T16:54:55.104611+0000","last_became_peered":"2023-10-14T16:54:55.104611+0000","last_unstale":"2023-10-14T17:00:21.859089+0000","last_undegraded":"2023-10-14T17:00:21.859089+0000","last_fullsized":"2023-10-14T17:00:21.859089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'546","last_scrub_stamp":"2023-10-14T17:00:21.858971+0000","last_deep_scrub":"23'546","last_deep_scrub_stamp":"2023-10-14T17:00:21.858971+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.858971+0000","objects_scrubbed":3,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:47.102060+0000","scrub_duration":0.0040357489999999999,"objects_trimmed":0,"snaptrim_duration":0.057513697000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"22'5","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:27.799109+0000","last_change":"2023-10-14T17:00:27.799084+0000","last_active":"2023-10-14T17:00:27.799109+0000","last_peered":"2023-10-14T17:00:27.799109+0000","last_clean":"2023-10-14T17:00:27.799109+0000","last_became_active":"2023-10-14T16:54:54.098432+0000","last_became_peered":"2023-10-14T16:54:54.098432+0000","last_unstale":"2023-10-14T17:00:27.799109+0000","last_undegraded":"2023-10-14T17:00:27.799109+0000","last_fullsized":"2023-10-14T17:00:27.799109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2023-10-14T17:00:27.798994+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2023-10-14T17:00:27.798994+0000","last_clean_scrub_stamp":"2023-10-14T17:00:27.798994+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:07.088613+0000","scrub_duration":0.0014250129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"23'1019","reported_seq":1096,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:10.548287+0000","last_change":"2023-10-14T17:00:10.548242+0000","last_active":"2023-10-14T17:00:10.548287+0000","last_peered":"2023-10-14T17:00:10.548287+0000","last_clean":"2023-10-14T17:00:10.548287+0000","last_became_active":"2023-10-14T16:54:55.092664+0000","last_became_peered":"2023-10-14T16:54:55.092664+0000","last_unstale":"2023-10-14T17:00:10.548287+0000","last_undegraded":"2023-10-14T17:00:10.548287+0000","last_fullsized":"2023-10-14T17:00:10.548287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1019","last_scrub_stamp":"2023-10-14T17:00:10.548118+0000","last_deep_scrub":"23'1019","last_deep_scrub_stamp":"2023-10-14T17:00:10.548118+0000","last_clean_scrub_stamp":"2023-10-14T17:00:10.548118+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:10.896871+0000","scrub_duration":0.0023116510000000001,"objects_trimmed":0,"snaptrim_duration":0.07026193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'1517","reported_seq":1545,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:33.925606+0000","last_change":"2023-10-14T17:00:33.925560+0000","last_active":"2023-10-14T17:00:33.925606+0000","last_peered":"2023-10-14T17:00:33.925606+0000","last_clean":"2023-10-14T17:00:33.925606+0000","last_became_active":"2023-10-14T16:54:54.098745+0000","last_became_peered":"2023-10-14T16:54:54.098745+0000","last_unstale":"2023-10-14T17:00:33.925606+0000","last_undegraded":"2023-10-14T17:00:33.925606+0000","last_fullsized":"2023-10-14T17:00:33.925606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1517","last_scrub_stamp":"2023-10-14T17:00:33.925467+0000","last_deep_scrub":"23'1517","last_deep_scrub_stamp":"2023-10-14T17:00:33.925467+0000","last_clean_scrub_stamp":"2023-10-14T17:00:33.925467+0000","objects_scrubbed":6,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:10.164969+0000","scrub_duration":0.024970293000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1507,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"23'585","reported_seq":662,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.585569+0000","last_change":"2023-10-14T17:00:14.585538+0000","last_active":"2023-10-14T17:00:14.585569+0000","last_peered":"2023-10-14T17:00:14.585569+0000","last_clean":"2023-10-14T17:00:14.585569+0000","last_became_active":"2023-10-14T16:54:55.099443+0000","last_became_peered":"2023-10-14T16:54:55.099443+0000","last_unstale":"2023-10-14T17:00:14.585569+0000","last_undegraded":"2023-10-14T17:00:14.585569+0000","last_fullsized":"2023-10-14T17:00:14.585569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'585","last_scrub_stamp":"2023-10-14T17:00:14.585421+0000","last_deep_scrub":"23'585","last_deep_scrub_stamp":"2023-10-14T17:00:14.585421+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.585421+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:54.815066+0000","scrub_duration":0.0018524399999999999,"objects_trimmed":0,"snaptrim_duration":0.071266745000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"23'757","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:30.436241+0000","last_change":"2023-10-14T17:00:30.436214+0000","last_active":"2023-10-14T17:00:30.436241+0000","last_peered":"2023-10-14T17:00:30.436241+0000","last_clean":"2023-10-14T17:00:30.436241+0000","last_became_active":"2023-10-14T16:54:54.100417+0000","last_became_peered":"2023-10-14T16:54:54.100417+0000","last_unstale":"2023-10-14T17:00:30.436241+0000","last_undegraded":"2023-10-14T17:00:30.436241+0000","last_fullsized":"2023-10-14T17:00:30.436241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'757","last_scrub_stamp":"2023-10-14T17:00:30.436119+0000","last_deep_scrub":"23'757","last_deep_scrub_stamp":"2023-10-14T17:00:30.436119+0000","last_clean_scrub_stamp":"2023-10-14T17:00:30.436119+0000","objects_scrubbed":2,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:55.679208+0000","scrub_duration":0.014880749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"23'815","reported_seq":892,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:06.672554+0000","last_change":"2023-10-14T17:00:06.672525+0000","last_active":"2023-10-14T17:00:06.672554+0000","last_peered":"2023-10-14T17:00:06.672554+0000","last_clean":"2023-10-14T17:00:06.672554+0000","last_became_active":"2023-10-14T16:54:55.093198+0000","last_became_peered":"2023-10-14T16:54:55.093198+0000","last_unstale":"2023-10-14T17:00:06.672554+0000","last_undegraded":"2023-10-14T17:00:06.672554+0000","last_fullsized":"2023-10-14T17:00:06.672554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'815","last_scrub_stamp":"2023-10-14T17:00:06.672437+0000","last_deep_scrub":"23'815","last_deep_scrub_stamp":"2023-10-14T17:00:06.672437+0000","last_clean_scrub_stamp":"2023-10-14T17:00:06.672437+0000","objects_scrubbed":2,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:45.321460+0000","scrub_duration":0.0042146179999999998,"objects_trimmed":0,"snaptrim_duration":0.057360406000000003,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"23'758","reported_seq":786,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:51.370885+0000","last_change":"2023-10-14T17:00:51.370858+0000","last_active":"2023-10-14T17:00:51.370885+0000","last_peered":"2023-10-14T17:00:51.370885+0000","last_clean":"2023-10-14T17:00:51.370885+0000","last_became_active":"2023-10-14T16:54:54.097306+0000","last_became_peered":"2023-10-14T16:54:54.097306+0000","last_unstale":"2023-10-14T17:00:51.370885+0000","last_undegraded":"2023-10-14T17:00:51.370885+0000","last_fullsized":"2023-10-14T17:00:51.370885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'758","last_scrub_stamp":"2023-10-14T17:00:51.370768+0000","last_deep_scrub":"23'758","last_deep_scrub_stamp":"2023-10-14T17:00:51.370768+0000","last_clean_scrub_stamp":"2023-10-14T17:00:51.370768+0000","objects_scrubbed":2,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:36.735490+0000","scrub_duration":0.012859822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"23'595","reported_seq":671,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:18.436040+0000","last_change":"2023-10-14T17:00:18.436003+0000","last_active":"2023-10-14T17:00:18.436040+0000","last_peered":"2023-10-14T17:00:18.436040+0000","last_clean":"2023-10-14T17:00:18.436040+0000","last_became_active":"2023-10-14T16:54:55.097199+0000","last_became_peered":"2023-10-14T16:54:55.097199+0000","last_unstale":"2023-10-14T17:00:18.436040+0000","last_undegraded":"2023-10-14T17:00:18.436040+0000","last_fullsized":"2023-10-14T17:00:18.436040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'595","last_scrub_stamp":"2023-10-14T17:00:18.435878+0000","last_deep_scrub":"23'595","last_deep_scrub_stamp":"2023-10-14T17:00:18.435878+0000","last_clean_scrub_stamp":"2023-10-14T17:00:18.435878+0000","objects_scrubbed":2,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:26.316085+0000","scrub_duration":0.0045224619999999997,"objects_trimmed":0,"snaptrim_duration":0.039029367000000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'757","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:46.800593+0000","last_change":"2023-10-14T17:00:46.800567+0000","last_active":"2023-10-14T17:00:46.800593+0000","last_peered":"2023-10-14T17:00:46.800593+0000","last_clean":"2023-10-14T17:00:46.800593+0000","last_became_active":"2023-10-14T16:54:54.100649+0000","last_became_peered":"2023-10-14T16:54:54.100649+0000","last_unstale":"2023-10-14T17:00:46.800593+0000","last_undegraded":"2023-10-14T17:00:46.800593+0000","last_fullsized":"2023-10-14T17:00:46.800593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'757","last_scrub_stamp":"2023-10-14T17:00:46.800478+0000","last_deep_scrub":"23'757","last_deep_scrub_stamp":"2023-10-14T17:00:46.800478+0000","last_clean_scrub_stamp":"2023-10-14T17:00:46.800478+0000","objects_scrubbed":2,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:19.772985+0000","scrub_duration":0.013316553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"23'445","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:17.439396+0000","last_change":"2023-10-14T17:00:17.439352+0000","last_active":"2023-10-14T17:00:17.439396+0000","last_peered":"2023-10-14T17:00:17.439396+0000","last_clean":"2023-10-14T17:00:17.439396+0000","last_became_active":"2023-10-14T16:54:55.096280+0000","last_became_peered":"2023-10-14T16:54:55.096280+0000","last_unstale":"2023-10-14T17:00:17.439396+0000","last_undegraded":"2023-10-14T17:00:17.439396+0000","last_fullsized":"2023-10-14T17:00:17.439396+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'445","last_scrub_stamp":"2023-10-14T17:00:17.439252+0000","last_deep_scrub":"23'445","last_deep_scrub_stamp":"2023-10-14T17:00:17.439252+0000","last_clean_scrub_stamp":"2023-10-14T17:00:17.439252+0000","objects_scrubbed":5,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:56.088275+0000","scrub_duration":0.0049452009999999998,"objects_trimmed":0,"snaptrim_duration":0.036384234000000001,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"23'11","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:06.898747+0000","last_change":"2023-10-14T17:01:06.898722+0000","last_active":"2023-10-14T17:01:06.898747+0000","last_peered":"2023-10-14T17:01:06.898747+0000","last_clean":"2023-10-14T17:01:06.898747+0000","last_became_active":"2023-10-14T16:54:54.099083+0000","last_became_peered":"2023-10-14T16:54:54.099083+0000","last_unstale":"2023-10-14T17:01:06.898747+0000","last_undegraded":"2023-10-14T17:01:06.898747+0000","last_fullsized":"2023-10-14T17:01:06.898747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2023-10-14T17:01:06.898620+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2023-10-14T17:01:06.898620+0000","last_clean_scrub_stamp":"2023-10-14T17:01:06.898620+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:32.376838+0000","scrub_duration":0.0083792199999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"23'731","reported_seq":808,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:20.695393+0000","last_change":"2023-10-14T17:00:20.695362+0000","last_active":"2023-10-14T17:00:20.695393+0000","last_peered":"2023-10-14T17:00:20.695393+0000","last_clean":"2023-10-14T17:00:20.695393+0000","last_became_active":"2023-10-14T16:54:55.097625+0000","last_became_peered":"2023-10-14T16:54:55.097625+0000","last_unstale":"2023-10-14T17:00:20.695393+0000","last_undegraded":"2023-10-14T17:00:20.695393+0000","last_fullsized":"2023-10-14T17:00:20.695393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'731","last_scrub_stamp":"2023-10-14T17:00:20.695264+0000","last_deep_scrub":"23'731","last_deep_scrub_stamp":"2023-10-14T17:00:20.695264+0000","last_clean_scrub_stamp":"2023-10-14T17:00:20.695264+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:05.017140+0000","scrub_duration":0.001565271,"objects_trimmed":0,"snaptrim_duration":0.070178661000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'1502","reported_seq":1530,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:36.331783+0000","last_change":"2023-10-14T17:00:36.331735+0000","last_active":"2023-10-14T17:00:36.331783+0000","last_peered":"2023-10-14T17:00:36.331783+0000","last_clean":"2023-10-14T17:00:36.331783+0000","last_became_active":"2023-10-14T16:54:54.093495+0000","last_became_peered":"2023-10-14T16:54:54.093495+0000","last_unstale":"2023-10-14T17:00:36.331783+0000","last_undegraded":"2023-10-14T17:00:36.331783+0000","last_fullsized":"2023-10-14T17:00:36.331783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1502","last_scrub_stamp":"2023-10-14T17:00:36.331637+0000","last_deep_scrub":"23'1502","last_deep_scrub_stamp":"2023-10-14T17:00:36.331637+0000","last_clean_scrub_stamp":"2023-10-14T17:00:36.331637+0000","objects_scrubbed":4,"log_size":1502,"log_dups_size":0,"ondisk_log_size":1502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:15.621256+0000","scrub_duration":0.027209761999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1485,"num_write_kb":12977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"23'732","reported_seq":809,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:07.636144+0000","last_change":"2023-10-14T17:00:07.636098+0000","last_active":"2023-10-14T17:00:07.636144+0000","last_peered":"2023-10-14T17:00:07.636144+0000","last_clean":"2023-10-14T17:00:07.636144+0000","last_became_active":"2023-10-14T16:54:55.100163+0000","last_became_peered":"2023-10-14T16:54:55.100163+0000","last_unstale":"2023-10-14T17:00:07.636144+0000","last_undegraded":"2023-10-14T17:00:07.636144+0000","last_fullsized":"2023-10-14T17:00:07.636144+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'732","last_scrub_stamp":"2023-10-14T17:00:07.635986+0000","last_deep_scrub":"23'732","last_deep_scrub_stamp":"2023-10-14T17:00:07.635986+0000","last_clean_scrub_stamp":"2023-10-14T17:00:07.635986+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:15.516193+0000","scrub_duration":0.0020539740000000001,"objects_trimmed":0,"snaptrim_duration":0.034606716000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'3229","reported_seq":3257,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:39.800699+0000","last_change":"2023-10-14T17:00:39.800656+0000","last_active":"2023-10-14T17:00:39.800699+0000","last_peered":"2023-10-14T17:00:39.800699+0000","last_clean":"2023-10-14T17:00:39.800699+0000","last_became_active":"2023-10-14T16:54:54.103123+0000","last_became_peered":"2023-10-14T16:54:54.103123+0000","last_unstale":"2023-10-14T17:00:39.800699+0000","last_undegraded":"2023-10-14T17:00:39.800699+0000","last_fullsized":"2023-10-14T17:00:39.800699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3229","last_scrub_stamp":"2023-10-14T17:00:39.800562+0000","last_deep_scrub":"23'3229","last_deep_scrub_stamp":"2023-10-14T17:00:39.800562+0000","last_clean_scrub_stamp":"2023-10-14T17:00:39.800562+0000","objects_scrubbed":2,"log_size":3229,"log_dups_size":0,"ondisk_log_size":3229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:36.839625+0000","scrub_duration":0.027341382000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3218,"num_write_kb":10301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"23'569","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.709675+0000","last_change":"2023-10-14T17:00:14.709621+0000","last_active":"2023-10-14T17:00:14.709675+0000","last_peered":"2023-10-14T17:00:14.709675+0000","last_clean":"2023-10-14T17:00:14.709675+0000","last_became_active":"2023-10-14T16:54:55.096010+0000","last_became_peered":"2023-10-14T16:54:55.096010+0000","last_unstale":"2023-10-14T17:00:14.709675+0000","last_undegraded":"2023-10-14T17:00:14.709675+0000","last_fullsized":"2023-10-14T17:00:14.709675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'569","last_scrub_stamp":"2023-10-14T17:00:14.709530+0000","last_deep_scrub":"23'569","last_deep_scrub_stamp":"2023-10-14T17:00:14.709530+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.709530+0000","objects_scrubbed":2,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:35:59.031407+0000","scrub_duration":0.0039121779999999997,"objects_trimmed":0,"snaptrim_duration":0.057531643,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"23'651","reported_seq":679,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:58.940562+0000","last_change":"2023-10-14T17:00:58.940536+0000","last_active":"2023-10-14T17:00:58.940562+0000","last_peered":"2023-10-14T17:00:58.940562+0000","last_clean":"2023-10-14T17:00:58.940562+0000","last_became_active":"2023-10-14T16:54:54.098826+0000","last_became_peered":"2023-10-14T16:54:54.098826+0000","last_unstale":"2023-10-14T17:00:58.940562+0000","last_undegraded":"2023-10-14T17:00:58.940562+0000","last_fullsized":"2023-10-14T17:00:58.940562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'651","last_scrub_stamp":"2023-10-14T17:00:58.940431+0000","last_deep_scrub":"23'651","last_deep_scrub_stamp":"2023-10-14T17:00:58.940431+0000","last_clean_scrub_stamp":"2023-10-14T17:00:58.940431+0000","objects_scrubbed":1,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:49.082334+0000","scrub_duration":0.012391549,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"23'610","reported_seq":708,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:15.396589+0000","last_change":"2023-10-14T17:00:15.396562+0000","last_active":"2023-10-14T17:00:15.396589+0000","last_peered":"2023-10-14T17:00:15.396589+0000","last_clean":"2023-10-14T17:00:15.396589+0000","last_became_active":"2023-10-14T16:54:55.093862+0000","last_became_peered":"2023-10-14T16:54:55.093862+0000","last_unstale":"2023-10-14T17:00:15.396589+0000","last_undegraded":"2023-10-14T17:00:15.396589+0000","last_fullsized":"2023-10-14T17:00:15.396589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'610","last_scrub_stamp":"2023-10-14T17:00:15.396476+0000","last_deep_scrub":"23'610","last_deep_scrub_stamp":"2023-10-14T17:00:15.396476+0000","last_clean_scrub_stamp":"2023-10-14T17:00:15.396476+0000","objects_scrubbed":10,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:15.745229+0000","scrub_duration":0.0089952309999999994,"objects_trimmed":0,"snaptrim_duration":0.038477224999999997,"stat_sum":{"num_bytes":16395,"num_objects":10,"num_object_clones":4,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":25,"num_read_kb":20,"num_write":32,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"23'758","reported_seq":786,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:35.288431+0000","last_change":"2023-10-14T17:00:35.288382+0000","last_active":"2023-10-14T17:00:35.288431+0000","last_peered":"2023-10-14T17:00:35.288431+0000","last_clean":"2023-10-14T17:00:35.288431+0000","last_became_active":"2023-10-14T16:54:54.095674+0000","last_became_peered":"2023-10-14T16:54:54.095674+0000","last_unstale":"2023-10-14T17:00:35.288431+0000","last_undegraded":"2023-10-14T17:00:35.288431+0000","last_fullsized":"2023-10-14T17:00:35.288431+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'758","last_scrub_stamp":"2023-10-14T17:00:35.288276+0000","last_deep_scrub":"23'758","last_deep_scrub_stamp":"2023-10-14T17:00:35.288276+0000","last_clean_scrub_stamp":"2023-10-14T17:00:35.288276+0000","objects_scrubbed":1,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:38.977356+0000","scrub_duration":0.013787259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'596","reported_seq":671,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:01:10.429861+0000","last_change":"2023-10-14T17:01:10.429830+0000","last_active":"2023-10-14T17:01:10.429861+0000","last_peered":"2023-10-14T17:01:10.429861+0000","last_clean":"2023-10-14T17:01:10.429861+0000","last_became_active":"2023-10-14T16:55:45.058862+0000","last_became_peered":"2023-10-14T16:55:45.058862+0000","last_unstale":"2023-10-14T17:01:10.429861+0000","last_undegraded":"2023-10-14T17:01:10.429861+0000","last_fullsized":"2023-10-14T17:01:10.429861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'596","last_scrub_stamp":"2023-10-14T17:01:10.429726+0000","last_deep_scrub":"23'596","last_deep_scrub_stamp":"2023-10-14T17:01:10.429726+0000","last_clean_scrub_stamp":"2023-10-14T17:01:10.429726+0000","objects_scrubbed":1,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:35.907944+0000","scrub_duration":0.0038904870000000002,"objects_trimmed":0,"snaptrim_duration":0.071388894999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'773","reported_seq":801,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:25.221455+0000","last_change":"2023-10-14T17:00:25.221425+0000","last_active":"2023-10-14T17:00:25.221455+0000","last_peered":"2023-10-14T17:00:25.221455+0000","last_clean":"2023-10-14T17:00:25.221455+0000","last_became_active":"2023-10-14T16:54:54.091739+0000","last_became_peered":"2023-10-14T16:54:54.091739+0000","last_unstale":"2023-10-14T17:00:25.221455+0000","last_undegraded":"2023-10-14T17:00:25.221455+0000","last_fullsized":"2023-10-14T17:00:25.221455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'773","last_scrub_stamp":"2023-10-14T17:00:25.221335+0000","last_deep_scrub":"23'773","last_deep_scrub_stamp":"2023-10-14T17:00:25.221335+0000","last_clean_scrub_stamp":"2023-10-14T17:00:25.221335+0000","objects_scrubbed":2,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:38.876887+0000","scrub_duration":0.013685787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:36.456601+0000","last_change":"2023-10-14T17:00:36.456573+0000","last_active":"2023-10-14T17:00:36.456601+0000","last_peered":"2023-10-14T17:00:36.456601+0000","last_clean":"2023-10-14T17:00:36.456601+0000","last_became_active":"2023-10-14T16:54:49.688973+0000","last_became_peered":"2023-10-14T16:54:49.688973+0000","last_unstale":"2023-10-14T17:00:36.456601+0000","last_undegraded":"2023-10-14T17:00:36.456601+0000","last_fullsized":"2023-10-14T17:00:36.456601+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:36.456470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:36.456470+0000","last_clean_scrub_stamp":"2023-10-14T17:00:36.456470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:40.145551+0000","scrub_duration":0.0018203920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"23'520","reported_seq":597,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:51.598491+0000","last_change":"2023-10-14T17:00:51.598463+0000","last_active":"2023-10-14T17:00:51.598491+0000","last_peered":"2023-10-14T17:00:51.598491+0000","last_clean":"2023-10-14T17:00:51.598491+0000","last_became_active":"2023-10-14T16:54:55.091907+0000","last_became_peered":"2023-10-14T16:54:55.091907+0000","last_unstale":"2023-10-14T17:00:51.598491+0000","last_undegraded":"2023-10-14T17:00:51.598491+0000","last_fullsized":"2023-10-14T17:00:51.598491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'520","last_scrub_stamp":"2023-10-14T17:00:51.598362+0000","last_deep_scrub":"23'520","last_deep_scrub_stamp":"2023-10-14T17:00:51.598362+0000","last_clean_scrub_stamp":"2023-10-14T17:00:51.598362+0000","objects_scrubbed":2,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:00:50.039779+0000","scrub_duration":0.0040435319999999999,"objects_trimmed":0,"snaptrim_duration":0.061999158999999998,"stat_sum":{"num_bytes":4107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:24.168089+0000","last_change":"2023-10-14T17:00:24.168059+0000","last_active":"2023-10-14T17:00:24.168089+0000","last_peered":"2023-10-14T17:00:24.168089+0000","last_clean":"2023-10-14T17:00:24.168089+0000","last_became_active":"2023-10-14T16:54:49.062911+0000","last_became_peered":"2023-10-14T16:54:49.062911+0000","last_unstale":"2023-10-14T17:00:24.168089+0000","last_undegraded":"2023-10-14T17:00:24.168089+0000","last_fullsized":"2023-10-14T17:00:24.168089+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:24.167949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:24.167949+0000","last_clean_scrub_stamp":"2023-10-14T17:00:24.167949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:08.489825+0000","scrub_duration":0.0018258009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"23'50","reported_seq":78,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:32.698034+0000","last_change":"2023-10-14T17:00:32.697997+0000","last_active":"2023-10-14T17:00:32.698034+0000","last_peered":"2023-10-14T17:00:32.698034+0000","last_clean":"2023-10-14T17:00:32.698034+0000","last_became_active":"2023-10-14T16:54:54.092828+0000","last_became_peered":"2023-10-14T16:54:54.092828+0000","last_unstale":"2023-10-14T17:00:32.698034+0000","last_undegraded":"2023-10-14T17:00:32.698034+0000","last_fullsized":"2023-10-14T17:00:32.698034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'50","last_scrub_stamp":"2023-10-14T17:00:32.697897+0000","last_deep_scrub":"23'50","last_deep_scrub_stamp":"2023-10-14T17:00:32.697897+0000","last_clean_scrub_stamp":"2023-10-14T17:00:32.697897+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:11.987516+0000","scrub_duration":0.0026746600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"23'517","reported_seq":594,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.446285+0000","last_change":"2023-10-14T17:00:21.446258+0000","last_active":"2023-10-14T17:00:21.446285+0000","last_peered":"2023-10-14T17:00:21.446285+0000","last_clean":"2023-10-14T17:00:21.446285+0000","last_became_active":"2023-10-14T16:54:55.093650+0000","last_became_peered":"2023-10-14T16:54:55.093650+0000","last_unstale":"2023-10-14T17:00:21.446285+0000","last_undegraded":"2023-10-14T17:00:21.446285+0000","last_fullsized":"2023-10-14T17:00:21.446285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'517","last_scrub_stamp":"2023-10-14T17:00:21.446154+0000","last_deep_scrub":"23'517","last_deep_scrub_stamp":"2023-10-14T17:00:21.446154+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.446154+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:45.918009+0000","scrub_duration":0.0014583549999999999,"objects_trimmed":0,"snaptrim_duration":0.038513458,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:20.098656+0000","last_change":"2023-10-14T17:00:20.098627+0000","last_active":"2023-10-14T17:00:20.098656+0000","last_peered":"2023-10-14T17:00:20.098656+0000","last_clean":"2023-10-14T17:00:20.098656+0000","last_became_active":"2023-10-14T16:54:49.063347+0000","last_became_peered":"2023-10-14T16:54:49.063347+0000","last_unstale":"2023-10-14T17:00:20.098656+0000","last_undegraded":"2023-10-14T17:00:20.098656+0000","last_fullsized":"2023-10-14T17:00:20.098656+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:20.098523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:20.098523+0000","last_clean_scrub_stamp":"2023-10-14T17:00:20.098523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:05:44.570379+0000","scrub_duration":0.0018044700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"23'119","reported_seq":183,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:55.944842+0000","last_change":"2023-10-14T17:00:55.944816+0000","last_active":"2023-10-14T17:00:55.944842+0000","last_peered":"2023-10-14T17:00:55.944842+0000","last_clean":"2023-10-14T17:00:55.944842+0000","last_became_active":"2023-10-14T16:54:49.062986+0000","last_became_peered":"2023-10-14T16:54:49.062986+0000","last_unstale":"2023-10-14T17:00:55.944842+0000","last_undegraded":"2023-10-14T17:00:55.944842+0000","last_fullsized":"2023-10-14T17:00:55.944842+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2023-10-14T17:00:55.944732+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2023-10-14T17:00:55.944732+0000","last_clean_scrub_stamp":"2023-10-14T17:00:55.944732+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:56.400894+0000","scrub_duration":0.0044312520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"23'77","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:44.621788+0000","last_change":"2023-10-14T17:00:44.621759+0000","last_active":"2023-10-14T17:00:44.621788+0000","last_peered":"2023-10-14T17:00:44.621788+0000","last_clean":"2023-10-14T17:00:44.621788+0000","last_became_active":"2023-10-14T16:54:54.097988+0000","last_became_peered":"2023-10-14T16:54:54.097988+0000","last_unstale":"2023-10-14T17:00:44.621788+0000","last_undegraded":"2023-10-14T17:00:44.621788+0000","last_fullsized":"2023-10-14T17:00:44.621788+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'77","last_scrub_stamp":"2023-10-14T17:00:44.621662+0000","last_deep_scrub":"23'77","last_deep_scrub_stamp":"2023-10-14T17:00:44.621662+0000","last_clean_scrub_stamp":"2023-10-14T17:00:44.621662+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:20:41.660725+0000","scrub_duration":0.004793645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":646501,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":64,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"23'755","reported_seq":833,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:24.676945+0000","last_change":"2023-10-14T17:00:24.676899+0000","last_active":"2023-10-14T17:00:24.676945+0000","last_peered":"2023-10-14T17:00:24.676945+0000","last_clean":"2023-10-14T17:00:24.676945+0000","last_became_active":"2023-10-14T16:54:55.095931+0000","last_became_peered":"2023-10-14T16:54:55.095931+0000","last_unstale":"2023-10-14T17:00:24.676945+0000","last_undegraded":"2023-10-14T17:00:24.676945+0000","last_fullsized":"2023-10-14T17:00:24.676945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'755","last_scrub_stamp":"2023-10-14T17:00:24.676790+0000","last_deep_scrub":"23'755","last_deep_scrub_stamp":"2023-10-14T17:00:24.676790+0000","last_clean_scrub_stamp":"2023-10-14T17:00:24.676790+0000","objects_scrubbed":1,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:13.281090+0000","scrub_duration":0.0031994969999999999,"objects_trimmed":0,"snaptrim_duration":0.069884818000000001,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:34.403364+0000","last_change":"2023-10-14T17:00:34.403336+0000","last_active":"2023-10-14T17:00:34.403364+0000","last_peered":"2023-10-14T17:00:34.403364+0000","last_clean":"2023-10-14T17:00:34.403364+0000","last_became_active":"2023-10-14T16:54:49.688994+0000","last_became_peered":"2023-10-14T16:54:49.688994+0000","last_unstale":"2023-10-14T17:00:34.403364+0000","last_undegraded":"2023-10-14T17:00:34.403364+0000","last_fullsized":"2023-10-14T17:00:34.403364+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:34.403232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:34.403232+0000","last_clean_scrub_stamp":"2023-10-14T17:00:34.403232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:05.118380+0000","scrub_duration":0.0023433809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'2238","reported_seq":2266,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:28.231608+0000","last_change":"2023-10-14T17:00:28.231580+0000","last_active":"2023-10-14T17:00:28.231608+0000","last_peered":"2023-10-14T17:00:28.231608+0000","last_clean":"2023-10-14T17:00:28.231608+0000","last_became_active":"2023-10-14T16:54:54.092901+0000","last_became_peered":"2023-10-14T16:54:54.092901+0000","last_unstale":"2023-10-14T17:00:28.231608+0000","last_undegraded":"2023-10-14T17:00:28.231608+0000","last_fullsized":"2023-10-14T17:00:28.231608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2238","last_scrub_stamp":"2023-10-14T17:00:28.231497+0000","last_deep_scrub":"23'2238","last_deep_scrub_stamp":"2023-10-14T17:00:28.231497+0000","last_clean_scrub_stamp":"2023-10-14T17:00:28.231497+0000","objects_scrubbed":3,"log_size":2238,"log_dups_size":0,"ondisk_log_size":2238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:16.835797+0000","scrub_duration":0.028927609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2227,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"23'634","reported_seq":711,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:45.357063+0000","last_change":"2023-10-14T17:00:45.357021+0000","last_active":"2023-10-14T17:00:45.357063+0000","last_peered":"2023-10-14T17:00:45.357063+0000","last_clean":"2023-10-14T17:00:45.357063+0000","last_became_active":"2023-10-14T16:54:55.105684+0000","last_became_peered":"2023-10-14T16:54:55.105684+0000","last_unstale":"2023-10-14T17:00:45.357063+0000","last_undegraded":"2023-10-14T17:00:45.357063+0000","last_fullsized":"2023-10-14T17:00:45.357063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'634","last_scrub_stamp":"2023-10-14T17:00:45.356915+0000","last_deep_scrub":"23'634","last_deep_scrub_stamp":"2023-10-14T17:00:45.356915+0000","last_clean_scrub_stamp":"2023-10-14T17:00:45.356915+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:26.594547+0000","scrub_duration":0.0020193810000000002,"objects_trimmed":0,"snaptrim_duration":0.047771027000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:50.829740+0000","last_change":"2023-10-14T17:00:50.829711+0000","last_active":"2023-10-14T17:00:50.829740+0000","last_peered":"2023-10-14T17:00:50.829740+0000","last_clean":"2023-10-14T17:00:50.829740+0000","last_became_active":"2023-10-14T16:54:49.688963+0000","last_became_peered":"2023-10-14T16:54:49.688963+0000","last_unstale":"2023-10-14T17:00:50.829740+0000","last_undegraded":"2023-10-14T17:00:50.829740+0000","last_fullsized":"2023-10-14T17:00:50.829740+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:50.829611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:50.829611+0000","last_clean_scrub_stamp":"2023-10-14T17:00:50.829611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:56.383252+0000","scrub_duration":0.0020121000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'1505","reported_seq":1533,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:33.281438+0000","last_change":"2023-10-14T17:00:33.281411+0000","last_active":"2023-10-14T17:00:33.281438+0000","last_peered":"2023-10-14T17:00:33.281438+0000","last_clean":"2023-10-14T17:00:33.281438+0000","last_became_active":"2023-10-14T16:54:54.099108+0000","last_became_peered":"2023-10-14T16:54:54.099108+0000","last_unstale":"2023-10-14T17:00:33.281438+0000","last_undegraded":"2023-10-14T17:00:33.281438+0000","last_fullsized":"2023-10-14T17:00:33.281438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1505","last_scrub_stamp":"2023-10-14T17:00:33.281327+0000","last_deep_scrub":"23'1505","last_deep_scrub_stamp":"2023-10-14T17:00:33.281327+0000","last_clean_scrub_stamp":"2023-10-14T17:00:33.281327+0000","objects_scrubbed":2,"log_size":1505,"log_dups_size":0,"ondisk_log_size":1505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:03.996475+0000","scrub_duration":0.022221726000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":8961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"23'761","reported_seq":837,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:08.665128+0000","last_change":"2023-10-14T17:00:08.665100+0000","last_active":"2023-10-14T17:00:08.665128+0000","last_peered":"2023-10-14T17:00:08.665128+0000","last_clean":"2023-10-14T17:00:08.665128+0000","last_became_active":"2023-10-14T16:54:55.096390+0000","last_became_peered":"2023-10-14T16:54:55.096390+0000","last_unstale":"2023-10-14T17:00:08.665128+0000","last_undegraded":"2023-10-14T17:00:08.665128+0000","last_fullsized":"2023-10-14T17:00:08.665128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'761","last_scrub_stamp":"2023-10-14T17:00:08.665003+0000","last_deep_scrub":"23'761","last_deep_scrub_stamp":"2023-10-14T17:00:08.665003+0000","last_clean_scrub_stamp":"2023-10-14T17:00:08.665003+0000","objects_scrubbed":2,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:48.894648+0000","scrub_duration":0.0039251659999999999,"objects_trimmed":0,"snaptrim_duration":0.057422879000000003,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:53.939685+0000","last_change":"2023-10-14T17:00:53.939655+0000","last_active":"2023-10-14T17:00:53.939685+0000","last_peered":"2023-10-14T17:00:53.939685+0000","last_clean":"2023-10-14T17:00:53.939685+0000","last_became_active":"2023-10-14T16:54:49.688988+0000","last_became_peered":"2023-10-14T16:54:49.688988+0000","last_unstale":"2023-10-14T17:00:53.939685+0000","last_undegraded":"2023-10-14T17:00:53.939685+0000","last_fullsized":"2023-10-14T17:00:53.939685+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:53.939560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:53.939560+0000","last_clean_scrub_stamp":"2023-10-14T17:00:53.939560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:13.158089+0000","scrub_duration":0.001768836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"23'742","reported_seq":770,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:37.452608+0000","last_change":"2023-10-14T17:00:37.452579+0000","last_active":"2023-10-14T17:00:37.452608+0000","last_peered":"2023-10-14T17:00:37.452608+0000","last_clean":"2023-10-14T17:00:37.452608+0000","last_became_active":"2023-10-14T16:54:54.100326+0000","last_became_peered":"2023-10-14T16:54:54.100326+0000","last_unstale":"2023-10-14T17:00:37.452608+0000","last_undegraded":"2023-10-14T17:00:37.452608+0000","last_fullsized":"2023-10-14T17:00:37.452608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'742","last_scrub_stamp":"2023-10-14T17:00:37.452486+0000","last_deep_scrub":"23'742","last_deep_scrub_stamp":"2023-10-14T17:00:37.452486+0000","last_clean_scrub_stamp":"2023-10-14T17:00:37.452486+0000","objects_scrubbed":1,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:04:16.742105+0000","scrub_duration":0.012675855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"23'580","reported_seq":657,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:57.496266+0000","last_change":"2023-10-14T17:00:57.496233+0000","last_active":"2023-10-14T17:00:57.496266+0000","last_peered":"2023-10-14T17:00:57.496266+0000","last_clean":"2023-10-14T17:00:57.496266+0000","last_became_active":"2023-10-14T16:54:55.107571+0000","last_became_peered":"2023-10-14T16:54:55.107571+0000","last_unstale":"2023-10-14T17:00:57.496266+0000","last_undegraded":"2023-10-14T17:00:57.496266+0000","last_fullsized":"2023-10-14T17:00:57.496266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'580","last_scrub_stamp":"2023-10-14T17:00:57.496127+0000","last_deep_scrub":"23'580","last_deep_scrub_stamp":"2023-10-14T17:00:57.496127+0000","last_clean_scrub_stamp":"2023-10-14T17:00:57.496127+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:53:46.107876+0000","scrub_duration":0.001658896,"objects_trimmed":0,"snaptrim_duration":0.047665379000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:51.873706+0000","last_change":"2023-10-14T17:00:51.873678+0000","last_active":"2023-10-14T17:00:51.873706+0000","last_peered":"2023-10-14T17:00:51.873706+0000","last_clean":"2023-10-14T17:00:51.873706+0000","last_became_active":"2023-10-14T16:54:49.689591+0000","last_became_peered":"2023-10-14T16:54:49.689591+0000","last_unstale":"2023-10-14T17:00:51.873706+0000","last_undegraded":"2023-10-14T17:00:51.873706+0000","last_fullsized":"2023-10-14T17:00:51.873706+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:51.873575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:51.873575+0000","last_clean_scrub_stamp":"2023-10-14T17:00:51.873575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:16.724807+0000","scrub_duration":0.0018907679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'738","reported_seq":766,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:29.244189+0000","last_change":"2023-10-14T17:00:29.244159+0000","last_active":"2023-10-14T17:00:29.244189+0000","last_peered":"2023-10-14T17:00:29.244189+0000","last_clean":"2023-10-14T17:00:29.244189+0000","last_became_active":"2023-10-14T16:54:54.096352+0000","last_became_peered":"2023-10-14T16:54:54.096352+0000","last_unstale":"2023-10-14T17:00:29.244189+0000","last_undegraded":"2023-10-14T17:00:29.244189+0000","last_fullsized":"2023-10-14T17:00:29.244189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'738","last_scrub_stamp":"2023-10-14T17:00:29.244076+0000","last_deep_scrub":"23'738","last_deep_scrub_stamp":"2023-10-14T17:00:29.244076+0000","last_clean_scrub_stamp":"2023-10-14T17:00:29.244076+0000","objects_scrubbed":1,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:52:54.487165+0000","scrub_duration":0.012834883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"23'698","reported_seq":775,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:29.644827+0000","last_change":"2023-10-14T17:00:29.644796+0000","last_active":"2023-10-14T17:00:29.644827+0000","last_peered":"2023-10-14T17:00:29.644827+0000","last_clean":"2023-10-14T17:00:29.644827+0000","last_became_active":"2023-10-14T16:54:55.089910+0000","last_became_peered":"2023-10-14T16:54:55.089910+0000","last_unstale":"2023-10-14T17:00:29.644827+0000","last_undegraded":"2023-10-14T17:00:29.644827+0000","last_fullsized":"2023-10-14T17:00:29.644827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'698","last_scrub_stamp":"2023-10-14T17:00:29.644709+0000","last_deep_scrub":"23'698","last_deep_scrub_stamp":"2023-10-14T17:00:29.644709+0000","last_clean_scrub_stamp":"2023-10-14T17:00:29.644709+0000","objects_scrubbed":1,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:00.359857+0000","scrub_duration":0.0037276449999999999,"objects_trimmed":0,"snaptrim_duration":0.068678344000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:56.895608+0000","last_change":"2023-10-14T17:00:56.895584+0000","last_active":"2023-10-14T17:00:56.895608+0000","last_peered":"2023-10-14T17:00:56.895608+0000","last_clean":"2023-10-14T17:00:56.895608+0000","last_became_active":"2023-10-14T16:54:49.064495+0000","last_became_peered":"2023-10-14T16:54:49.064495+0000","last_unstale":"2023-10-14T17:00:56.895608+0000","last_undegraded":"2023-10-14T17:00:56.895608+0000","last_fullsized":"2023-10-14T17:00:56.895608+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T17:00:56.895495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T17:00:56.895495+0000","last_clean_scrub_stamp":"2023-10-14T17:00:56.895495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:49.998334+0000","scrub_duration":0.001570407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"23'1042","reported_seq":1070,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:43.521284+0000","last_change":"2023-10-14T17:00:43.521256+0000","last_active":"2023-10-14T17:00:43.521284+0000","last_peered":"2023-10-14T17:00:43.521284+0000","last_clean":"2023-10-14T17:00:43.521284+0000","last_became_active":"2023-10-14T16:54:54.105097+0000","last_became_peered":"2023-10-14T16:54:54.105097+0000","last_unstale":"2023-10-14T17:00:43.521284+0000","last_undegraded":"2023-10-14T17:00:43.521284+0000","last_fullsized":"2023-10-14T17:00:43.521284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1042","last_scrub_stamp":"2023-10-14T17:00:43.521155+0000","last_deep_scrub":"23'1042","last_deep_scrub_stamp":"2023-10-14T17:00:43.521155+0000","last_clean_scrub_stamp":"2023-10-14T17:00:43.521155+0000","objects_scrubbed":2,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:19.760658+0000","scrub_duration":0.021131402000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":8695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"23'755","reported_seq":832,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:39.294771+0000","last_change":"2023-10-14T17:00:39.294739+0000","last_active":"2023-10-14T17:00:39.294771+0000","last_peered":"2023-10-14T17:00:39.294771+0000","last_clean":"2023-10-14T17:00:39.294771+0000","last_became_active":"2023-10-14T16:54:55.099881+0000","last_became_peered":"2023-10-14T16:54:55.099881+0000","last_unstale":"2023-10-14T17:00:39.294771+0000","last_undegraded":"2023-10-14T17:00:39.294771+0000","last_fullsized":"2023-10-14T17:00:39.294771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'755","last_scrub_stamp":"2023-10-14T17:00:39.294633+0000","last_deep_scrub":"23'755","last_deep_scrub_stamp":"2023-10-14T17:00:39.294633+0000","last_clean_scrub_stamp":"2023-10-14T17:00:39.294633+0000","objects_scrubbed":1,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:20.360047+0000","scrub_duration":0.0038686810000000001,"objects_trimmed":0,"snaptrim_duration":0.015859669999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'741","reported_seq":769,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:46.615464+0000","last_change":"2023-10-14T17:00:46.615433+0000","last_active":"2023-10-14T17:00:46.615464+0000","last_peered":"2023-10-14T17:00:46.615464+0000","last_clean":"2023-10-14T17:00:46.615464+0000","last_became_active":"2023-10-14T16:54:54.102688+0000","last_became_peered":"2023-10-14T16:54:54.102688+0000","last_unstale":"2023-10-14T17:00:46.615464+0000","last_undegraded":"2023-10-14T17:00:46.615464+0000","last_fullsized":"2023-10-14T17:00:46.615464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'741","last_scrub_stamp":"2023-10-14T17:00:46.615342+0000","last_deep_scrub":"23'741","last_deep_scrub_stamp":"2023-10-14T17:00:46.615342+0000","last_clean_scrub_stamp":"2023-10-14T17:00:46.615342+0000","objects_scrubbed":1,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:31.980064+0000","scrub_duration":0.012945305000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'628","reported_seq":705,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:37.264296+0000","last_change":"2023-10-14T17:00:37.264268+0000","last_active":"2023-10-14T17:00:37.264296+0000","last_peered":"2023-10-14T17:00:37.264296+0000","last_clean":"2023-10-14T17:00:37.264296+0000","last_became_active":"2023-10-14T16:54:55.108575+0000","last_became_peered":"2023-10-14T16:54:55.108575+0000","last_unstale":"2023-10-14T17:00:37.264296+0000","last_undegraded":"2023-10-14T17:00:37.264296+0000","last_fullsized":"2023-10-14T17:00:37.264296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'628","last_scrub_stamp":"2023-10-14T17:00:37.264178+0000","last_deep_scrub":"23'628","last_deep_scrub_stamp":"2023-10-14T17:00:37.264178+0000","last_clean_scrub_stamp":"2023-10-14T17:00:37.264178+0000","objects_scrubbed":1,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:56.886434+0000","scrub_duration":0.0030037409999999999,"objects_trimmed":0,"snaptrim_duration":0.048042644000000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'756","reported_seq":784,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:41.497508+0000","last_change":"2023-10-14T17:00:41.497480+0000","last_active":"2023-10-14T17:00:41.497508+0000","last_peered":"2023-10-14T17:00:41.497508+0000","last_clean":"2023-10-14T17:00:41.497508+0000","last_became_active":"2023-10-14T16:54:54.095709+0000","last_became_peered":"2023-10-14T16:54:54.095709+0000","last_unstale":"2023-10-14T17:00:41.497508+0000","last_undegraded":"2023-10-14T17:00:41.497508+0000","last_fullsized":"2023-10-14T17:00:41.497508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'756","last_scrub_stamp":"2023-10-14T17:00:41.497391+0000","last_deep_scrub":"23'756","last_deep_scrub_stamp":"2023-10-14T17:00:41.497391+0000","last_clean_scrub_stamp":"2023-10-14T17:00:41.497391+0000","objects_scrubbed":2,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:22.562805+0000","scrub_duration":0.014326548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":751,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"23'834","reported_seq":911,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:56.297998+0000","last_change":"2023-10-14T17:00:56.297971+0000","last_active":"2023-10-14T17:00:56.297998+0000","last_peered":"2023-10-14T17:00:56.297998+0000","last_clean":"2023-10-14T17:00:56.297998+0000","last_became_active":"2023-10-14T16:54:55.098664+0000","last_became_peered":"2023-10-14T16:54:55.098664+0000","last_unstale":"2023-10-14T17:00:56.297998+0000","last_undegraded":"2023-10-14T17:00:56.297998+0000","last_fullsized":"2023-10-14T17:00:56.297998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'834","last_scrub_stamp":"2023-10-14T17:00:56.297867+0000","last_deep_scrub":"23'834","last_deep_scrub_stamp":"2023-10-14T17:00:56.297867+0000","last_clean_scrub_stamp":"2023-10-14T17:00:56.297867+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:00:54.739284+0000","scrub_duration":0.0021536770000000001,"objects_trimmed":0,"snaptrim_duration":0.038542571999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2260","reported_seq":2288,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:19.853834+0000","last_change":"2023-10-14T17:00:19.853808+0000","last_active":"2023-10-14T17:00:19.853834+0000","last_peered":"2023-10-14T17:00:19.853834+0000","last_clean":"2023-10-14T17:00:19.853834+0000","last_became_active":"2023-10-14T16:54:54.102732+0000","last_became_peered":"2023-10-14T16:54:54.102732+0000","last_unstale":"2023-10-14T17:00:19.853834+0000","last_undegraded":"2023-10-14T17:00:19.853834+0000","last_fullsized":"2023-10-14T17:00:19.853834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2260","last_scrub_stamp":"2023-10-14T17:00:19.853728+0000","last_deep_scrub":"23'2260","last_deep_scrub_stamp":"2023-10-14T17:00:19.853728+0000","last_clean_scrub_stamp":"2023-10-14T17:00:19.853728+0000","objects_scrubbed":4,"log_size":2260,"log_dups_size":0,"ondisk_log_size":2260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:08.458027+0000","scrub_duration":0.035936590999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2245,"num_write_kb":13441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"23'673","reported_seq":750,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:29.414546+0000","last_change":"2023-10-14T17:00:29.414519+0000","last_active":"2023-10-14T17:00:29.414546+0000","last_peered":"2023-10-14T17:00:29.414546+0000","last_clean":"2023-10-14T17:00:29.414546+0000","last_became_active":"2023-10-14T16:54:55.096918+0000","last_became_peered":"2023-10-14T16:54:55.096918+0000","last_unstale":"2023-10-14T17:00:29.414546+0000","last_undegraded":"2023-10-14T17:00:29.414546+0000","last_fullsized":"2023-10-14T17:00:29.414546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'673","last_scrub_stamp":"2023-10-14T17:00:29.414416+0000","last_deep_scrub":"23'673","last_deep_scrub_stamp":"2023-10-14T17:00:29.414416+0000","last_clean_scrub_stamp":"2023-10-14T17:00:29.414416+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:59:18.018716+0000","scrub_duration":0.0018134749999999999,"objects_trimmed":0,"snaptrim_duration":0.038619158000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"23'3075","reported_seq":3103,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:42.686548+0000","last_change":"2023-10-14T17:00:42.686498+0000","last_active":"2023-10-14T17:00:42.686548+0000","last_peered":"2023-10-14T17:00:42.686548+0000","last_clean":"2023-10-14T17:00:42.686548+0000","last_became_active":"2023-10-14T16:54:54.095054+0000","last_became_peered":"2023-10-14T16:54:54.095054+0000","last_unstale":"2023-10-14T17:00:42.686548+0000","last_undegraded":"2023-10-14T17:00:42.686548+0000","last_fullsized":"2023-10-14T17:00:42.686548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3075","last_scrub_stamp":"2023-10-14T17:00:42.686353+0000","last_deep_scrub":"23'3075","last_deep_scrub_stamp":"2023-10-14T17:00:42.686353+0000","last_clean_scrub_stamp":"2023-10-14T17:00:42.686353+0000","objects_scrubbed":2,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:23.923986+0000","scrub_duration":0.017120115000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5336939,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3065,"num_write_kb":7243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"23'767","reported_seq":844,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:13.628534+0000","last_change":"2023-10-14T17:00:13.628505+0000","last_active":"2023-10-14T17:00:13.628534+0000","last_peered":"2023-10-14T17:00:13.628534+0000","last_clean":"2023-10-14T17:00:13.628534+0000","last_became_active":"2023-10-14T16:54:55.097108+0000","last_became_peered":"2023-10-14T16:54:55.097108+0000","last_unstale":"2023-10-14T17:00:13.628534+0000","last_undegraded":"2023-10-14T17:00:13.628534+0000","last_fullsized":"2023-10-14T17:00:13.628534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'767","last_scrub_stamp":"2023-10-14T17:00:13.628407+0000","last_deep_scrub":"23'767","last_deep_scrub_stamp":"2023-10-14T17:00:13.628407+0000","last_clean_scrub_stamp":"2023-10-14T17:00:13.628407+0000","objects_scrubbed":1,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:21.508614+0000","scrub_duration":0.0032656299999999998,"objects_trimmed":0,"snaptrim_duration":0.068737623999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"23'788","reported_seq":816,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:38.718974+0000","last_change":"2023-10-14T17:00:38.718944+0000","last_active":"2023-10-14T17:00:38.718974+0000","last_peered":"2023-10-14T17:00:38.718974+0000","last_clean":"2023-10-14T17:00:38.718974+0000","last_became_active":"2023-10-14T16:54:54.097944+0000","last_became_peered":"2023-10-14T16:54:54.097944+0000","last_unstale":"2023-10-14T17:00:38.718974+0000","last_undegraded":"2023-10-14T17:00:38.718974+0000","last_fullsized":"2023-10-14T17:00:38.718974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'788","last_scrub_stamp":"2023-10-14T17:00:38.718839+0000","last_deep_scrub":"23'788","last_deep_scrub_stamp":"2023-10-14T17:00:38.718839+0000","last_clean_scrub_stamp":"2023-10-14T17:00:38.718839+0000","objects_scrubbed":4,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:14.958342+0000","scrub_duration":0.020417911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389162,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"23'697","reported_seq":772,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:25.463530+0000","last_change":"2023-10-14T17:00:25.463505+0000","last_active":"2023-10-14T17:00:25.463530+0000","last_peered":"2023-10-14T17:00:25.463530+0000","last_clean":"2023-10-14T17:00:25.463530+0000","last_became_active":"2023-10-14T16:54:55.107131+0000","last_became_peered":"2023-10-14T16:54:55.107131+0000","last_unstale":"2023-10-14T17:00:25.463530+0000","last_undegraded":"2023-10-14T17:00:25.463530+0000","last_fullsized":"2023-10-14T17:00:25.463530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'697","last_scrub_stamp":"2023-10-14T17:00:25.463404+0000","last_deep_scrub":"23'697","last_deep_scrub_stamp":"2023-10-14T17:00:25.463404+0000","last_clean_scrub_stamp":"2023-10-14T17:00:25.463404+0000","objects_scrubbed":4,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:09.785280+0000","scrub_duration":0.0057845700000000002,"objects_trimmed":0,"snaptrim_duration":0.026701018,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"23'673","reported_seq":749,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:59.255258+0000","last_change":"2023-10-14T17:00:59.255217+0000","last_active":"2023-10-14T17:00:59.255258+0000","last_peered":"2023-10-14T17:00:59.255258+0000","last_clean":"2023-10-14T17:00:59.255258+0000","last_became_active":"2023-10-14T16:54:55.107563+0000","last_became_peered":"2023-10-14T16:54:55.107563+0000","last_unstale":"2023-10-14T17:00:59.255258+0000","last_undegraded":"2023-10-14T17:00:59.255258+0000","last_fullsized":"2023-10-14T17:00:59.255258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'673","last_scrub_stamp":"2023-10-14T17:00:59.255080+0000","last_deep_scrub":"23'673","last_deep_scrub_stamp":"2023-10-14T17:00:59.255080+0000","last_clean_scrub_stamp":"2023-10-14T17:00:59.255080+0000","objects_scrubbed":4,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:04.808721+0000","scrub_duration":0.0063237620000000001,"objects_trimmed":0,"snaptrim_duration":0.01972498,"stat_sum":{"num_bytes":33,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"23'709","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:07.161938+0000","last_change":"2023-10-14T17:00:07.161914+0000","last_active":"2023-10-14T17:00:07.161938+0000","last_peered":"2023-10-14T17:00:07.161938+0000","last_clean":"2023-10-14T17:00:07.161938+0000","last_became_active":"2023-10-14T16:54:55.094365+0000","last_became_peered":"2023-10-14T16:54:55.094365+0000","last_unstale":"2023-10-14T17:00:07.161938+0000","last_undegraded":"2023-10-14T17:00:07.161938+0000","last_fullsized":"2023-10-14T17:00:07.161938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'709","last_scrub_stamp":"2023-10-14T17:00:07.161847+0000","last_deep_scrub":"23'709","last_deep_scrub_stamp":"2023-10-14T17:00:07.161847+0000","last_clean_scrub_stamp":"2023-10-14T17:00:07.161847+0000","objects_scrubbed":3,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:33:35.683711+0000","scrub_duration":0.003594294,"objects_trimmed":0,"snaptrim_duration":0.012044934,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"23'777","reported_seq":853,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:31.885442+0000","last_change":"2023-10-14T17:00:31.885415+0000","last_active":"2023-10-14T17:00:31.885442+0000","last_peered":"2023-10-14T17:00:31.885442+0000","last_clean":"2023-10-14T17:00:31.885442+0000","last_became_active":"2023-10-14T16:54:55.105044+0000","last_became_peered":"2023-10-14T16:54:55.105044+0000","last_unstale":"2023-10-14T17:00:31.885442+0000","last_undegraded":"2023-10-14T17:00:31.885442+0000","last_fullsized":"2023-10-14T17:00:31.885442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'777","last_scrub_stamp":"2023-10-14T17:00:31.885334+0000","last_deep_scrub":"23'777","last_deep_scrub_stamp":"2023-10-14T17:00:31.885334+0000","last_clean_scrub_stamp":"2023-10-14T17:00:31.885334+0000","objects_scrubbed":2,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:31:12.950748+0000","scrub_duration":0.0045303030000000003,"objects_trimmed":0,"snaptrim_duration":0.058085603999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.23","version":"23'606","reported_seq":682,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:21.715441+0000","last_change":"2023-10-14T17:00:21.715409+0000","last_active":"2023-10-14T17:00:21.715441+0000","last_peered":"2023-10-14T17:00:21.715441+0000","last_clean":"2023-10-14T17:00:21.715441+0000","last_became_active":"2023-10-14T16:54:55.096856+0000","last_became_peered":"2023-10-14T16:54:55.096856+0000","last_unstale":"2023-10-14T17:00:21.715441+0000","last_undegraded":"2023-10-14T17:00:21.715441+0000","last_fullsized":"2023-10-14T17:00:21.715441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'606","last_scrub_stamp":"2023-10-14T17:00:21.715312+0000","last_deep_scrub":"23'606","last_deep_scrub_stamp":"2023-10-14T17:00:21.715312+0000","last_clean_scrub_stamp":"2023-10-14T17:00:21.715312+0000","objects_scrubbed":6,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:35.370865+0000","scrub_duration":0.0068255670000000003,"objects_trimmed":0,"snaptrim_duration":0.070423702000000005,"stat_sum":{"num_bytes":8224,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"23'396","reported_seq":472,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T17:00:14.082031+0000","last_change":"2023-10-14T17:00:14.081988+0000","last_active":"2023-10-14T17:00:14.082031+0000","last_peered":"2023-10-14T17:00:14.082031+0000","last_clean":"2023-10-14T17:00:14.082031+0000","last_became_active":"2023-10-14T16:54:55.107510+0000","last_became_peered":"2023-10-14T16:54:55.107510+0000","last_unstale":"2023-10-14T17:00:14.082031+0000","last_undegraded":"2023-10-14T17:00:14.082031+0000","last_fullsized":"2023-10-14T17:00:14.082031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'396","last_scrub_stamp":"2023-10-14T17:00:14.081897+0000","last_deep_scrub":"23'396","last_deep_scrub_stamp":"2023-10-14T17:00:14.081897+0000","last_clean_scrub_stamp":"2023-10-14T17:00:14.081897+0000","objects_scrubbed":2,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:21:14.426123+0000","scrub_duration":0.0038898180000000002,"objects_trimmed":0,"snaptrim_duration":0.048708460000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":82,"num_object_clones":21,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":8,"num_read":30,"num_read_kb":20,"num_write":108,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41448,"ondisk_log_size":41448,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":190534230,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":678,"num_write":33641,"num_write_kb":203675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381124608,"data_stored":381068460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33908,"ondisk_log_size":33908,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705752,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396524,"kb_used_data":86948,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93975316,"statfs":{"total":96636764160,"available":96230723584,"internally_reserved":0,"allocated":89034752,"data_stored":88829719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 17:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.39300000000000002,"15min":0.41699999999999998},"min":{"1min":0.33000000000000002,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.39400000000000002,"15min":0.42499999999999999},"min":{"1min":0.28499999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.624}]},{"osd":1,"last update":"Sat Oct 14 17:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.82399999999999995,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.44900000000000001,"15min":0.47099999999999997},"min":{"1min":0.29699999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.79700000000000004,"5min":2.194,"15min":2.194},"last":0.67300000000000004}]},{"osd":2,"last update":"Sat Oct 14 17:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.28799999999999998,"15min":0.33600000000000002},"min":{"1min":0.245,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.442,"5min":0.45200000000000001,"15min":0.47699999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.34300000000000003},"min":{"1min":0.26700000000000002,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.49299999999999999},"last":0.51200000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705752,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426368,"kb_used_data":116792,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93945472,"statfs":{"total":96636764160,"available":96200163328,"internally_reserved":0,"allocated":119595008,"data_stored":119367674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 17:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.47299999999999998,"15min":0.45300000000000001},"min":{"1min":0.32900000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66400000000000003,"5min":5.992,"15min":5.992},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51000000000000001,"15min":0.46400000000000002},"min":{"1min":0.35999999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.60299999999999998,"5min":9.2620000000000005,"15min":9.2620000000000005},"last":0.47699999999999998}]},{"osd":1,"last update":"Sat Oct 14 17:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.34799999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61299999999999999,"5min":6.266,"15min":6.266},"last":0.497},{"interface":"front","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.496},"min":{"1min":0.38900000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64100000000000001,"5min":6.5209999999999999,"15min":6.5209999999999999},"last":0.51200000000000001}]},{"osd":3,"last update":"Sat Oct 14 17:00:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32300000000000001},"min":{"1min":0.27500000000000002,"5min":0.16,"15min":0.16},"max":{"1min":0.61199999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.371},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.35999999999999999},"min":{"1min":0.29499999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.56699999999999995,"5min":6.3170000000000002,"15min":6.3170000000000002},"last":0.33600000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397668,"kb_used_data":92188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":93974172,"statfs":{"total":96636764160,"available":96229552128,"internally_reserved":0,"allocated":94400512,"data_stored":94213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.27000000000000002,"15min":0.29499999999999998},"min":{"1min":0.23200000000000001,"5min":0.153,"15min":0.153},"max":{"1min":0.40699999999999997,"5min":0.443,"15min":0.443},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.28299999999999997,"15min":0.30599999999999999},"min":{"1min":0.22800000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.39500000000000002,"5min":0.50800000000000001,"15min":0.53100000000000003},"last":0.33600000000000002}]},{"osd":2,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59899999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.46300000000000002},"min":{"1min":0.34999999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.36699999999999999}]},{"osd":3,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41499999999999998,"15min":0.46800000000000003},"min":{"1min":0.36299999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68999999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42199999999999999,"15min":0.47499999999999998},"min":{"1min":0.375,"5min":0.25,"15min":0.25},"max":{"1min":0.63900000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.41899999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705751,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388312,"kb_used_data":78736,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":93983528,"statfs":{"total":96636764160,"available":96239132672,"internally_reserved":0,"allocated":80625664,"data_stored":80427560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.27300000000000002,"15min":0.27600000000000002},"min":{"1min":0.20499999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.42799999999999999,"5min":0.441,"15min":0.441},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.30099999999999999},"min":{"1min":0.23799999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.443,"15min":0.46300000000000002},"min":{"1min":0.37,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.42899999999999999,"15min":0.46300000000000002},"min":{"1min":0.32600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.68400000000000005},"last":0.59799999999999998}]},{"osd":3,"last update":"Sat Oct 14 17:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.434,"15min":0.45800000000000002},"min":{"1min":0.39200000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.48899999999999999},"min":{"1min":0.36599999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69199999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94076928,"data_stored":94064538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":79691776,"data_stored":79691776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":119250944,"data_stored":119230438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88104960,"data_stored":88081708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":53391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":73798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T17:01:48.926 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-14T17:01:49.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.074+0000 7f969d875700 1 Processor -- start 2023-10-14T17:01:49.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.074+0000 7f969d875700 1 -- start start 2023-10-14T17:01:49.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f969d875700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f96980a6990 0x7f96980a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f969d875700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96980972a0 con 0x7f9698096b50 2023-10-14T17:01:49.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f969d875700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9698096120 con 0x7f969813bc90 2023-10-14T17:01:49.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f969d875700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9698097000 con 0x7f96980a6990 2023-10-14T17:01:49.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f9697fff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9698096b50 0x7f96980a50c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51896/0 (socket says 172.21.15.8:51896) 2023-10-14T17:01:49.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f9697fff700 1 -- 172.21.15.8:0/2279288903 learned_addr learned my addr 172.21.15.8:0/2279288903 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:01:49.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f969c873700 1 --2- 172.21.15.8:0/2279288903 >> v2:172.21.15.155:3300/0 conn(0x7f96980a6990 0x7f96980a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703792569 0 0) 0x7f96980972a0 con 0x7f9698096b50 2023-10-14T17:01:49.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9680003570 con 0x7f9698096b50 2023-10-14T17:01:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1004064099 0 0) 0x7f9680003570 con 0x7f9698096b50 2023-10-14T17:01:49.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 >> v2:172.21.15.155:3300/0 conn(0x7f96980a6990 msgr2=0x7f96980a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 --2- 172.21.15.8:0/2279288903 >> v2:172.21.15.155:3300/0 conn(0x7f96980a6990 0x7f96980a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 >> v1:172.21.15.155:6789/0 conn(0x7f969813bc90 legacy=0x7f969813e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96980a4750 con 0x7f9698096b50 2023-10-14T17:01:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f968c001470 con 0x7f9698096b50 2023-10-14T17:01:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 >> v1:172.21.15.8:6789/0 conn(0x7f9698096b50 legacy=0x7f96980a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 --2- 172.21.15.8:0/2279288903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9680003a60 0x7f9680003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 --2- 172.21.15.8:0/2279288903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9680004810 0x7f9680004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 --2- 172.21.15.8:0/2279288903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96800051c0 0x7f968000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9698097000 con 0x7f9680004810 2023-10-14T17:01:49.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968000c0e0 con 0x7f9680003a60 2023-10-14T17:01:49.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.075+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968000c2a0 con 0x7f96800051c0 2023-10-14T17:01:49.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f9697fff700 1 --2- 172.21.15.8:0/2279288903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9680004810 0x7f9680004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f969c873700 1 --2- 172.21.15.8:0/2279288903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9680003a60 0x7f9680003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f969d074700 1 --2- 172.21.15.8:0/2279288903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96800051c0 0x7f968000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f9697fff700 1 -- 172.21.15.8:0/2279288903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96800051c0 msgr2=0x7f968000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f9697fff700 1 --2- 172.21.15.8:0/2279288903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96800051c0 0x7f968000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f9697fff700 1 -- 172.21.15.8:0/2279288903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9680003a60 msgr2=0x7f9680003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:49.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f9697fff700 1 --2- 172.21.15.8:0/2279288903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9680003a60 0x7f9680003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f9697fff700 1 -- 172.21.15.8:0/2279288903 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9680003570 con 0x7f9680004810 2023-10-14T17:01:49.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f969d074700 1 -- 172.21.15.8:0/2279288903 reap_dead start 2023-10-14T17:01:49.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f9697fff700 1 --2- 172.21.15.8:0/2279288903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9680004810 0x7f9680004c80 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7f968c00c390 tx=0x7f96980a48e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9bf2c49250618a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:49.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00cc60 con 0x7f9680004810 2023-10-14T17:01:49.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c00ce00 con 0x7f9680004810 2023-10-14T17:01:49.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f96977fe700 1 -- 172.21.15.8:0/2279288903 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c005b70 con 0x7f9680004810 2023-10-14T17:01:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.076+0000 7f969d875700 1 -- 172.21.15.8:0/2279288903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9680004810 msgr2=0x7f9680004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.077+0000 7f969d875700 1 --2- 172.21.15.8:0/2279288903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9680004810 0x7f9680004c80 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7f968c00c390 tx=0x7f96980a48e0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.077+0000 7f969d875700 1 -- 172.21.15.8:0/2279288903 shutdown_connections 2023-10-14T17:01:49.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.077+0000 7f969d875700 1 --2- 172.21.15.8:0/2279288903 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9680004810 0x7f9680004c80 unknown :-1 s=CLOSED pgs=2501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.077+0000 7f969d875700 1 -- 172.21.15.8:0/2279288903 >> 172.21.15.8:0/2279288903 conn(0x7f969806a840 msgr2=0x7f96980701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.077+0000 7f969d875700 1 -- 172.21.15.8:0/2279288903 shutdown_connections 2023-10-14T17:01:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.077+0000 7f969d875700 1 -- 172.21.15.8:0/2279288903 wait complete. 2023-10-14T17:01:49.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.077+0000 7f969d875700 1 Processor -- start 2023-10-14T17:01:49.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f969d875700 1 -- start start 2023-10-14T17:01:49.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f969d875700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9680004810 0x7f9698132440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f969d875700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f969809c1d0 0x7f9698132980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f969d875700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9698132ec0 0x7f9698098a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f969d875700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9698099e60 con 0x7f969809c1d0 2023-10-14T17:01:49.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f969d875700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96980a2fa0 con 0x7f9680004810 2023-10-14T17:01:49.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f969d875700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969809c650 con 0x7f9698132ec0 2023-10-14T17:01:49.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f9697fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f969809c1d0 0x7f9698132980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f9697fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f969809c1d0 0x7f9698132980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50220/0 (socket says 172.21.15.8:50220) 2023-10-14T17:01:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f9697fff700 1 -- 172.21.15.8:0/844491295 learned_addr learned my addr 172.21.15.8:0/844491295 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f969c873700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9680004810 0x7f9698132440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f969d074700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9698132ec0 0x7f9698098a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.078+0000 7f9697fff700 1 -- 172.21.15.8:0/844491295 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9698132ec0 msgr2=0x7f9698098a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.079+0000 7f9697fff700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9698132ec0 0x7f9698098a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.079+0000 7f9697fff700 1 -- 172.21.15.8:0/844491295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9680004810 msgr2=0x7f9698132440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.079+0000 7f9697fff700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9680004810 0x7f9698132440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.079+0000 7f9697fff700 1 -- 172.21.15.8:0/844491295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969809c910 con 0x7f969809c1d0 2023-10-14T17:01:49.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.079+0000 7f969d074700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9698132ec0 0x7f9698098a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:01:49.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.079+0000 7f9697fff700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f969809c1d0 0x7f9698132980 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7f968000c0b0 tx=0x7f968c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:49.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.079+0000 7f9694ff9700 1 -- 172.21.15.8:0/844491295 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0072e0 con 0x7f969809c1d0 2023-10-14T17:01:49.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.079+0000 7f9694ff9700 1 -- 172.21.15.8:0/844491295 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c007440 con 0x7f969809c1d0 2023-10-14T17:01:49.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.079+0000 7f9694ff9700 1 -- 172.21.15.8:0/844491295 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0077c0 con 0x7f969809c1d0 2023-10-14T17:01:49.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.079+0000 7f969d875700 1 -- 172.21.15.8:0/844491295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969809a5b0 con 0x7f969809c1d0 2023-10-14T17:01:49.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.079+0000 7f969d875700 1 -- 172.21.15.8:0/844491295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9698098f70 con 0x7f969809c1d0 2023-10-14T17:01:49.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.080+0000 7f969d875700 1 -- 172.21.15.8:0/844491295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96981332c0 con 0x7f969809c1d0 2023-10-14T17:01:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.080+0000 7f9694ff9700 1 -- 172.21.15.8:0/844491295 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f968c01e640 con 0x7f969809c1d0 2023-10-14T17:01:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.081+0000 7f9694ff9700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9684066f30 0x7f96840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.081+0000 7f969c873700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9684066f30 0x7f96840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.081+0000 7f9694ff9700 1 -- 172.21.15.8:0/844491295 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f968c084d20 con 0x7f969809c1d0 2023-10-14T17:01:49.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.081+0000 7f969c873700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9684066f30 0x7f96840693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96900094d0 tx=0x7f969000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:49.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.085+0000 7f9694ff9700 1 -- 172.21.15.8:0/844491295 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f968c0524b0 con 0x7f969809c1d0 2023-10-14T17:01:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.279+0000 7f969d875700 1 -- 172.21.15.8:0/844491295 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f969806ac10 con 0x7f969809c1d0 2023-10-14T17:01:49.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.282+0000 7f9694ff9700 1 -- 172.21.15.8:0/844491295 <== mon.0 v2:172.21.15.8:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f968c088030 con 0x7f969809c1d0 2023-10-14T17:01:49.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.282+0000 7f9694ff9700 1 -- 172.21.15.8:0/844491295 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f968c017070 con 0x7f969809c1d0 2023-10-14T17:01:49.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.285+0000 7f969d875700 1 -- 172.21.15.8:0/844491295 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9684066f30 msgr2=0x7f96840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.285+0000 7f969d875700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9684066f30 0x7f96840693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96900094d0 tx=0x7f969000b040 comp rx=0 tx=0).stop 2023-10-14T17:01:49.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.285+0000 7f969d875700 1 -- 172.21.15.8:0/844491295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f969809c1d0 msgr2=0x7f9698132980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.285+0000 7f969d875700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f969809c1d0 0x7f9698132980 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7f968000c0b0 tx=0x7f968c015000 comp rx=0 tx=0).stop 2023-10-14T17:01:49.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.285+0000 7f969d875700 1 -- 172.21.15.8:0/844491295 shutdown_connections 2023-10-14T17:01:49.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.285+0000 7f969d875700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f9684066f30 0x7f96840693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.285+0000 7f969d875700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9698132ec0 0x7f9698098a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.285+0000 7f969d875700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9680004810 0x7f9698132440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.285+0000 7f969d875700 1 --2- 172.21.15.8:0/844491295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f969809c1d0 0x7f9698132980 unknown :-1 s=CLOSED pgs=2502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.285+0000 7f969d875700 1 -- 172.21.15.8:0/844491295 >> 172.21.15.8:0/844491295 conn(0x7f969806a840 msgr2=0x7f9698133660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:49.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.285+0000 7f969d875700 1 -- 172.21.15.8:0/844491295 shutdown_connections 2023-10-14T17:01:49.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.285+0000 7f969d875700 1 -- 172.21.15.8:0/844491295 wait complete. 2023-10-14T17:01:49.298 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T17:01:49.299 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T17:01:49.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.416+0000 7f4029457700 1 Processor -- start 2023-10-14T17:01:49.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.416+0000 7f4029457700 1 -- start start 2023-10-14T17:01:49.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.416+0000 7f4029457700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40240a6a70 0x7f40240a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.416+0000 7f4029457700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f40240a5550 0x7f4024137080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.416+0000 7f4029457700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240a0d30 con 0x7f40240a5180 2023-10-14T17:01:49.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.416+0000 7f4029457700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40240a4850 con 0x7f40240a5550 2023-10-14T17:01:49.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.416+0000 7f4029457700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40240a2a40 con 0x7f40240a6a70 2023-10-14T17:01:49.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f40237fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f40240a5180 0x7f4024136970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51898/0 (socket says 172.21.15.8:51898) 2023-10-14T17:01:49.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f40237fe700 1 -- 172.21.15.8:0/2024557993 learned_addr learned my addr 172.21.15.8:0/2024557993 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:01:49.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785384409 0 0) 0x7f40240a0d30 con 0x7f40240a5180 2023-10-14T17:01:49.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4023fff700 1 --2- 172.21.15.8:0/2024557993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40240a6a70 0x7f40240a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4028c56700 1 --2- 172.21.15.8:0/2024557993 >> v2:172.21.15.155:3300/0 conn(0x7f40240a5550 0x7f4024137080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f400c003570 con 0x7f40240a5180 2023-10-14T17:01:49.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1851896556 0 0) 0x7f400c003570 con 0x7f40240a5180 2023-10-14T17:01:49.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40240a6a70 msgr2=0x7f40240a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:49.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 --2- 172.21.15.8:0/2024557993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40240a6a70 0x7f40240a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 >> v2:172.21.15.155:3300/0 conn(0x7f40240a5550 msgr2=0x7f4024137080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:49.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 --2- 172.21.15.8:0/2024557993 >> v2:172.21.15.155:3300/0 conn(0x7f40240a5550 0x7f4024137080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40240a18c0 con 0x7f40240a5180 2023-10-14T17:01:49.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2178533324 0 0) 0x7f4018001470 con 0x7f40240a5180 2023-10-14T17:01:49.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 >> v1:172.21.15.8:6789/0 conn(0x7f40240a5180 legacy=0x7f4024136970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 --2- 172.21.15.8:0/2024557993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f400c003a60 0x7f400c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 --2- 172.21.15.8:0/2024557993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400c004810 0x7f400c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 --2- 172.21.15.8:0/2024557993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f400c0051c0 0x7f400c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240a4850 con 0x7f400c003a60 2023-10-14T17:01:49.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240a2a40 con 0x7f400c004810 2023-10-14T17:01:49.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c00bfa0 con 0x7f400c0051c0 2023-10-14T17:01:49.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4023fff700 1 --2- 172.21.15.8:0/2024557993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f400c003a60 0x7f400c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f4028c56700 1 --2- 172.21.15.8:0/2024557993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f400c0051c0 0x7f400c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.417+0000 7f40237fe700 1 --2- 172.21.15.8:0/2024557993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400c004810 0x7f400c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4023fff700 1 -- 172.21.15.8:0/2024557993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f400c0051c0 msgr2=0x7f400c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:49.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4023fff700 1 --2- 172.21.15.8:0/2024557993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f400c0051c0 0x7f400c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4023fff700 1 -- 172.21.15.8:0/2024557993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400c004810 msgr2=0x7f400c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:49.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4023fff700 1 --2- 172.21.15.8:0/2024557993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f400c004810 0x7f400c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4023fff700 1 -- 172.21.15.8:0/2024557993 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c003570 con 0x7f400c003a60 2023-10-14T17:01:49.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4023fff700 1 --2- 172.21.15.8:0/2024557993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f400c003a60 0x7f400c003e70 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7f4014009c00 tx=0x7f40140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18669cd99018130 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:49.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401400e6b0 con 0x7f400c003a60 2023-10-14T17:01:49.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f401400e810 con 0x7f400c003a60 2023-10-14T17:01:49.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4022ffd700 1 -- 172.21.15.8:0/2024557993 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401400ebf0 con 0x7f400c003a60 2023-10-14T17:01:49.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4029457700 1 -- 172.21.15.8:0/2024557993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f400c003a60 msgr2=0x7f400c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4029457700 1 --2- 172.21.15.8:0/2024557993 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f400c003a60 0x7f400c003e70 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7f4014009c00 tx=0x7f40140091a0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4028c56700 1 -- 172.21.15.8:0/2024557993 reap_dead start 2023-10-14T17:01:49.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4029457700 1 -- 172.21.15.8:0/2024557993 shutdown_connections 2023-10-14T17:01:49.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4029457700 1 -- 172.21.15.8:0/2024557993 >> 172.21.15.8:0/2024557993 conn(0x7f402406a960 msgr2=0x7f40240701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:49.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4029457700 1 -- 172.21.15.8:0/2024557993 shutdown_connections 2023-10-14T17:01:49.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.418+0000 7f4029457700 1 -- 172.21.15.8:0/2024557993 wait complete. 2023-10-14T17:01:49.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.419+0000 7f4029457700 1 Processor -- start 2023-10-14T17:01:49.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.419+0000 7f4029457700 1 -- start start 2023-10-14T17:01:49.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4029457700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f400c003a60 0x7f4024146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4029457700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f402409bd80 0x7f40241466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4029457700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f402409aac0 0x7f4024146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4029457700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4024099180 con 0x7f400c003a60 2023-10-14T17:01:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4029457700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402409b630 con 0x7f402409bd80 2023-10-14T17:01:49.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4029457700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4024097390 con 0x7f402409aac0 2023-10-14T17:01:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4023fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f400c003a60 0x7f4024146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4023fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f400c003a60 0x7f4024146190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50242/0 (socket says 172.21.15.8:50242) 2023-10-14T17:01:49.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4023fff700 1 -- 172.21.15.8:0/2345232933 learned_addr learned my addr 172.21.15.8:0/2345232933 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:49.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f40237fe700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f402409bd80 0x7f40241466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4028c56700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f402409aac0 0x7f4024146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4023fff700 1 -- 172.21.15.8:0/2345232933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f402409aac0 msgr2=0x7f4024146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4023fff700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f402409aac0 0x7f4024146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4023fff700 1 -- 172.21.15.8:0/2345232933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f402409bd80 msgr2=0x7f40241466d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4023fff700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f402409bd80 0x7f40241466d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4023fff700 1 -- 172.21.15.8:0/2345232933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4024097630 con 0x7f400c003a60 2023-10-14T17:01:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.420+0000 7f4023fff700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f400c003a60 0x7f4024146190 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7f401400e4b0 tx=0x7f40140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.421+0000 7f400bfff700 1 -- 172.21.15.8:0/2345232933 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014022070 con 0x7f400c003a60 2023-10-14T17:01:49.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.421+0000 7f400bfff700 1 -- 172.21.15.8:0/2345232933 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4014013bb0 con 0x7f400c003a60 2023-10-14T17:01:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.421+0000 7f4029457700 1 -- 172.21.15.8:0/2345232933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402409b090 con 0x7f400c003a60 2023-10-14T17:01:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.421+0000 7f400bfff700 1 -- 172.21.15.8:0/2345232933 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401400e6b0 con 0x7f400c003a60 2023-10-14T17:01:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.421+0000 7f4029457700 1 -- 172.21.15.8:0/2345232933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402409c210 con 0x7f400c003a60 2023-10-14T17:01:49.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.422+0000 7f4029457700 1 -- 172.21.15.8:0/2345232933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402406ad60 con 0x7f400c003a60 2023-10-14T17:01:49.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.422+0000 7f400bfff700 1 -- 172.21.15.8:0/2345232933 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f401401c450 con 0x7f400c003a60 2023-10-14T17:01:49.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.422+0000 7f400bfff700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4010066f30 0x7f40100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.423+0000 7f400bfff700 1 -- 172.21.15.8:0/2345232933 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f4014085a90 con 0x7f400c003a60 2023-10-14T17:01:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.423+0000 7f40237fe700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4010066f30 0x7f40100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.423+0000 7f40237fe700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4010066f30 0x7f40100693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f402402b570 tx=0x7f4018007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:49.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.427+0000 7f400bfff700 1 -- 172.21.15.8:0/2345232933 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4014053320 con 0x7f400c003a60 2023-10-14T17:01:49.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.664+0000 7f4029457700 1 -- 172.21.15.8:0/2345232933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4024096480 con 0x7f400c003a60 2023-10-14T17:01:49.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.665+0000 7f400bfff700 1 -- 172.21.15.8:0/2345232933 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3079 (secure 0 0 0) 0x7f4014017c20 con 0x7f400c003a60 2023-10-14T17:01:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:01:49.667 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6817/3883908964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3883908964},{"type":"v1","addr":"172.21.15.155:6817","nonce":3883908964}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T16:54:54.479174+0000","modified":"2023-10-14T16:54:58.104119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.8:6819/3402040876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3402040876},{"type":"v1","addr":"172.21.15.8:6819","nonce":3402040876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T17:01:49.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.667+0000 7f4029457700 1 -- 172.21.15.8:0/2345232933 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4010066f30 msgr2=0x7f40100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.667+0000 7f4029457700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4010066f30 0x7f40100693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f402402b570 tx=0x7f4018007040 comp rx=0 tx=0).stop 2023-10-14T17:01:49.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.667+0000 7f4029457700 1 -- 172.21.15.8:0/2345232933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f400c003a60 msgr2=0x7f4024146190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.667+0000 7f4029457700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f400c003a60 0x7f4024146190 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7f401400e4b0 tx=0x7f40140091a0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.667+0000 7f4029457700 1 -- 172.21.15.8:0/2345232933 shutdown_connections 2023-10-14T17:01:49.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.667+0000 7f4029457700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f4010066f30 0x7f40100693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.667+0000 7f4029457700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f402409aac0 0x7f4024146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.667+0000 7f4029457700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f400c003a60 0x7f4024146190 unknown :-1 s=CLOSED pgs=2505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.667+0000 7f4029457700 1 --2- 172.21.15.8:0/2345232933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f402409bd80 0x7f40241466d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.667+0000 7f4029457700 1 -- 172.21.15.8:0/2345232933 >> 172.21.15.8:0/2345232933 conn(0x7f402406a960 msgr2=0x7f4024132750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:49.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.667+0000 7f4029457700 1 -- 172.21.15.8:0/2345232933 shutdown_connections 2023-10-14T17:01:49.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.667+0000 7f4029457700 1 -- 172.21.15.8:0/2345232933 wait complete. 2023-10-14T17:01:49.672 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T17:01:49.680 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T17:01:49.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.797+0000 7fcafa254700 1 Processor -- start 2023-10-14T17:01:49.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.797+0000 7fcafa254700 1 -- start start 2023-10-14T17:01:49.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.797+0000 7fcafa254700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaf40a1310 0x7fcaf413f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcafa254700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf40a2df0 con 0x7fcaf40a6940 2023-10-14T17:01:49.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcafa254700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf4133ae0 con 0x7fcaf40a25c0 2023-10-14T17:01:49.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcafa254700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf41338f0 con 0x7fcaf40a1310 2023-10-14T17:01:49.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcaf37fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fcaf40a6940 0x7fcaf4133f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51914/0 (socket says 172.21.15.8:51914) 2023-10-14T17:01:49.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcaf37fe700 1 -- 172.21.15.8:0/570618566 learned_addr learned my addr 172.21.15.8:0/570618566 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:01:49.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcaf3fff700 1 --2- 172.21.15.8:0/570618566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaf40a1310 0x7fcaf413f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcaf27fc700 1 -- 172.21.15.8:0/570618566 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669244783 0 0) 0x7fcaf40a2df0 con 0x7fcaf40a6940 2023-10-14T17:01:49.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcaf27fc700 1 -- 172.21.15.8:0/570618566 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcadc003570 con 0x7fcaf40a6940 2023-10-14T17:01:49.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcaf27fc700 1 -- 172.21.15.8:0/570618566 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570699712 0 0) 0x7fcaf4133ae0 con 0x7fcaf40a25c0 2023-10-14T17:01:49.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcaf27fc700 1 -- 172.21.15.8:0/570618566 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaf40a2df0 con 0x7fcaf40a25c0 2023-10-14T17:01:49.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcaf3fff700 1 -- 172.21.15.8:0/570618566 >> v1:172.21.15.155:6789/0 conn(0x7fcaf40a25c0 legacy=0x7fcaf413c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcaf3fff700 1 -- 172.21.15.8:0/570618566 >> v1:172.21.15.8:6789/0 conn(0x7fcaf40a6940 legacy=0x7fcaf4133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcaf3fff700 1 -- 172.21.15.8:0/570618566 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40a1720 con 0x7fcaf40a1310 2023-10-14T17:01:49.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcaf3fff700 1 --2- 172.21.15.8:0/570618566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaf40a1310 0x7fcaf413f8d0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009e90 tx=0x7fcaec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2725c01a223780f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:49.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.798+0000 7fcaf27fc700 1 -- 172.21.15.8:0/570618566 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec00e070 con 0x7fcaf40a1310 2023-10-14T17:01:49.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.799+0000 7fcaf27fc700 1 -- 172.21.15.8:0/570618566 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcaec00bb80 con 0x7fcaf40a1310 2023-10-14T17:01:49.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.799+0000 7fcaf27fc700 1 -- 172.21.15.8:0/570618566 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec012430 con 0x7fcaf40a1310 2023-10-14T17:01:49.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.799+0000 7fcafa254700 1 -- 172.21.15.8:0/570618566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaf40a1310 msgr2=0x7fcaf413f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.799+0000 7fcafa254700 1 --2- 172.21.15.8:0/570618566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaf40a1310 0x7fcaf413f8d0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009e90 tx=0x7fcaec009780 comp rx=0 tx=0).stop 2023-10-14T17:01:49.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.799+0000 7fcafa254700 1 -- 172.21.15.8:0/570618566 shutdown_connections 2023-10-14T17:01:49.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.799+0000 7fcafa254700 1 --2- 172.21.15.8:0/570618566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaf40a1310 0x7fcaf413f8d0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.799+0000 7fcafa254700 1 -- 172.21.15.8:0/570618566 >> 172.21.15.8:0/570618566 conn(0x7fcaf406acd0 msgr2=0x7fcaf40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:49.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.799+0000 7fcafa254700 1 -- 172.21.15.8:0/570618566 shutdown_connections 2023-10-14T17:01:49.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.799+0000 7fcafa254700 1 -- 172.21.15.8:0/570618566 wait complete. 2023-10-14T17:01:49.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.800+0000 7fcafa254700 1 Processor -- start 2023-10-14T17:01:49.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.800+0000 7fcafa254700 1 -- start start 2023-10-14T17:01:49.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcafa254700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaf40a1310 0x7fcaf4095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcafa254700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf40a25c0 0x7fcaf4095fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcafa254700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaf4099a30 0x7fcaf40964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcafa254700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf40a0960 con 0x7fcaf40a1310 2023-10-14T17:01:49.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcafa254700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf4099ec0 con 0x7fcaf40a25c0 2023-10-14T17:01:49.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcafa254700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf40992e0 con 0x7fcaf4099a30 2023-10-14T17:01:49.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcaf37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaf40a1310 0x7fcaf4095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcaf37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaf40a1310 0x7fcaf4095a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50244/0 (socket says 172.21.15.8:50244) 2023-10-14T17:01:49.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcaf37fe700 1 -- 172.21.15.8:0/3939394093 learned_addr learned my addr 172.21.15.8:0/3939394093 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:49.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcaf3fff700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaf4099a30 0x7fcaf40964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcaf2ffd700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf40a25c0 0x7fcaf4095fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcaf37fe700 1 -- 172.21.15.8:0/3939394093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaf4099a30 msgr2=0x7fcaf40964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcaf37fe700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaf4099a30 0x7fcaf40964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcaf37fe700 1 -- 172.21.15.8:0/3939394093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf40a25c0 msgr2=0x7fcaf4095fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:49.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcaf37fe700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf40a25c0 0x7fcaf4095fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:49.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcaf37fe700 1 -- 172.21.15.8:0/3939394093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec009a20 con 0x7fcaf40a1310 2023-10-14T17:01:49.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcaf2ffd700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf40a25c0 0x7fcaf4095fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T17:01:49.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcaf37fe700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaf40a1310 0x7fcaf4095a70 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7fcae400c790 tx=0x7fcae4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:49.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcadb7fe700 1 -- 172.21.15.8:0/3939394093 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4005b30 con 0x7fcaf40a1310 2023-10-14T17:01:49.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcadb7fe700 1 -- 172.21.15.8:0/3939394093 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcae4005c90 con 0x7fcaf40a1310 2023-10-14T17:01:49.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcafa254700 1 -- 172.21.15.8:0/3939394093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf40a06a0 con 0x7fcaf40a1310 2023-10-14T17:01:49.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcadb7fe700 1 -- 172.21.15.8:0/3939394093 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4007320 con 0x7fcaf40a1310 2023-10-14T17:01:49.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.801+0000 7fcafa254700 1 -- 172.21.15.8:0/3939394093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf4096d10 con 0x7fcaf40a1310 2023-10-14T17:01:49.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.802+0000 7fcafa254700 1 -- 172.21.15.8:0/3939394093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf4098df0 con 0x7fcaf40a1310 2023-10-14T17:01:49.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.803+0000 7fcadb7fe700 1 -- 172.21.15.8:0/3939394093 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcae4007690 con 0x7fcaf40a1310 2023-10-14T17:01:49.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.803+0000 7fcadb7fe700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcae0066f30 0x7fcae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:49.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.803+0000 7fcadb7fe700 1 -- 172.21.15.8:0/3939394093 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7fcae4083650 con 0x7fcaf40a1310 2023-10-14T17:01:49.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.803+0000 7fcaf2ffd700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcae0066f30 0x7fcae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:49.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.804+0000 7fcaf2ffd700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcae0066f30 0x7fcae00693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4139fd0 tx=0x7fcae8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:49.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:49.807+0000 7fcadb7fe700 1 -- 172.21.15.8:0/3939394093 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcae4050de0 con 0x7fcaf40a1310 2023-10-14T17:01:50.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.047+0000 7fcafa254700 1 -- 172.21.15.8:0/3939394093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcaf40708d0 con 0x7fcaf40a1310 2023-10-14T17:01:50.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.048+0000 7fcadb7fe700 1 -- 172.21.15.8:0/3939394093 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3079 (secure 0 0 0) 0x7fcae4017090 con 0x7fcaf40a1310 2023-10-14T17:01:50.049 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:01:50.050 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4216,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6817/3883908964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3883908964},{"type":"v1","addr":"172.21.15.155:6817","nonce":3883908964}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T16:54:54.479174+0000","modified":"2023-10-14T16:54:58.104119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.8:6819/3402040876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3402040876},{"type":"v1","addr":"172.21.15.8:6819","nonce":3402040876}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T17:01:50.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.050+0000 7fcafa254700 1 -- 172.21.15.8:0/3939394093 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcae0066f30 msgr2=0x7fcae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.050+0000 7fcafa254700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcae0066f30 0x7fcae00693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4139fd0 tx=0x7fcae8009040 comp rx=0 tx=0).stop 2023-10-14T17:01:50.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.050+0000 7fcafa254700 1 -- 172.21.15.8:0/3939394093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaf40a1310 msgr2=0x7fcaf4095a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.050+0000 7fcafa254700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaf40a1310 0x7fcaf4095a70 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7fcae400c790 tx=0x7fcae4007ea0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.050+0000 7fcafa254700 1 -- 172.21.15.8:0/3939394093 shutdown_connections 2023-10-14T17:01:50.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.050+0000 7fcafa254700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fcae0066f30 0x7fcae00693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.050+0000 7fcafa254700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaf4099a30 0x7fcaf40964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.050+0000 7fcafa254700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcaf40a1310 0x7fcaf4095a70 unknown :-1 s=CLOSED pgs=2507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.050+0000 7fcafa254700 1 --2- 172.21.15.8:0/3939394093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcaf40a25c0 0x7fcaf4095fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.050+0000 7fcafa254700 1 -- 172.21.15.8:0/3939394093 >> 172.21.15.8:0/3939394093 conn(0x7fcaf406acd0 msgr2=0x7fcaf4138fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:50.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.050+0000 7fcafa254700 1 -- 172.21.15.8:0/3939394093 shutdown_connections 2023-10-14T17:01:50.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.050+0000 7fcafa254700 1 -- 172.21.15.8:0/3939394093 wait complete. 2023-10-14T17:01:50.055 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-14T17:01:50.062 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T17:01:50.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.180+0000 7fac923a0700 1 Processor -- start 2023-10-14T17:01:50.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.181+0000 7fac923a0700 1 -- start start 2023-10-14T17:01:50.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.181+0000 7fac923a0700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fac8c13d3c0 0x7fac8c13f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.181+0000 7fac923a0700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c0a0d30 con 0x7fac8c0a6a70 2023-10-14T17:01:50.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.181+0000 7fac923a0700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c0a4850 con 0x7fac8c0a5350 2023-10-14T17:01:50.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.181+0000 7fac923a0700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c0a2a40 con 0x7fac8c13d3c0 2023-10-14T17:01:50.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.181+0000 7fac91b9f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fac8c13d3c0 0x7fac8c13f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.181+0000 7fac91b9f700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fac8c13d3c0 0x7fac8c13f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50246/0 (socket says 172.21.15.8:50246) 2023-10-14T17:01:50.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.181+0000 7fac9139e700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fac8c0a6a70 0x7fac8c0a4c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51924/0 (socket says 172.21.15.8:51924) 2023-10-14T17:01:50.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.181+0000 7fac91b9f700 1 -- 172.21.15.8:0/2196737395 learned_addr learned my addr 172.21.15.8:0/2196737395 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:50.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.181+0000 7fac91b9f700 1 -- 172.21.15.8:0/2196737395 >> v1:172.21.15.155:6789/0 conn(0x7fac8c0a5350 legacy=0x7fac8c13bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:50.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.181+0000 7fac91b9f700 1 -- 172.21.15.8:0/2196737395 >> v1:172.21.15.8:6789/0 conn(0x7fac8c0a6a70 legacy=0x7fac8c0a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac91b9f700 1 -- 172.21.15.8:0/2196737395 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0a18c0 con 0x7fac8c13d3c0 2023-10-14T17:01:50.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac8bfff700 1 -- 172.21.15.8:0/2196737395 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909924486 0 0) 0x7fac8c0a0d30 con 0x7fac8c0a6a70 2023-10-14T17:01:50.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac91b9f700 1 --2- 172.21.15.8:0/2196737395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac8c13d3c0 0x7fac8c13f7a0 secure :-1 s=READY pgs=2509 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0099b0 tx=0x7fac7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1777c637133a27d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:50.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac8bfff700 1 -- 172.21.15.8:0/2196737395 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00b820 con 0x7fac8c13d3c0 2023-10-14T17:01:50.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac8bfff700 1 -- 172.21.15.8:0/2196737395 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fac7c00b980 con 0x7fac8c13d3c0 2023-10-14T17:01:50.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac8bfff700 1 -- 172.21.15.8:0/2196737395 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00bd60 con 0x7fac8c13d3c0 2023-10-14T17:01:50.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac923a0700 1 -- 172.21.15.8:0/2196737395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac8c13d3c0 msgr2=0x7fac8c13f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac923a0700 1 --2- 172.21.15.8:0/2196737395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac8c13d3c0 0x7fac8c13f7a0 secure :-1 s=READY pgs=2509 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0099b0 tx=0x7fac7c009250 comp rx=0 tx=0).stop 2023-10-14T17:01:50.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac923a0700 1 -- 172.21.15.8:0/2196737395 shutdown_connections 2023-10-14T17:01:50.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac923a0700 1 --2- 172.21.15.8:0/2196737395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac8c13d3c0 0x7fac8c13f7a0 unknown :-1 s=CLOSED pgs=2509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac923a0700 1 -- 172.21.15.8:0/2196737395 >> 172.21.15.8:0/2196737395 conn(0x7fac8c06a960 msgr2=0x7fac8c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:50.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac923a0700 1 -- 172.21.15.8:0/2196737395 shutdown_connections 2023-10-14T17:01:50.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.182+0000 7fac923a0700 1 -- 172.21.15.8:0/2196737395 wait complete. 2023-10-14T17:01:50.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.183+0000 7fac923a0700 1 Processor -- start 2023-10-14T17:01:50.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.183+0000 7fac923a0700 1 -- start start 2023-10-14T17:01:50.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac923a0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c0a5350 0x7fac8c146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac923a0700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac8c13d3c0 0x7fac8c146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac923a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac8c13bee0 0x7fac8c1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac923a0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c138e40 con 0x7fac8c13bee0 2023-10-14T17:01:50.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac923a0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0a6280 con 0x7fac8c0a5350 2023-10-14T17:01:50.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac923a0700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c139070 con 0x7fac8c13d3c0 2023-10-14T17:01:50.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac91b9f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac8c13bee0 0x7fac8c1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac91b9f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac8c13bee0 0x7fac8c1472a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50258/0 (socket says 172.21.15.8:50258) 2023-10-14T17:01:50.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac91b9f700 1 -- 172.21.15.8:0/1322081848 learned_addr learned my addr 172.21.15.8:0/1322081848 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:50.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac9139e700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c0a5350 0x7fac8c146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac90b9d700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac8c13d3c0 0x7fac8c146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac91b9f700 1 -- 172.21.15.8:0/1322081848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac8c13d3c0 msgr2=0x7fac8c146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac91b9f700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac8c13d3c0 0x7fac8c146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac91b9f700 1 -- 172.21.15.8:0/1322081848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c0a5350 msgr2=0x7fac8c146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac91b9f700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c0a5350 0x7fac8c146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac91b9f700 1 -- 172.21.15.8:0/1322081848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c0094f0 con 0x7fac8c13bee0 2023-10-14T17:01:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.184+0000 7fac91b9f700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac8c13bee0 0x7fac8c1472a0 secure :-1 s=READY pgs=2510 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0090b0 tx=0x7fac7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.185+0000 7fac897fa700 1 -- 172.21.15.8:0/1322081848 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c01a650 con 0x7fac8c13bee0 2023-10-14T17:01:50.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.185+0000 7fac897fa700 1 -- 172.21.15.8:0/1322081848 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fac7c01f070 con 0x7fac8c13bee0 2023-10-14T17:01:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.185+0000 7fac923a0700 1 -- 172.21.15.8:0/1322081848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c1356a0 con 0x7fac8c13bee0 2023-10-14T17:01:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.185+0000 7fac897fa700 1 -- 172.21.15.8:0/1322081848 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c01aa20 con 0x7fac8c13bee0 2023-10-14T17:01:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.185+0000 7fac923a0700 1 -- 172.21.15.8:0/1322081848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c139310 con 0x7fac8c13bee0 2023-10-14T17:01:50.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.186+0000 7fac923a0700 1 -- 172.21.15.8:0/1322081848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8c131a60 con 0x7fac8c13bee0 2023-10-14T17:01:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.186+0000 7fac897fa700 1 -- 172.21.15.8:0/1322081848 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac7c01b440 con 0x7fac8c13bee0 2023-10-14T17:01:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.186+0000 7fac897fa700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fac78066f60 0x7fac78069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.187+0000 7fac897fa700 1 -- 172.21.15.8:0/1322081848 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7fac7c021070 con 0x7fac8c13bee0 2023-10-14T17:01:50.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.187+0000 7fac9139e700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fac78066f60 0x7fac78069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.187+0000 7fac9139e700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fac78066f60 0x7fac78069410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fac84001560 tx=0x7fac84005d10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:50.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.191+0000 7fac897fa700 1 -- 172.21.15.8:0/1322081848 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac7c053ab0 con 0x7fac8c13bee0 2023-10-14T17:01:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.385+0000 7fac923a0700 1 -- 172.21.15.8:0/1322081848 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac8c06ad60 con 0x7fac8c13bee0 2023-10-14T17:01:50.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.386+0000 7fac897fa700 1 -- 172.21.15.8:0/1322081848 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12273 (secure 0 0 0) 0x7fac7c02b020 con 0x7fac8c13bee0 2023-10-14T17:01:50.387 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:01:50.388 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":23,"fsid":"95adc750-512b-4c1d-be1d-b471b9b365f8","created":"2023-10-14T16:54:38.186707+0000","modified":"2023-10-14T16:59:47.965865+0000","last_up_change":"2023-10-14T16:54:46.708519+0000","last_in_change":"2023-10-14T16:54:39.412080+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-14T16:54:47.365008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-14T16:54:48.035513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-14T16:54:52.330193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-14T16:54:53.459270+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18a7026e-e2a8-4830-8249-a048158018b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":86152},{"type":"v1","addr":"172.21.15.8:6801","nonce":86152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6803","nonce":86152},{"type":"v1","addr":"172.21.15.8:6805","nonce":86152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6811","nonce":86152},{"type":"v1","addr":"172.21.15.8:6813","nonce":86152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6807","nonce":86152},{"type":"v1","addr":"172.21.15.8:6809","nonce":86152}]},"public_addr":"172.21.15.8:6801/86152","cluster_addr":"172.21.15.8:6805/86152","heartbeat_back_addr":"172.21.15.8:6813/86152","heartbeat_front_addr":"172.21.15.8:6809/86152","state":["exists","up"]},{"osd":1,"uuid":"59b26170-a84b-41fb-9ecd-0cbd6daf418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":86153},{"type":"v1","addr":"172.21.15.8:6804","nonce":86153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":86153},{"type":"v1","addr":"172.21.15.8:6808","nonce":86153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":86153},{"type":"v1","addr":"172.21.15.8:6815","nonce":86153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":86153},{"type":"v1","addr":"172.21.15.8:6812","nonce":86153}]},"public_addr":"172.21.15.8:6804/86153","cluster_addr":"172.21.15.8:6808/86153","heartbeat_back_addr":"172.21.15.8:6815/86153","heartbeat_front_addr":"172.21.15.8:6812/86153","state":["exists","up"]},{"osd":2,"uuid":"2357fcd3-7aa9-4bb0-a7a6-64449296dac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":86169},{"type":"v1","addr":"172.21.15.155:6801","nonce":86169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":86169},{"type":"v1","addr":"172.21.15.155:6803","nonce":86169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":86169},{"type":"v1","addr":"172.21.15.155:6807","nonce":86169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":86169},{"type":"v1","addr":"172.21.15.155:6805","nonce":86169}]},"public_addr":"172.21.15.155:6801/86169","cluster_addr":"172.21.15.155:6803/86169","heartbeat_back_addr":"172.21.15.155:6807/86169","heartbeat_front_addr":"172.21.15.155:6805/86169","state":["exists","up"]},{"osd":3,"uuid":"f8e9141f-9815-4410-bbd0-2af26e034a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":86170},{"type":"v1","addr":"172.21.15.155:6809","nonce":86170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":86170},{"type":"v1","addr":"172.21.15.155:6811","nonce":86170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":86170},{"type":"v1","addr":"172.21.15.155:6815","nonce":86170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":86170},{"type":"v1","addr":"172.21.15.155:6813","nonce":86170}]},"public_addr":"172.21.15.155:6809/86170","cluster_addr":"172.21.15.155:6811/86170","heartbeat_back_addr":"172.21.15.155:6815/86170","heartbeat_front_addr":"172.21.15.155:6813/86170","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.589093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.587504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.523879+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T16:54:44.548178+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":14,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T17:01:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.388+0000 7fac923a0700 1 -- 172.21.15.8:0/1322081848 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fac78066f60 msgr2=0x7fac78069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.388+0000 7fac923a0700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fac78066f60 0x7fac78069410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fac84001560 tx=0x7fac84005d10 comp rx=0 tx=0).stop 2023-10-14T17:01:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.388+0000 7fac923a0700 1 -- 172.21.15.8:0/1322081848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac8c13bee0 msgr2=0x7fac8c1472a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.388+0000 7fac923a0700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac8c13bee0 0x7fac8c1472a0 secure :-1 s=READY pgs=2510 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0090b0 tx=0x7fac7c009250 comp rx=0 tx=0).stop 2023-10-14T17:01:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.388+0000 7fac923a0700 1 -- 172.21.15.8:0/1322081848 shutdown_connections 2023-10-14T17:01:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.388+0000 7fac923a0700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7fac78066f60 0x7fac78069410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.388+0000 7fac923a0700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac8c13bee0 0x7fac8c1472a0 unknown :-1 s=CLOSED pgs=2510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.388+0000 7fac923a0700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac8c0a5350 0x7fac8c146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.388+0000 7fac923a0700 1 --2- 172.21.15.8:0/1322081848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac8c13d3c0 0x7fac8c146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.388+0000 7fac923a0700 1 -- 172.21.15.8:0/1322081848 >> 172.21.15.8:0/1322081848 conn(0x7fac8c06a960 msgr2=0x7fac8c130b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.388+0000 7fac923a0700 1 -- 172.21.15.8:0/1322081848 shutdown_connections 2023-10-14T17:01:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.388+0000 7fac923a0700 1 -- 172.21.15.8:0/1322081848 wait complete. 2023-10-14T17:01:50.401 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T17:01:50.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.519+0000 7f16cd9fe700 1 Processor -- start 2023-10-14T17:01:50.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.519+0000 7f16cd9fe700 1 -- start start 2023-10-14T17:01:50.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16cd9fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f16c80a6940 0x7f16c80a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16cd9fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80a25c0 0x7f16c8133f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16cd9fe700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c80a2df0 con 0x7f16c8134450 2023-10-14T17:01:50.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16cd9fe700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c81338f0 con 0x7f16c80a6940 2023-10-14T17:01:50.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16cd9fe700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8134890 con 0x7f16c80a25c0 2023-10-14T17:01:50.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c6ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f16c80a6940 0x7f16c80a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c6ffd700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f16c80a6940 0x7f16c80a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50270/0 (socket says 172.21.15.8:50270) 2023-10-14T17:01:50.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c77fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f16c8134450 0x7f16c8136e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51932/0 (socket says 172.21.15.8:51932) 2023-10-14T17:01:50.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c6ffd700 1 -- 172.21.15.8:0/2136246294 learned_addr learned my addr 172.21.15.8:0/2136246294 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:50.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c67fc700 1 --2- 172.21.15.8:0/2136246294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80a25c0 0x7f16c8133f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c6ffd700 1 -- 172.21.15.8:0/2136246294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80a25c0 msgr2=0x7f16c8133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:50.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c6ffd700 1 --2- 172.21.15.8:0/2136246294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80a25c0 0x7f16c8133f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c6ffd700 1 -- 172.21.15.8:0/2136246294 >> v1:172.21.15.8:6789/0 conn(0x7f16c8134450 legacy=0x7f16c8136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c6ffd700 1 -- 172.21.15.8:0/2136246294 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8133ae0 con 0x7f16c80a6940 2023-10-14T17:01:50.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c5ffb700 1 -- 172.21.15.8:0/2136246294 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431078883 0 0) 0x7f16c80a2df0 con 0x7f16c8134450 2023-10-14T17:01:50.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c6ffd700 1 --2- 172.21.15.8:0/2136246294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c80a6940 0x7f16c80a1310 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7f16b00099b0 tx=0x7f16b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c142af0efd1b24 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:50.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c5ffb700 1 -- 172.21.15.8:0/2136246294 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b000b860 con 0x7f16c80a6940 2023-10-14T17:01:50.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.520+0000 7f16c5ffb700 1 -- 172.21.15.8:0/2136246294 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f16b000b9c0 con 0x7f16c80a6940 2023-10-14T17:01:50.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.521+0000 7f16c5ffb700 1 -- 172.21.15.8:0/2136246294 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b000bd80 con 0x7f16c80a6940 2023-10-14T17:01:50.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.521+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2136246294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c80a6940 msgr2=0x7f16c80a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.521+0000 7f16cd9fe700 1 --2- 172.21.15.8:0/2136246294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c80a6940 0x7f16c80a1310 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7f16b00099b0 tx=0x7f16b0009250 comp rx=0 tx=0).stop 2023-10-14T17:01:50.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.521+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2136246294 shutdown_connections 2023-10-14T17:01:50.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.521+0000 7f16cd9fe700 1 --2- 172.21.15.8:0/2136246294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c80a6940 0x7f16c80a1310 unknown :-1 s=CLOSED pgs=2512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.521+0000 7f16cd9fe700 1 --2- 172.21.15.8:0/2136246294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80a25c0 0x7f16c8133f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.521+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2136246294 >> 172.21.15.8:0/2136246294 conn(0x7f16c806acd0 msgr2=0x7f16c80701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:50.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.521+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2136246294 shutdown_connections 2023-10-14T17:01:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.521+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2136246294 wait complete. 2023-10-14T17:01:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.522+0000 7f16cd9fe700 1 Processor -- start 2023-10-14T17:01:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.522+0000 7f16cd9fe700 1 -- start start 2023-10-14T17:01:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.522+0000 7f16cd9fe700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80a25c0 0x7f16c8095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.522+0000 7f16cd9fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c8134450 0x7f16c8095fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16cd9fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c813b000 0x7f16c80964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16cd9fe700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8131760 con 0x7f16c8134450 2023-10-14T17:01:50.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16cd9fe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8098d20 con 0x7f16c813b000 2023-10-14T17:01:50.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16cd9fe700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8097840 con 0x7f16c80a25c0 2023-10-14T17:01:50.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16c67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c8134450 0x7f16c8095fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16c67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c8134450 0x7f16c8095fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50280/0 (socket says 172.21.15.8:50280) 2023-10-14T17:01:50.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16c67fc700 1 -- 172.21.15.8:0/2145335552 learned_addr learned my addr 172.21.15.8:0/2145335552 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:50.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16c6ffd700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80a25c0 0x7f16c8095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16c77fe700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c813b000 0x7f16c80964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16c67fc700 1 -- 172.21.15.8:0/2145335552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80a25c0 msgr2=0x7f16c8095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16c67fc700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80a25c0 0x7f16c8095a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16c67fc700 1 -- 172.21.15.8:0/2145335552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c813b000 msgr2=0x7f16c80964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16c67fc700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c813b000 0x7f16c80964f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16c67fc700 1 -- 172.21.15.8:0/2145335552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b00094f0 con 0x7f16c8134450 2023-10-14T17:01:50.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16c67fc700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c8134450 0x7f16c8095fb0 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f16b800d860 tx=0x7f16b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:50.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16beffd700 1 -- 172.21.15.8:0/2145335552 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80125f0 con 0x7f16c8134450 2023-10-14T17:01:50.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16beffd700 1 -- 172.21.15.8:0/2145335552 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f16b8012750 con 0x7f16c8134450 2023-10-14T17:01:50.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2145335552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c80a0800 con 0x7f16c8134450 2023-10-14T17:01:50.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16beffd700 1 -- 172.21.15.8:0/2145335552 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8012b30 con 0x7f16c8134450 2023-10-14T17:01:50.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.523+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2145335552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c8099060 con 0x7f16c8134450 2023-10-14T17:01:50.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.524+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2145335552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c80708d0 con 0x7f16c8134450 2023-10-14T17:01:50.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.525+0000 7f16beffd700 1 -- 172.21.15.8:0/2145335552 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16b801e460 con 0x7f16c8134450 2023-10-14T17:01:50.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.525+0000 7f16beffd700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f16a8066f30 0x7f16a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.525+0000 7f16beffd700 1 -- 172.21.15.8:0/2145335552 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4387+0+0 (secure 0 0 0) 0x7f16b8084650 con 0x7f16c8134450 2023-10-14T17:01:50.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.525+0000 7f16c6ffd700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f16a8066f30 0x7f16a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.525+0000 7f16c6ffd700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f16a8066f30 0x7f16a80693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f16b00099b0 tx=0x7f16b0009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:50.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.529+0000 7f16beffd700 1 -- 172.21.15.8:0/2145335552 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16b8051e60 con 0x7f16c8134450 2023-10-14T17:01:50.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.766+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2145335552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f16c80639b0 con 0x7f16c8134450 2023-10-14T17:01:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.772+0000 7f16beffd700 1 -- 172.21.15.8:0/2145335552 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f16b8055480 con 0x7f16c8134450 2023-10-14T17:01:50.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.774+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2145335552 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f16a8066f30 msgr2=0x7f16a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.774+0000 7f16cd9fe700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f16a8066f30 0x7f16a80693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f16b00099b0 tx=0x7f16b0009250 comp rx=0 tx=0).stop 2023-10-14T17:01:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.774+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2145335552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c8134450 msgr2=0x7f16c8095fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.774+0000 7f16cd9fe700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c8134450 0x7f16c8095fb0 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f16b800d860 tx=0x7f16b8008040 comp rx=0 tx=0).stop 2023-10-14T17:01:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.774+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2145335552 shutdown_connections 2023-10-14T17:01:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.774+0000 7f16cd9fe700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f16a8066f30 0x7f16a80693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.774+0000 7f16cd9fe700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c813b000 0x7f16c80964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.774+0000 7f16cd9fe700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80a25c0 0x7f16c8095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.774+0000 7f16cd9fe700 1 --2- 172.21.15.8:0/2145335552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f16c8134450 0x7f16c8095fb0 unknown :-1 s=CLOSED pgs=2513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.774+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2145335552 >> 172.21.15.8:0/2145335552 conn(0x7f16c806acd0 msgr2=0x7f16c80a9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.774+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2145335552 shutdown_connections 2023-10-14T17:01:50.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.774+0000 7f16cd9fe700 1 -- 172.21.15.8:0/2145335552 wait complete. 2023-10-14T17:01:50.779 INFO:teuthology.orchestra.run.smithi008.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T17:01:50.787 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T17:01:50.809 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2023-10-14T17:01:50.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.910+0000 7f36c6033700 1 Processor -- start 2023-10-14T17:01:50.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.910+0000 7f36c6033700 1 -- start start 2023-10-14T17:01:50.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36c6033700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f36c00a01c0 0x7f36c00a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36c6033700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c00a1e20 con 0x7f36c00a1120 2023-10-14T17:01:50.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36c6033700 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c009e720 con 0x7f36c0138ad0 2023-10-14T17:01:50.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36c6033700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c00a1c30 con 0x7f36c00a01c0 2023-10-14T17:01:50.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36beffd700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f36c00a1120 0x7f36c00a1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51952/0 (socket says 172.21.15.8:51952) 2023-10-14T17:01:50.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36beffd700 1 -- 172.21.15.8:0/3709506214 learned_addr learned my addr 172.21.15.8:0/3709506214 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:01:50.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36bf7fe700 1 --2- 172.21.15.8:0/3709506214 >> v2:172.21.15.155:3300/0 conn(0x7f36c00a01c0 0x7f36c00a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36be7fc700 1 -- 172.21.15.8:0/3709506214 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405436017 0 0) 0x7f36c00a1e20 con 0x7f36c00a1120 2023-10-14T17:01:50.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36be7fc700 1 -- 172.21.15.8:0/3709506214 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a8003570 con 0x7f36c00a1120 2023-10-14T17:01:50.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36be7fc700 1 -- 172.21.15.8:0/3709506214 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1656130444 0 0) 0x7f36a8003570 con 0x7f36c00a1120 2023-10-14T17:01:50.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36bf7fe700 1 -- 172.21.15.8:0/3709506214 >> v1:172.21.15.155:6789/0 conn(0x7f36c0138ad0 legacy=0x7f36c013aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36bf7fe700 1 -- 172.21.15.8:0/3709506214 >> v1:172.21.15.8:6789/0 conn(0x7f36c00a1120 legacy=0x7f36c00a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.911+0000 7f36bf7fe700 1 -- 172.21.15.8:0/3709506214 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0069440 con 0x7f36c00a01c0 2023-10-14T17:01:50.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.912+0000 7f36bf7fe700 1 --2- 172.21.15.8:0/3709506214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c00a01c0 0x7f36c00a0be0 secure :-1 s=READY pgs=3222 cs=0 l=1 rev1=1 crypto rx=0x7f36b00098e0 tx=0x7f36b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe03b51f52c5504c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:50.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.912+0000 7f36be7fc700 1 -- 172.21.15.8:0/3709506214 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4001470 con 0x7f36c00a01c0 2023-10-14T17:01:50.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.912+0000 7f36be7fc700 1 -- 172.21.15.8:0/3709506214 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f36b0011420 con 0x7f36c00a01c0 2023-10-14T17:01:50.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.912+0000 7f36be7fc700 1 -- 172.21.15.8:0/3709506214 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b00117e0 con 0x7f36c00a01c0 2023-10-14T17:01:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.912+0000 7f36c6033700 1 -- 172.21.15.8:0/3709506214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c00a01c0 msgr2=0x7f36c00a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.912+0000 7f36c6033700 1 --2- 172.21.15.8:0/3709506214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c00a01c0 0x7f36c00a0be0 secure :-1 s=READY pgs=3222 cs=0 l=1 rev1=1 crypto rx=0x7f36b00098e0 tx=0x7f36b00091a0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.912+0000 7f36c6033700 1 -- 172.21.15.8:0/3709506214 shutdown_connections 2023-10-14T17:01:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.912+0000 7f36c6033700 1 --2- 172.21.15.8:0/3709506214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c00a01c0 0x7f36c00a0be0 unknown :-1 s=CLOSED pgs=3222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.912+0000 7f36c6033700 1 -- 172.21.15.8:0/3709506214 >> 172.21.15.8:0/3709506214 conn(0x7f36c0068130 msgr2=0x7f36c00a6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.912+0000 7f36c6033700 1 -- 172.21.15.8:0/3709506214 shutdown_connections 2023-10-14T17:01:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.912+0000 7f36c6033700 1 -- 172.21.15.8:0/3709506214 wait complete. 2023-10-14T17:01:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.913+0000 7f36c6033700 1 Processor -- start 2023-10-14T17:01:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.913+0000 7f36c6033700 1 -- start start 2023-10-14T17:01:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36c6033700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c00a01c0 0x7f36c0137f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36c6033700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36c00a1120 0x7f36c0138460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36c6033700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c0138ad0 0x7f36c0095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36c6033700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c0098b70 con 0x7f36c00a1120 2023-10-14T17:01:50.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36c6033700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c009ce10 con 0x7f36c0138ad0 2023-10-14T17:01:50.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36c6033700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c009c700 con 0x7f36c00a01c0 2023-10-14T17:01:50.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36c00a1120 0x7f36c0138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36c00a1120 0x7f36c0138460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50308/0 (socket says 172.21.15.8:50308) 2023-10-14T17:01:50.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36beffd700 1 -- 172.21.15.8:0/3703787861 learned_addr learned my addr 172.21.15.8:0/3703787861 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:50.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36bf7fe700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c00a01c0 0x7f36c0137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36bffff700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c0138ad0 0x7f36c0095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36beffd700 1 -- 172.21.15.8:0/3703787861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c00a01c0 msgr2=0x7f36c0137f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36beffd700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c00a01c0 0x7f36c0137f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36beffd700 1 -- 172.21.15.8:0/3703787861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c0138ad0 msgr2=0x7f36c0095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:50.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36beffd700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c0138ad0 0x7f36c0095a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:50.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36beffd700 1 -- 172.21.15.8:0/3703787861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b0009420 con 0x7f36c00a1120 2023-10-14T17:01:50.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.914+0000 7f36beffd700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36c00a1120 0x7f36c0138460 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7f36b400cbc0 tx=0x7f36b4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:50.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.915+0000 7f36a77fe700 1 -- 172.21.15.8:0/3703787861 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4007360 con 0x7f36c00a1120 2023-10-14T17:01:50.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.915+0000 7f36a77fe700 1 -- 172.21.15.8:0/3703787861 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f36b40074e0 con 0x7f36c00a1120 2023-10-14T17:01:50.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.915+0000 7f36c6033700 1 -- 172.21.15.8:0/3703787861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c009c1d0 con 0x7f36c00a1120 2023-10-14T17:01:50.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.915+0000 7f36a77fe700 1 -- 172.21.15.8:0/3703787861 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4004830 con 0x7f36c00a1120 2023-10-14T17:01:50.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.915+0000 7f36c6033700 1 -- 172.21.15.8:0/3703787861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c013d210 con 0x7f36c00a1120 2023-10-14T17:01:50.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.916+0000 7f36c6033700 1 -- 172.21.15.8:0/3703787861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c006aee0 con 0x7f36c00a1120 2023-10-14T17:01:50.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.916+0000 7f36a77fe700 1 -- 172.21.15.8:0/3703787861 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36b4004be0 con 0x7f36c00a1120 2023-10-14T17:01:50.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.917+0000 7f36a77fe700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f36ac066f30 0x7f36ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:50.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.917+0000 7f36bf7fe700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f36ac066f30 0x7f36ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:50.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.917+0000 7f36a77fe700 1 -- 172.21.15.8:0/3703787861 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4445+0+0 (secure 0 0 0) 0x7f36b4083720 con 0x7f36c00a1120 2023-10-14T17:01:50.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.917+0000 7f36bf7fe700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f36ac066f30 0x7f36ac0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f36b0003080 tx=0x7f36b00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:50.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:50.921+0000 7f36a77fe700 1 -- 172.21.15.8:0/3703787861 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36b4050fe0 con 0x7f36c00a1120 2023-10-14T17:01:51.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.162+0000 7f36c6033700 1 -- 172.21.15.8:0/3703787861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f36c006ec90 con 0x7f36c00a1120 2023-10-14T17:01:51.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.771+0000 7f36a77fe700 1 -- 172.21.15.8:0/3703787861 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f36b4054600 con 0x7f36c00a1120 2023-10-14T17:01:51.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.775+0000 7f36c6033700 1 -- 172.21.15.8:0/3703787861 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f36ac066f30 msgr2=0x7f36ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:51.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.775+0000 7f36c6033700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f36ac066f30 0x7f36ac0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f36b0003080 tx=0x7f36b00091a0 comp rx=0 tx=0).stop 2023-10-14T17:01:51.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.775+0000 7f36c6033700 1 -- 172.21.15.8:0/3703787861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36c00a1120 msgr2=0x7f36c0138460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:51.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.775+0000 7f36c6033700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36c00a1120 0x7f36c0138460 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7f36b400cbc0 tx=0x7f36b4001a30 comp rx=0 tx=0).stop 2023-10-14T17:01:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.775+0000 7f36c6033700 1 -- 172.21.15.8:0/3703787861 shutdown_connections 2023-10-14T17:01:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.775+0000 7f36c6033700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f36ac066f30 0x7f36ac0693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.775+0000 7f36c6033700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c0138ad0 0x7f36c0095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:51.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.775+0000 7f36c6033700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c00a01c0 0x7f36c0137f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.775+0000 7f36c6033700 1 --2- 172.21.15.8:0/3703787861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36c00a1120 0x7f36c0138460 unknown :-1 s=CLOSED pgs=2518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.775+0000 7f36c6033700 1 -- 172.21.15.8:0/3703787861 >> 172.21.15.8:0/3703787861 conn(0x7f36c0068130 msgr2=0x7f36c006d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:51.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.775+0000 7f36c6033700 1 -- 172.21.15.8:0/3703787861 shutdown_connections 2023-10-14T17:01:51.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.775+0000 7f36c6033700 1 -- 172.21.15.8:0/3703787861 wait complete. 2023-10-14T17:01:51.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T17:01:51.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.955+0000 7f03d95b2700 1 Processor -- start 2023-10-14T17:01:51.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.955+0000 7f03d95b2700 1 -- start start 2023-10-14T17:01:51.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.955+0000 7f03d95b2700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f03d40a4940 0x7f03d4137250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:51.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.955+0000 7f03d95b2700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f03d4133cd0 0x7f03d413eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:51.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.955+0000 7f03d95b2700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d406ad40 con 0x7f03d4137790 2023-10-14T17:01:51.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.955+0000 7f03d95b2700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d406a040 con 0x7f03d4133cd0 2023-10-14T17:01:51.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.955+0000 7f03d95b2700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d4069aa0 con 0x7f03d40a4940 2023-10-14T17:01:51.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d37fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f03d4133cd0 0x7f03d413eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:51.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d27fc700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f03d4137790 0x7f03d41335c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51968/0 (socket says 172.21.15.8:51968) 2023-10-14T17:01:51.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d27fc700 1 -- 172.21.15.8:0/3312432719 learned_addr learned my addr 172.21.15.8:0/3312432719 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:01:51.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d2ffd700 1 --2- 172.21.15.8:0/3312432719 >> v2:172.21.15.155:3300/0 conn(0x7f03d40a4940 0x7f03d4137250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:51.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d37fe700 1 -- 172.21.15.8:0/3312432719 >> v2:172.21.15.155:3300/0 conn(0x7f03d40a4940 msgr2=0x7f03d4137250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:51.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d37fe700 1 --2- 172.21.15.8:0/3312432719 >> v2:172.21.15.155:3300/0 conn(0x7f03d40a4940 0x7f03d4137250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:51.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d37fe700 1 -- 172.21.15.8:0/3312432719 >> v1:172.21.15.8:6789/0 conn(0x7f03d4137790 legacy=0x7f03d41335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:51.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d1ffb700 1 -- 172.21.15.8:0/3312432719 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487628411 0 0) 0x7f03bc001110 con 0x7f03d4137790 2023-10-14T17:01:51.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d37fe700 1 -- 172.21.15.8:0/3312432719 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d4069d60 con 0x7f03d4133cd0 2023-10-14T17:01:51.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d37fe700 1 --2- 172.21.15.8:0/3312432719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d4133cd0 0x7f03d413eed0 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7f03d40a4e80 tx=0x7f03c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85c8d8aa731d57b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:51.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d1ffb700 1 -- 172.21.15.8:0/3312432719 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c400b6b0 con 0x7f03d4133cd0 2023-10-14T17:01:51.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d1ffb700 1 -- 172.21.15.8:0/3312432719 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f03c400b810 con 0x7f03d4133cd0 2023-10-14T17:01:51.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.956+0000 7f03d1ffb700 1 -- 172.21.15.8:0/3312432719 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c400bbd0 con 0x7f03d4133cd0 2023-10-14T17:01:51.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.957+0000 7f03d95b2700 1 -- 172.21.15.8:0/3312432719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d4133cd0 msgr2=0x7f03d413eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:51.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.957+0000 7f03d95b2700 1 --2- 172.21.15.8:0/3312432719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d4133cd0 0x7f03d413eed0 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7f03d40a4e80 tx=0x7f03c40091a0 comp rx=0 tx=0).stop 2023-10-14T17:01:51.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.957+0000 7f03d95b2700 1 -- 172.21.15.8:0/3312432719 shutdown_connections 2023-10-14T17:01:51.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.957+0000 7f03d95b2700 1 --2- 172.21.15.8:0/3312432719 >> v2:172.21.15.155:3300/0 conn(0x7f03d40a4940 0x7f03d4137250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:51.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.957+0000 7f03d95b2700 1 --2- 172.21.15.8:0/3312432719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d4133cd0 0x7f03d413eed0 unknown :-1 s=CLOSED pgs=2520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:51.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.957+0000 7f03d95b2700 1 -- 172.21.15.8:0/3312432719 >> 172.21.15.8:0/3312432719 conn(0x7f03d406f840 msgr2=0x7f03d40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:51.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.957+0000 7f03d95b2700 1 -- 172.21.15.8:0/3312432719 shutdown_connections 2023-10-14T17:01:51.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.957+0000 7f03d95b2700 1 -- 172.21.15.8:0/3312432719 wait complete. 2023-10-14T17:01:51.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.958+0000 7f03d95b2700 1 Processor -- start 2023-10-14T17:01:51.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.958+0000 7f03d95b2700 1 -- start start 2023-10-14T17:01:51.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.958+0000 7f03d95b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d4133cd0 0x7f03d40a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:51.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.958+0000 7f03d95b2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d4137790 0x7f03d4143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:51.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.958+0000 7f03d95b2700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03d4143950 0x7f03d4146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:51.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.958+0000 7f03d95b2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d409cf70 con 0x7f03d4133cd0 2023-10-14T17:01:51.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.958+0000 7f03d95b2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d40a0760 con 0x7f03d4137790 2023-10-14T17:01:51.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.958+0000 7f03d95b2700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d409fde0 con 0x7f03d4143950 2023-10-14T17:01:51.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.958+0000 7f03d2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d4133cd0 0x7f03d40a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:51.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.958+0000 7f03d2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d4133cd0 0x7f03d40a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50324/0 (socket says 172.21.15.8:50324) 2023-10-14T17:01:51.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.958+0000 7f03d2ffd700 1 -- 172.21.15.8:0/624991659 learned_addr learned my addr 172.21.15.8:0/624991659 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:51.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03d27fc700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d4137790 0x7f03d4143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:51.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03d37fe700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03d4143950 0x7f03d4146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:51.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03d2ffd700 1 -- 172.21.15.8:0/624991659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03d4143950 msgr2=0x7f03d4146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:51.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03d2ffd700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03d4143950 0x7f03d4146390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:51.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03d2ffd700 1 -- 172.21.15.8:0/624991659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d4137790 msgr2=0x7f03d4143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:51.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03d2ffd700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d4137790 0x7f03d4143410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:51.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03d2ffd700 1 -- 172.21.15.8:0/624991659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4009420 con 0x7f03d4133cd0 2023-10-14T17:01:51.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03d2ffd700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d4133cd0 0x7f03d40a0220 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009fa0 tx=0x7f03cc009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:51.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03caffd700 1 -- 172.21.15.8:0/624991659 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc00ed20 con 0x7f03d4133cd0 2023-10-14T17:01:51.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03caffd700 1 -- 172.21.15.8:0/624991659 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f03cc00ee80 con 0x7f03d4133cd0 2023-10-14T17:01:51.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03d95b2700 1 -- 172.21.15.8:0/624991659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d409f7f0 con 0x7f03d4133cd0 2023-10-14T17:01:51.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03caffd700 1 -- 172.21.15.8:0/624991659 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc014690 con 0x7f03d4133cd0 2023-10-14T17:01:51.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.959+0000 7f03d95b2700 1 -- 172.21.15.8:0/624991659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d409fab0 con 0x7f03d4133cd0 2023-10-14T17:01:51.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.960+0000 7f03d95b2700 1 -- 172.21.15.8:0/624991659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d40708d0 con 0x7f03d4133cd0 2023-10-14T17:01:51.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.960+0000 7f03caffd700 1 -- 172.21.15.8:0/624991659 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03cc014a00 con 0x7f03d4133cd0 2023-10-14T17:01:51.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.961+0000 7f03caffd700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f03b4066fb0 0x7f03b4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:51.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.961+0000 7f03caffd700 1 -- 172.21.15.8:0/624991659 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4445+0+0 (secure 0 0 0) 0x7f03cc084880 con 0x7f03d4133cd0 2023-10-14T17:01:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.961+0000 7f03d27fc700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f03b4066fb0 0x7f03b4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.961+0000 7f03d27fc700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f03b4066fb0 0x7f03b4069460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f03d409e050 tx=0x7f03bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:51.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:51.965+0000 7f03caffd700 1 -- 172.21.15.8:0/624991659 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03cc051fc0 con 0x7f03d4133cd0 2023-10-14T17:01:52.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.157+0000 7f03d95b2700 1 -- 172.21.15.8:0/624991659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f03d40a1ef0 con 0x7f03d4133cd0 2023-10-14T17:01:52.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.777+0000 7f03caffd700 1 -- 172.21.15.8:0/624991659 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f03cc014cb0 con 0x7f03d4133cd0 2023-10-14T17:01:52.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.781+0000 7f03d95b2700 1 -- 172.21.15.8:0/624991659 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f03b4066fb0 msgr2=0x7f03b4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:52.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.781+0000 7f03d95b2700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f03b4066fb0 0x7f03b4069460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f03d409e050 tx=0x7f03bc009040 comp rx=0 tx=0).stop 2023-10-14T17:01:52.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.781+0000 7f03d95b2700 1 -- 172.21.15.8:0/624991659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d4133cd0 msgr2=0x7f03d40a0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:52.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.781+0000 7f03d95b2700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d4133cd0 0x7f03d40a0220 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009fa0 tx=0x7f03cc009880 comp rx=0 tx=0).stop 2023-10-14T17:01:52.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.782+0000 7f03d95b2700 1 -- 172.21.15.8:0/624991659 shutdown_connections 2023-10-14T17:01:52.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.782+0000 7f03d95b2700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f03b4066fb0 0x7f03b4069460 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:52.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.782+0000 7f03d95b2700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03d4143950 0x7f03d4146390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:52.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.782+0000 7f03d95b2700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03d4133cd0 0x7f03d40a0220 unknown :-1 s=CLOSED pgs=2521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:52.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.782+0000 7f03d95b2700 1 --2- 172.21.15.8:0/624991659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d4137790 0x7f03d4143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:52.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.782+0000 7f03d95b2700 1 -- 172.21.15.8:0/624991659 >> 172.21.15.8:0/624991659 conn(0x7f03d406f840 msgr2=0x7f03d40a6900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:52.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.783+0000 7f03d95b2700 1 -- 172.21.15.8:0/624991659 shutdown_connections 2023-10-14T17:01:52.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.783+0000 7f03d95b2700 1 -- 172.21.15.8:0/624991659 wait complete. 2023-10-14T17:01:52.786 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' removed 2023-10-14T17:01:52.802 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T17:01:52.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.934+0000 7f21bcd19700 1 Processor -- start 2023-10-14T17:01:52.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.934+0000 7f21bcd19700 1 -- start start 2023-10-14T17:01:52.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.934+0000 7f21bcd19700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b80a6690 0x7f21b8133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:52.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.934+0000 7f21bcd19700 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f21b8096f20 0x7f21b81342e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:52.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.934+0000 7f21bcd19700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b8095f40 con 0x7f21b80a4850 2023-10-14T17:01:52.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.934+0000 7f21bcd19700 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b8133780 con 0x7f21b8096f20 2023-10-14T17:01:52.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.934+0000 7f21bcd19700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b80962d0 con 0x7f21b80a6690 2023-10-14T17:01:52.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.934+0000 7f21b6d9d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f21b80a4850 0x7f21b80a4c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51982/0 (socket says 172.21.15.8:51982) 2023-10-14T17:01:52.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.934+0000 7f21b6d9d700 1 -- 172.21.15.8:0/1926151792 learned_addr learned my addr 172.21.15.8:0/1926151792 (peer_addr_for_me v1:172.21.15.8:0/0) 2023-10-14T17:01:52.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b659c700 1 --2- 172.21.15.8:0/1926151792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b80a6690 0x7f21b8133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:52.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b5d9b700 1 --2- 172.21.15.8:0/1926151792 >> v2:172.21.15.155:3300/0 conn(0x7f21b8096f20 0x7f21b81342e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b559a700 1 -- 172.21.15.8:0/1926151792 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258657185 0 0) 0x7f21b8095f40 con 0x7f21b80a4850 2023-10-14T17:01:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b559a700 1 -- 172.21.15.8:0/1926151792 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21a4003570 con 0x7f21b80a4850 2023-10-14T17:01:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b559a700 1 -- 172.21.15.8:0/1926151792 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 162064566 0 0) 0x7f21a4003570 con 0x7f21b80a4850 2023-10-14T17:01:52.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b659c700 1 -- 172.21.15.8:0/1926151792 >> v2:172.21.15.155:3300/0 conn(0x7f21b8096f20 msgr2=0x7f21b81342e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T17:01:52.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b659c700 1 --2- 172.21.15.8:0/1926151792 >> v2:172.21.15.155:3300/0 conn(0x7f21b8096f20 0x7f21b81342e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:52.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b659c700 1 -- 172.21.15.8:0/1926151792 >> v1:172.21.15.8:6789/0 conn(0x7f21b80a4850 legacy=0x7f21b80a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:52.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b659c700 1 -- 172.21.15.8:0/1926151792 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8097750 con 0x7f21b80a6690 2023-10-14T17:01:52.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b5d9b700 1 --2- 172.21.15.8:0/1926151792 >> v2:172.21.15.155:3300/0 conn(0x7f21b8096f20 0x7f21b81342e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T17:01:52.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b659c700 1 --2- 172.21.15.8:0/1926151792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b80a6690 0x7f21b8133da0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009e60 tx=0x7f21a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=327b0c3b8ed4b2c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:52.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b559a700 1 -- 172.21.15.8:0/1926151792 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a800e070 con 0x7f21b80a6690 2023-10-14T17:01:52.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b559a700 1 -- 172.21.15.8:0/1926151792 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f21a800b7a0 con 0x7f21b80a6690 2023-10-14T17:01:52.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.935+0000 7f21b559a700 1 -- 172.21.15.8:0/1926151792 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0001470 con 0x7f21b80a6690 2023-10-14T17:01:52.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.936+0000 7f21bcd19700 1 -- 172.21.15.8:0/1926151792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b80a6690 msgr2=0x7f21b8133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:52.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.936+0000 7f21bcd19700 1 --2- 172.21.15.8:0/1926151792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b80a6690 0x7f21b8133da0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009e60 tx=0x7f21a8009780 comp rx=0 tx=0).stop 2023-10-14T17:01:52.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.936+0000 7f21bcd19700 1 -- 172.21.15.8:0/1926151792 shutdown_connections 2023-10-14T17:01:52.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.936+0000 7f21bcd19700 1 --2- 172.21.15.8:0/1926151792 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b80a6690 0x7f21b8133da0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:52.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.936+0000 7f21bcd19700 1 --2- 172.21.15.8:0/1926151792 >> v2:172.21.15.155:3300/0 conn(0x7f21b8096f20 0x7f21b81342e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:52.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.936+0000 7f21bcd19700 1 -- 172.21.15.8:0/1926151792 >> 172.21.15.8:0/1926151792 conn(0x7f21b806abb0 msgr2=0x7f21b80701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:52.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.936+0000 7f21bcd19700 1 -- 172.21.15.8:0/1926151792 shutdown_connections 2023-10-14T17:01:52.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.936+0000 7f21bcd19700 1 -- 172.21.15.8:0/1926151792 wait complete. 2023-10-14T17:01:52.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.937+0000 7f21bcd19700 1 Processor -- start 2023-10-14T17:01:52.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.937+0000 7f21bcd19700 1 -- start start 2023-10-14T17:01:52.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.937+0000 7f21bcd19700 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b8096f20 0x7f21b8146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:52.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.937+0000 7f21bcd19700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a4850 0x7f21b8146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:52.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.937+0000 7f21bcd19700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b8130d70 0x7f21b8147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:52.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.937+0000 7f21bcd19700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b8131570 con 0x7f21b80a4850 2023-10-14T17:01:52.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.937+0000 7f21bcd19700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b80a4290 con 0x7f21b8130d70 2023-10-14T17:01:52.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.937+0000 7f21bcd19700 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b80a2550 con 0x7f21b8096f20 2023-10-14T17:01:52.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.937+0000 7f21b5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a4850 0x7f21b8146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:52.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.937+0000 7f21b5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a4850 0x7f21b8146f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50326/0 (socket says 172.21.15.8:50326) 2023-10-14T17:01:52.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21b5d9b700 1 -- 172.21.15.8:0/1840541004 learned_addr learned my addr 172.21.15.8:0/1840541004 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-14T17:01:52.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21b6d9d700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b8130d70 0x7f21b8147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:52.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21b659c700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b8096f20 0x7f21b8146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:52.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21b5d9b700 1 -- 172.21.15.8:0/1840541004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b8096f20 msgr2=0x7f21b8146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:52.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21b5d9b700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b8096f20 0x7f21b8146a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:52.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21b5d9b700 1 -- 172.21.15.8:0/1840541004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b8130d70 msgr2=0x7f21b8147490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:52.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21b5d9b700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b8130d70 0x7f21b8147490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:52.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21b5d9b700 1 -- 172.21.15.8:0/1840541004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a0009420 con 0x7f21b80a4850 2023-10-14T17:01:52.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21b6d9d700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b8130d70 0x7f21b8147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T17:01:52.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21b659c700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b8096f20 0x7f21b8146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T17:01:52.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21b5d9b700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a4850 0x7f21b8146f50 secure :-1 s=READY pgs=2523 cs=0 l=1 rev1=1 crypto rx=0x7f21a000ec80 tx=0x7f21a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:52.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21ae7fc700 1 -- 172.21.15.8:0/1840541004 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a000c9d0 con 0x7f21b80a4850 2023-10-14T17:01:52.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21ae7fc700 1 -- 172.21.15.8:0/1840541004 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f21a000cb30 con 0x7f21b80a4850 2023-10-14T17:01:52.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21bcd19700 1 -- 172.21.15.8:0/1840541004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a8009a20 con 0x7f21b80a4850 2023-10-14T17:01:52.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21ae7fc700 1 -- 172.21.15.8:0/1840541004 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0013470 con 0x7f21b80a4850 2023-10-14T17:01:52.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.938+0000 7f21bcd19700 1 -- 172.21.15.8:0/1840541004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b80a2b60 con 0x7f21b80a4850 2023-10-14T17:01:52.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.939+0000 7f21bcd19700 1 -- 172.21.15.8:0/1840541004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b81313b0 con 0x7f21b80a4850 2023-10-14T17:01:52.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.940+0000 7f21ae7fc700 1 -- 172.21.15.8:0/1840541004 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21a00137e0 con 0x7f21b80a4850 2023-10-14T17:01:52.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.940+0000 7f21ae7fc700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2198066f30 0x7f21980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T17:01:52.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.940+0000 7f21ae7fc700 1 -- 172.21.15.8:0/1840541004 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4007+0+0 (secure 0 0 0) 0x7f21a00841e0 con 0x7f21b80a4850 2023-10-14T17:01:52.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.940+0000 7f21b659c700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2198066f30 0x7f21980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T17:01:52.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.940+0000 7f21b659c700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2198066f30 0x7f21980693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f21a800bb50 tx=0x7f21a8009780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T17:01:52.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:52.944+0000 7f21ae7fc700 1 -- 172.21.15.8:0/1840541004 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21a0051af0 con 0x7f21b80a4850 2023-10-14T17:01:53.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.138+0000 7f21bcd19700 1 -- 172.21.15.8:0/1840541004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f21b80a2710 con 0x7f21b80a4850 2023-10-14T17:01:53.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.991+0000 7f21ae7fc700 1 -- 172.21.15.8:0/1840541004 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f21a0055110 con 0x7f21b80a4850 2023-10-14T17:01:53.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.995+0000 7f21bcd19700 1 -- 172.21.15.8:0/1840541004 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2198066f30 msgr2=0x7f21980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:53.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.995+0000 7f21bcd19700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2198066f30 0x7f21980693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f21a800bb50 tx=0x7f21a8009780 comp rx=0 tx=0).stop 2023-10-14T17:01:53.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.995+0000 7f21bcd19700 1 -- 172.21.15.8:0/1840541004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a4850 msgr2=0x7f21b8146f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T17:01:53.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.995+0000 7f21bcd19700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a4850 0x7f21b8146f50 secure :-1 s=READY pgs=2523 cs=0 l=1 rev1=1 crypto rx=0x7f21a000ec80 tx=0x7f21a00091a0 comp rx=0 tx=0).stop 2023-10-14T17:01:53.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.998+0000 7f21bcd19700 1 -- 172.21.15.8:0/1840541004 shutdown_connections 2023-10-14T17:01:53.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.998+0000 7f21bcd19700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.8:6816/86003,v1:172.21.15.8:6817/86003] conn(0x7f2198066f30 0x7f21980693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:53.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.998+0000 7f21bcd19700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21b8130d70 0x7f21b8147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:54.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.998+0000 7f21bcd19700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21b8096f20 0x7f21b8146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:54.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.998+0000 7f21bcd19700 1 --2- 172.21.15.8:0/1840541004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21b80a4850 0x7f21b8146f50 unknown :-1 s=CLOSED pgs=2523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T17:01:54.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.998+0000 7f21bcd19700 1 -- 172.21.15.8:0/1840541004 >> 172.21.15.8:0/1840541004 conn(0x7f21b806abb0 msgr2=0x7f21b8099940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T17:01:54.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.999+0000 7f21bcd19700 1 -- 172.21.15.8:0/1840541004 shutdown_connections 2023-10-14T17:01:54.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-14T17:01:53.999+0000 7f21bcd19700 1 -- 172.21.15.8:0/1840541004 wait complete. 2023-10-14T17:01:54.001 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' removed 2023-10-14T17:01:54.018 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T17:01:54.019 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T17:01:54.019 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T17:01:54.031 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T17:01:54.032 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T17:01:54.032 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T17:01:54.045 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T17:01:54.046 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T17:01:54.046 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T17:01:54.046 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T17:01:54.113 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T17:01:54.114 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T17:01:54.115 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T17:01:54.159 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T17:01:54.159 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T17:01:54.160 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T17:01:54.206 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T17:01:54.207 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-14T17:01:54.207 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T17:01:54.251 INFO:tasks.ceph.osd.3:Stopped 2023-10-14T17:01:54.252 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T17:01:54.252 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T17:01:54.253 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T17:01:54.278 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T17:01:54.279 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-14T17:01:54.279 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T17:01:54.301 INFO:tasks.ceph.mgr.y:Stopped 2023-10-14T17:01:54.302 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T17:01:54.302 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T17:01:54.303 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T17:01:54.330 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T17:01:54.330 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-14T17:01:54.330 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T17:01:54.352 INFO:tasks.ceph.mon.b:Stopped 2023-10-14T17:01:54.352 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-14T17:01:54.353 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T17:01:54.403 INFO:tasks.ceph.mon.c:Stopped 2023-10-14T17:01:54.403 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T17:01:54.404 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-10-14T17:01:54.432 INFO:teuthology.orchestra.run.smithi008.stdout:1697302494.0721993 mon.a (mon.0) 141 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-14T17:01:54.433 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-14T17:01:54.433 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T17:01:54.433 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T17:01:54.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T17:01:54.802 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T17:01:55.098 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi155.front.sepia.ceph.com 2023-10-14T17:01:55.099 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T17:01:55.450 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi155.front.sepia.ceph.com 2023-10-14T17:01:55.450 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-14T17:01:55.519 INFO:tasks.ceph:Archiving mon data... 2023-10-14T17:01:55.520 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/data/mon.a.tgz 2023-10-14T17:01:55.521 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-10-14T17:01:55.539 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.csRHJyVnoY 2023-10-14T17:01:55.540 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.csRHJyVnoY 2023-10-14T17:01:55.693 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.csRHJyVnoY 2023-10-14T17:01:55.778 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.csRHJyVnoY is 317KB 2023-10-14T17:01:55.874 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.csRHJyVnoY 2023-10-14T17:01:55.890 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/data/mon.b.tgz 2023-10-14T17:01:55.890 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2023-10-14T17:01:55.906 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.kuTh3SwuzE 2023-10-14T17:01:55.907 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kuTh3SwuzE 2023-10-14T17:01:56.062 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.kuTh3SwuzE 2023-10-14T17:01:56.144 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.kuTh3SwuzE is 416KB 2023-10-14T17:01:56.239 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.kuTh3SwuzE 2023-10-14T17:01:56.253 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/data/mon.c.tgz 2023-10-14T17:01:56.254 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2023-10-14T17:01:56.307 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.YHtd4DYu8Z 2023-10-14T17:01:56.307 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YHtd4DYu8Z 2023-10-14T17:01:56.449 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.YHtd4DYu8Z 2023-10-14T17:01:56.533 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.YHtd4DYu8Z is 416KB 2023-10-14T17:01:56.616 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.YHtd4DYu8Z 2023-10-14T17:01:56.632 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T17:01:56.633 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T17:01:56.636 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T17:01:56.676 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T17:01:56.704 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T17:01:56.705 DEBUG:teuthology.orchestra.run.smithi008:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T17:01:56.708 DEBUG:teuthology.orchestra.run.smithi155:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T17:01:56.735 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T17:01:56.740 DEBUG:teuthology.orchestra.run.smithi158:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T17:01:56.763 INFO:teuthology.orchestra.run.smithi155.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T17:01:56.772 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T17:01:56.779 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T17:01:56.780 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/remote/smithi008/crash 2023-10-14T17:01:56.781 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T17:01:56.810 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/remote/smithi155/crash 2023-10-14T17:01:56.812 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T17:01:56.837 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/remote/smithi158/crash 2023-10-14T17:01:56.839 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T17:01:56.876 INFO:tasks.ceph:Shutting down logrotate 2023-10-14T17:01:56.877 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:56.880 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:56.883 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:57.006 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:57.033 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:57.057 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:57.083 INFO:tasks.ceph:Compressing logs... 2023-10-14T17:01:57.083 DEBUG:teuthology.orchestra.run.smithi008:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T17:01:57.086 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T17:01:57.100 DEBUG:teuthology.orchestra.run.smithi158:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T17:01:57.109 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93035.log 2023-10-14T17:01:57.128 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86106.log 2023-10-14T17:01:57.129 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T17:01:57.129 INFO:teuthology.orchestra.run.smithi155.stderr:gzip /var/log/ceph/ceph-client.admin.86106.log: -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T17:01:57.129 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85967.log 2023-10-14T17:01:57.130 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86106.log.gz 2023-10-14T17:01:57.130 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86063.log 2023-10-14T17:01:57.130 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.85967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86007.log 2023-10-14T17:01:57.131 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85967.log.gz 2023-10-14T17:01:57.131 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.86063.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-14T17:01:57.131 INFO:teuthology.orchestra.run.smithi155.stderr: 92.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T17:01:57.131 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-14T17:01:57.132 INFO:teuthology.orchestra.run.smithi155.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86063.log.gz 2023-10-14T17:01:57.132 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.86007.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-14T17:01:57.132 INFO:teuthology.orchestra.run.smithi155.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.86007.log.gz 2023-10-14T17:01:57.132 INFO:teuthology.orchestra.run.smithi155.stderr: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T17:01:57.133 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-14T17:01:57.133 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-14T17:01:57.133 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T17:01:57.134 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.2.log: 93.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-14T17:01:57.135 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-14T17:01:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90698.log 2023-10-14T17:01:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92183.log 2023-10-14T17:01:57.149 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92267.log 2023-10-14T17:01:57.150 INFO:teuthology.orchestra.run.smithi008.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93035.log.gz 2023-10-14T17:01:57.150 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92183.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90698.log.gz 2023-10-14T17:01:57.150 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91355.log 2023-10-14T17:01:57.151 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89419.log 2023-10-14T17:01:57.151 INFO:teuthology.orchestra.run.smithi008.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92183.log.gz 2023-10-14T17:01:57.151 INFO:teuthology.orchestra.run.smithi008.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92267.log.gz 2023-10-14T17:01:57.151 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90093.log 2023-10-14T17:01:57.152 INFO:teuthology.orchestra.run.smithi008.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91355.log.gz 2023-10-14T17:01:57.152 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91481.log 2023-10-14T17:01:57.152 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90093.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89419.log.gz 2023-10-14T17:01:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91691.log 2023-10-14T17:01:57.153 INFO:teuthology.orchestra.run.smithi008.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90093.log.gz 2023-10-14T17:01:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91757.log 2023-10-14T17:01:57.153 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91691.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91481.log.gz 2023-10-14T17:01:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-14T17:01:57.154 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90528.log 2023-10-14T17:01:57.154 INFO:teuthology.orchestra.run.smithi008.stderr: 90.9% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91691.log.gz -- replaced with /var/log/ceph/ceph-client.admin.91757.log.gz 2023-10-14T17:01:57.155 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-14T17:01:57.155 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90696.log 2023-10-14T17:01:57.155 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90866.log 2023-10-14T17:01:57.155 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90696.log: gzip -5 87.5%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.90528.log.gz/var/log/ceph/ceph-client.admin.89744.log 2023-10-14T17:01:57.156 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-14T17:01:57.156 INFO:teuthology.orchestra.run.smithi008.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90696.log.gz 2023-10-14T17:01:57.156 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91649.log 2023-10-14T17:01:57.157 INFO:teuthology.orchestra.run.smithi008.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90866.log.gz 2023-10-14T17:01:57.157 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93137.log 2023-10-14T17:01:57.157 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91187.log 2023-10-14T17:01:57.157 INFO:teuthology.orchestra.run.smithi008.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.89744.log.gz 2023-10-14T17:01:57.158 INFO:teuthology.orchestra.run.smithi008.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91649.log.gz 2023-10-14T17:01:57.158 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89617.log 2023-10-14T17:01:57.158 INFO:teuthology.orchestra.run.smithi008.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93137.log.gz 2023-10-14T17:01:57.159 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89480.log 2023-10-14T17:01:57.159 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92477.log 2023-10-14T17:01:57.159 INFO:teuthology.orchestra.run.smithi008.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91187.log.gz 2023-10-14T17:01:57.159 INFO:teuthology.orchestra.run.smithi008.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89617.log.gz 2023-10-14T17:01:57.160 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92802.log 2023-10-14T17:01:57.160 INFO:teuthology.orchestra.run.smithi008.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89480.log.gz 2023-10-14T17:01:57.160 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91313.log 2023-10-14T17:01:57.161 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90179.log 2023-10-14T17:01:57.161 INFO:teuthology.orchestra.run.smithi008.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92477.log.gz 2023-10-14T17:01:57.161 INFO:teuthology.orchestra.run.smithi008.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92802.log.gz 2023-10-14T17:01:57.161 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90527.log 2023-10-14T17:01:57.162 INFO:teuthology.orchestra.run.smithi008.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91313.log.gz 2023-10-14T17:01:57.162 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90695.log 2023-10-14T17:01:57.162 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90527.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90179.log.gz 2023-10-14T17:01:57.163 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T17:01:57.163 INFO:teuthology.orchestra.run.smithi008.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90527.log.gz 2023-10-14T17:01:57.163 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91145.log 2023-10-14T17:01:57.163 INFO:teuthology.orchestra.run.smithi008.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90695.log.gz 2023-10-14T17:01:57.164 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92435.log 2023-10-14T17:01:57.164 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92621.log 2023-10-14T17:01:57.164 INFO:teuthology.orchestra.run.smithi008.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91145.log.gz 2023-10-14T17:01:57.165 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92057.log 2023-10-14T17:01:57.165 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89914.log 2023-10-14T17:01:57.165 INFO:teuthology.orchestra.run.smithi008.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92435.log.gz 2023-10-14T17:01:57.165 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92621.log: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T17:01:57.166 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92057.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92621.log.gz 2023-10-14T17:01:57.166 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90865.log 2023-10-14T17:01:57.166 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89958.log 2023-10-14T17:01:57.166 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89914.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92057.log.gz 2023-10-14T17:01:57.167 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92743.log 2023-10-14T17:01:57.167 INFO:teuthology.orchestra.run.smithi008.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89914.log.gz 2023-10-14T17:01:57.167 INFO:teuthology.orchestra.run.smithi008.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90865.log.gz 2023-10-14T17:01:57.168 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86223.log 2023-10-14T17:01:57.168 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92743.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89958.log.gz 2023-10-14T17:01:57.168 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92680.log 2023-10-14T17:01:57.168 INFO:teuthology.orchestra.run.smithi008.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92743.log.gz 2023-10-14T17:01:57.169 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.86223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90431.log 2023-10-14T17:01:57.169 INFO:teuthology.orchestra.run.smithi008.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86223.log.gz 2023-10-14T17:01:57.169 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91103.log 2023-10-14T17:01:57.170 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90431.log: gzip 88.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.92680.log.gz--verbose 2023-10-14T17:01:57.170 INFO:teuthology.orchestra.run.smithi008.stderr:-- /var/log/ceph/ceph-client.admin.91439.log 2023-10-14T17:01:57.170 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91103.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90431.log.gz 2023-10-14T17:01:57.170 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92519.log 2023-10-14T17:01:57.171 INFO:teuthology.orchestra.run.smithi008.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91103.log.gz 2023-10-14T17:01:57.171 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91439.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T17:01:57.171 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90389.log 2023-10-14T17:01:57.172 INFO:teuthology.orchestra.run.smithi008.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91439.log.gz 2023-10-14T17:01:57.172 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph.audit.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92519.log.gz 2023-10-14T17:01:57.172 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85967.log 2023-10-14T17:01:57.172 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90009.log 2023-10-14T17:01:57.173 INFO:teuthology.orchestra.run.smithi008.stderr: 87.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T17:01:57.173 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.85967.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.90389.log.gz 2023-10-14T17:01:57.173 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93180.log 2023-10-14T17:01:57.174 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90529.log 2023-10-14T17:01:57.174 INFO:teuthology.orchestra.run.smithi008.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.85967.log.gz 2023-10-14T17:01:57.174 INFO:teuthology.orchestra.run.smithi008.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90009.log.gz 2023-10-14T17:01:57.174 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91565.log 2023-10-14T17:01:57.175 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90529.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93180.log.gz 2023-10-14T17:01:57.175 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91019.log 2023-10-14T17:01:57.175 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91565.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90529.log.gz 2023-10-14T17:01:57.176 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T17:01:57.176 INFO:teuthology.orchestra.run.smithi008.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91565.log.gz 2023-10-14T17:01:57.176 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91019.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82849.log 2023-10-14T17:01:57.176 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91523.log 2023-10-14T17:01:57.177 INFO:teuthology.orchestra.run.smithi008.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91019.log.gz 2023-10-14T17:01:57.177 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph.tmp-client.admin.82849.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82849.log.gz 2023-10-14T17:01:57.177 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91271.log 2023-10-14T17:01:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89567.log 2023-10-14T17:01:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91271.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91523.log.gz 2023-10-14T17:01:57.178 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90221.log 2023-10-14T17:01:57.178 INFO:teuthology.orchestra.run.smithi008.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91271.log.gz 2023-10-14T17:01:57.179 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90137.log 2023-10-14T17:01:57.179 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89567.log: /var/log/ceph/ceph-client.admin.90221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92225.log 2023-10-14T17:01:57.179 INFO:teuthology.orchestra.run.smithi008.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89567.log.gz 2023-10-14T17:01:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90137.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90221.log.gz 2023-10-14T17:01:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92561.log 2023-10-14T17:01:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89659.log 2023-10-14T17:01:57.180 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92225.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.90137.log.gz 2023-10-14T17:01:57.181 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92393.log 2023-10-14T17:01:57.181 INFO:teuthology.orchestra.run.smithi008.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92225.log.gz 2023-10-14T17:01:57.181 INFO:teuthology.orchestra.run.smithi008.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92561.log.gz 2023-10-14T17:01:57.181 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89870.log 2023-10-14T17:01:57.182 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90809.log 2023-10-14T17:01:57.182 INFO:teuthology.orchestra.run.smithi008.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89659.log.gz 2023-10-14T17:01:57.182 INFO:teuthology.orchestra.run.smithi008.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92393.log.gz 2023-10-14T17:01:57.183 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90305.log 2023-10-14T17:01:57.183 INFO:teuthology.orchestra.run.smithi008.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.89870.log.gz 2023-10-14T17:01:57.183 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92099.log 2023-10-14T17:01:57.183 INFO:teuthology.orchestra.run.smithi008.stderr: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.90809.log.gz--verbose 2023-10-14T17:01:57.184 INFO:teuthology.orchestra.run.smithi008.stderr:-- /var/log/ceph/ceph-client.admin.89828.log 2023-10-14T17:01:57.184 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90305.log: /var/log/ceph/ceph-client.admin.92099.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90305.log.gz 2023-10-14T17:01:57.184 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90864.log 2023-10-14T17:01:57.185 INFO:teuthology.orchestra.run.smithi008.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92099.log.gz 2023-10-14T17:01:57.185 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92909.log 2023-10-14T17:01:57.185 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89828.log: /var/log/ceph/ceph-client.admin.90864.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T17:01:57.185 INFO:teuthology.orchestra.run.smithi008.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89828.log.gz 2023-10-14T17:01:57.186 INFO:teuthology.orchestra.run.smithi008.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90864.log.gz 2023-10-14T17:01:57.186 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92010.log 2023-10-14T17:01:57.186 INFO:teuthology.orchestra.run.smithi008.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92909.log.gz 2023-10-14T17:01:57.186 INFO:teuthology.orchestra.run.smithi008.stderr:gzip /var/log/ceph/ceph-osd.1.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.89367.log 2023-10-14T17:01:57.187 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90263.log 2023-10-14T17:01:57.187 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89367.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92010.log.gz 2023-10-14T17:01:57.187 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90697.log 2023-10-14T17:01:57.188 INFO:teuthology.orchestra.run.smithi008.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89367.log.gz 2023-10-14T17:01:57.188 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90263.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T17:01:57.188 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- 88.3%/var/log/ceph/ceph-client.admin.92951.log 2023-10-14T17:01:57.188 INFO:teuthology.orchestra.run.smithi008.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90263.log.gz 2023-10-14T17:01:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90697.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90697.log.gz 2023-10-14T17:01:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91061.log 2023-10-14T17:01:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91397.log 2023-10-14T17:01:57.189 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92951.log: /var/log/ceph/ceph-client.admin.91061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92869.log 2023-10-14T17:01:57.190 INFO:teuthology.orchestra.run.smithi008.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92951.log.gz 2023-10-14T17:01:57.190 INFO:teuthology.orchestra.run.smithi008.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91061.log.gz 2023-10-14T17:01:57.190 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93222.log 2023-10-14T17:01:57.191 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92869.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91397.log.gz 2023-10-14T17:01:57.191 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91229.log 2023-10-14T17:01:57.191 INFO:teuthology.orchestra.run.smithi008.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92869.log.gz 2023-10-14T17:01:57.191 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93222.log: /var/log/ceph/ceph-client.admin.91229.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93222.log.gz 2023-10-14T17:01:57.192 INFO:teuthology.orchestra.run.smithi008.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91229.log.gz 2023-10-14T17:01:57.192 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90530.log 2023-10-14T17:01:57.192 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93077.log 2023-10-14T17:01:57.192 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90977.log 2023-10-14T17:01:57.193 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.93077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90347.log 2023-10-14T17:01:57.193 INFO:teuthology.orchestra.run.smithi008.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90530.log.gz 2023-10-14T17:01:57.193 INFO:teuthology.orchestra.run.smithi008.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93077.log.gz 2023-10-14T17:01:57.193 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90977.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T17:01:57.194 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92351.log 2023-10-14T17:01:57.194 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.90347.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90977.log.gz 2023-10-14T17:01:57.194 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-osd.0.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.90347.log.gz-5 2023-10-14T17:01:57.195 INFO:teuthology.orchestra.run.smithi008.stderr:--verbose -- /var/log/ceph/ceph-client.admin.90051.log 2023-10-14T17:01:57.195 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92351.log: /var/log/ceph/ceph-client.admin.90051.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92351.log.gz 2023-10-14T17:01:57.195 INFO:teuthology.orchestra.run.smithi008.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90051.log.gz 2023-10-14T17:01:57.195 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89702.log 2023-10-14T17:01:57.196 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89786.log 2023-10-14T17:01:57.196 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89702.log: /var/log/ceph/ceph-client.admin.89786.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89702.log.gz 2023-10-14T17:01:57.196 INFO:teuthology.orchestra.run.smithi008.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89786.log.gz 2023-10-14T17:01:57.197 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86150.log 2023-10-14T17:01:57.197 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92309.log 2023-10-14T17:01:57.197 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.86150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89312.log 2023-10-14T17:01:57.197 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92309.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.86150.log.gz 2023-10-14T17:01:57.198 INFO:teuthology.orchestra.run.smithi008.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92309.log.gz 2023-10-14T17:01:57.198 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.89312.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89312.log.gz 2023-10-14T17:01:57.198 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91607.log 2023-10-14T17:01:57.198 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92993.log 2023-10-14T17:01:57.199 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.91607.log: /var/log/ceph/ceph-client.admin.92993.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91607.log.gz 2023-10-14T17:01:57.199 INFO:teuthology.orchestra.run.smithi008.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92993.log.gz 2023-10-14T17:01:57.199 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92141.log 2023-10-14T17:01:57.200 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/ceph-client.admin.92141.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92141.log.gz 2023-10-14T17:01:57.200 INFO:teuthology.orchestra.run.smithi008.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T17:01:57.203 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103895.log 2023-10-14T17:01:57.203 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_path_test.279286240.103895.log 2023-10-14T17:01:57.203 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_foo_test.1375169618.103895.log 2023-10-14T17:01:57.204 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.103895.log: /var/log/ceph/ceph-client.libcephfs_path_test.279286240.103895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83648.log 2023-10-14T17:01:57.204 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.libcephfs_foo_test.1375169618.103895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_readonly_test.841930888.103895.log 2023-10-14T17:01:57.204 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83323.log 2023-10-14T17:01:57.205 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.admin.83648.log: /var/log/ceph/ceph-client.libcephfs_readonly_test.841930888.103895.log: 87.7% -- replaced with /var/log/ceph/ceph-client.libcephfs_foo_test.1375169618.103895.log.gz 2023-10-14T17:01:57.205 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_user_test.252847435.103895.log 2023-10-14T17:01:57.205 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.0.83323.log: /var/log/ceph/ceph-client.libcephfs_user_test.252847435.103895.log: 92.1% -- replaced with /var/log/ceph/ceph-client.libcephfs_readonly_test.841930888.103895.log.gz 2023-10-14T17:01:57.205 INFO:teuthology.orchestra.run.smithi158.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.libcephfs_user_test.252847435.103895.log.gz 2023-10-14T17:01:57.206 INFO:teuthology.orchestra.run.smithi158.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.libcephfs_path_test.279286240.103895.log.gz 2023-10-14T17:01:57.206 INFO:teuthology.orchestra.run.smithi158.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.0.83323.log.gz 2023-10-14T17:01:57.394 INFO:teuthology.orchestra.run.smithi155.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-14T17:01:57.473 INFO:teuthology.orchestra.run.smithi155.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-14T17:01:57.585 INFO:teuthology.orchestra.run.smithi008.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T17:02:00.059 INFO:teuthology.orchestra.run.smithi158.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.103895.log.gz 2023-10-14T17:02:02.111 INFO:teuthology.orchestra.run.smithi158.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.83648.log.gz 2023-10-14T17:02:02.113 INFO:teuthology.orchestra.run.smithi158.stderr: 2023-10-14T17:02:02.113 INFO:teuthology.orchestra.run.smithi158.stderr:real 0m4.964s 2023-10-14T17:02:02.114 INFO:teuthology.orchestra.run.smithi158.stderr:user 0m7.591s 2023-10-14T17:02:02.114 INFO:teuthology.orchestra.run.smithi158.stderr:sys 0m0.289s 2023-10-14T17:02:05.350 INFO:teuthology.orchestra.run.smithi008.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T17:02:05.957 INFO:teuthology.orchestra.run.smithi008.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T17:02:06.948 INFO:teuthology.orchestra.run.smithi155.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-14T17:02:06.965 INFO:teuthology.orchestra.run.smithi155.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T17:02:06.966 INFO:teuthology.orchestra.run.smithi155.stderr: 2023-10-14T17:02:06.967 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m9.855s 2023-10-14T17:02:06.967 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m19.573s 2023-10-14T17:02:06.967 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m0.715s 2023-10-14T17:02:30.575 INFO:teuthology.orchestra.run.smithi008.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-14T17:02:30.577 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-14T17:02:30.577 INFO:teuthology.orchestra.run.smithi008.stderr:real 0m33.478s 2023-10-14T17:02:30.577 INFO:teuthology.orchestra.run.smithi008.stderr:user 0m49.199s 2023-10-14T17:02:30.578 INFO:teuthology.orchestra.run.smithi008.stderr:sys 0m1.584s 2023-10-14T17:02:30.578 INFO:tasks.ceph:Archiving logs... 2023-10-14T17:02:30.579 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/remote/smithi008/log 2023-10-14T17:02:30.580 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T17:02:37.928 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/remote/smithi155/log 2023-10-14T17:02:37.929 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T17:02:41.277 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/remote/smithi158/log 2023-10-14T17:02:41.279 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T17:02:42.416 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T17:02:42.426 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T17:02:42.427 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T17:02:42.430 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T17:02:42.433 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T17:02:42.493 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2023-10-14T17:02:42.493 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-14T17:02:42.494 DEBUG:teuthology.orchestra.run.smithi008:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do 2023-10-14T17:02:42.494 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y remove $d || true 2023-10-14T17:02:42.494 DEBUG:teuthology.orchestra.run.smithi008:> done 2023-10-14T17:02:42.517 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2023-10-14T17:02:42.517 DEBUG:teuthology.orchestra.run.smithi155:> 2023-10-14T17:02:42.517 DEBUG:teuthology.orchestra.run.smithi155:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do 2023-10-14T17:02:42.518 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y remove $d || true 2023-10-14T17:02:42.518 DEBUG:teuthology.orchestra.run.smithi155:> done 2023-10-14T17:02:42.539 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2023-10-14T17:02:42.540 DEBUG:teuthology.orchestra.run.smithi158:> 2023-10-14T17:02:42.540 DEBUG:teuthology.orchestra.run.smithi158:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do 2023-10-14T17:02:42.540 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y remove $d || true 2023-10-14T17:02:42.541 DEBUG:teuthology.orchestra.run.smithi158:> done 2023-10-14T17:02:42.903 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:02:42.908 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:02:42.929 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:02:44.497 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:02:44.498 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T17:02:44.499 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repo Size 2023-10-14T17:02:44.499 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T17:02:44.499 INFO:teuthology.orchestra.run.smithi158.stdout:Removing: 2023-10-14T17:02:44.499 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 65 M 2023-10-14T17:02:44.500 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:02:44.500 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T17:02:44.500 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T17:02:44.501 INFO:teuthology.orchestra.run.smithi158.stdout:Remove 1 Package 2023-10-14T17:02:44.501 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:02:44.501 INFO:teuthology.orchestra.run.smithi158.stdout:Freed space: 65 M 2023-10-14T17:02:44.502 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T17:02:44.502 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T17:02:44.503 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T17:02:44.531 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T17:02:44.532 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T17:02:44.589 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T17:02:44.658 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:02:44.659 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:02:44.661 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:02:44.662 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T17:02:44.662 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2023-10-14T17:02:44.662 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T17:02:44.663 INFO:teuthology.orchestra.run.smithi155.stdout:Removing: 2023-10-14T17:02:44.663 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 65 M 2023-10-14T17:02:44.663 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:02:44.664 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T17:02:44.664 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T17:02:44.664 INFO:teuthology.orchestra.run.smithi155.stdout:Remove 1 Package 2023-10-14T17:02:44.664 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:02:44.665 INFO:teuthology.orchestra.run.smithi155.stdout:Freed space: 65 M 2023-10-14T17:02:44.665 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T17:02:44.666 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T17:02:44.666 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T17:02:44.695 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T17:02:44.696 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T17:02:44.719 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:02:44.720 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T17:02:44.720 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repo Size 2023-10-14T17:02:44.721 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T17:02:44.721 INFO:teuthology.orchestra.run.smithi008.stdout:Removing: 2023-10-14T17:02:44.721 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 65 M 2023-10-14T17:02:44.722 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:02:44.722 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T17:02:44.722 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T17:02:44.722 INFO:teuthology.orchestra.run.smithi008.stdout:Remove 1 Package 2023-10-14T17:02:44.723 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:02:44.723 INFO:teuthology.orchestra.run.smithi008.stdout:Freed space: 65 M 2023-10-14T17:02:44.724 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T17:02:44.724 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T17:02:44.724 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T17:02:44.754 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T17:02:44.756 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T17:02:44.757 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T17:02:44.805 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:02:44.806 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:02:44.824 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T17:02:44.874 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:02:44.875 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:02:45.310 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:02:45.395 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:02:45.533 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:02:46.310 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:02:46.311 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:14:18 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T17:02:46.487 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:02:46.488 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:14:03 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T17:02:46.705 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:02:46.705 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:14:16 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T17:02:51.951 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T17:02:51.956 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:02:51.957 INFO:teuthology.orchestra.run.smithi158.stdout:Removed: 2023-10-14T17:02:51.957 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:02:51.957 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:02:51.957 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:02:52.216 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T17:02:52.222 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:02:52.223 INFO:teuthology.orchestra.run.smithi155.stdout:Removed: 2023-10-14T17:02:52.223 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:02:52.223 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:02:52.224 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:02:52.370 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T17:02:52.376 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:02:52.376 INFO:teuthology.orchestra.run.smithi008.stdout:Removed: 2023-10-14T17:02:52.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:02:52.377 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:02:52.377 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:02:52.515 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:02:52.786 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:02:52.931 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:02:54.106 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:02:54.108 INFO:teuthology.orchestra.run.smithi158.stdout:========================================================================================== 2023-10-14T17:02:54.108 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T17:02:54.109 INFO:teuthology.orchestra.run.smithi158.stdout:========================================================================================== 2023-10-14T17:02:54.109 INFO:teuthology.orchestra.run.smithi158.stdout:Removing: 2023-10-14T17:02:54.110 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 230 M 2023-10-14T17:02:54.110 INFO:teuthology.orchestra.run.smithi158.stdout:Removing unused dependencies: 2023-10-14T17:02:54.110 INFO:teuthology.orchestra.run.smithi158.stdout: jq x86_64 1.5-12.el8 @rhel-8-for-x86_64-appstream-rpms 357 k 2023-10-14T17:02:54.111 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma x86_64 6.8.2-2.el8 @rhel-8-for-x86_64-appstream-rpms 676 k 2023-10-14T17:02:54.111 INFO:teuthology.orchestra.run.smithi158.stdout: socat x86_64 1.7.3.3-2.el8 @rhel-8-for-x86_64-appstream-rpms 1.1 M 2023-10-14T17:02:54.112 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet x86_64 1.6.1-20.el8 @lab-extras 200 k 2023-10-14T17:02:54.112 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:02:54.113 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T17:02:54.113 INFO:teuthology.orchestra.run.smithi158.stdout:========================================================================================== 2023-10-14T17:02:54.113 INFO:teuthology.orchestra.run.smithi158.stdout:Remove 5 Packages 2023-10-14T17:02:54.114 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:02:54.114 INFO:teuthology.orchestra.run.smithi158.stdout:Freed space: 232 M 2023-10-14T17:02:54.115 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T17:02:54.116 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T17:02:54.116 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T17:02:54.175 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T17:02:54.175 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T17:02:54.230 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:02:54.232 INFO:teuthology.orchestra.run.smithi155.stdout:========================================================================================== 2023-10-14T17:02:54.232 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T17:02:54.232 INFO:teuthology.orchestra.run.smithi155.stdout:========================================================================================== 2023-10-14T17:02:54.233 INFO:teuthology.orchestra.run.smithi155.stdout:Removing: 2023-10-14T17:02:54.233 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 230 M 2023-10-14T17:02:54.233 INFO:teuthology.orchestra.run.smithi155.stdout:Removing unused dependencies: 2023-10-14T17:02:54.234 INFO:teuthology.orchestra.run.smithi155.stdout: jq x86_64 1.5-12.el8 @rhel-8-for-x86_64-appstream-rpms 357 k 2023-10-14T17:02:54.234 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma x86_64 6.8.2-2.el8 @rhel-8-for-x86_64-appstream-rpms 676 k 2023-10-14T17:02:54.234 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.3.3-2.el8 @rhel-8-for-x86_64-appstream-rpms 1.1 M 2023-10-14T17:02:54.235 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el8 @lab-extras 200 k 2023-10-14T17:02:54.235 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:02:54.235 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T17:02:54.236 INFO:teuthology.orchestra.run.smithi155.stdout:========================================================================================== 2023-10-14T17:02:54.236 INFO:teuthology.orchestra.run.smithi155.stdout:Remove 5 Packages 2023-10-14T17:02:54.236 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:02:54.236 INFO:teuthology.orchestra.run.smithi155.stdout:Freed space: 232 M 2023-10-14T17:02:54.237 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T17:02:54.238 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T17:02:54.238 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T17:02:54.300 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T17:02:54.300 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T17:02:54.336 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T17:02:54.405 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:02:54.406 INFO:teuthology.orchestra.run.smithi008.stdout:========================================================================================== 2023-10-14T17:02:54.407 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T17:02:54.407 INFO:teuthology.orchestra.run.smithi008.stdout:========================================================================================== 2023-10-14T17:02:54.407 INFO:teuthology.orchestra.run.smithi008.stdout:Removing: 2023-10-14T17:02:54.407 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 230 M 2023-10-14T17:02:54.408 INFO:teuthology.orchestra.run.smithi008.stdout:Removing unused dependencies: 2023-10-14T17:02:54.408 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.5-12.el8 @rhel-8-for-x86_64-appstream-rpms 357 k 2023-10-14T17:02:54.408 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.8.2-2.el8 @rhel-8-for-x86_64-appstream-rpms 676 k 2023-10-14T17:02:54.409 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.3.3-2.el8 @rhel-8-for-x86_64-appstream-rpms 1.1 M 2023-10-14T17:02:54.409 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el8 @lab-extras 200 k 2023-10-14T17:02:54.409 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:02:54.409 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T17:02:54.410 INFO:teuthology.orchestra.run.smithi008.stdout:========================================================================================== 2023-10-14T17:02:54.410 INFO:teuthology.orchestra.run.smithi008.stdout:Remove 5 Packages 2023-10-14T17:02:54.410 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:02:54.410 INFO:teuthology.orchestra.run.smithi008.stdout:Freed space: 232 M 2023-10-14T17:02:54.411 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T17:02:54.413 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T17:02:54.413 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T17:02:54.461 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T17:02:54.478 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T17:02:54.479 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T17:02:54.618 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/5 2023-10-14T17:02:54.710 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/5 2023-10-14T17:02:54.810 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 2023-10-14T17:02:54.810 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-14T17:02:54.811 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T17:02:54.861 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 2023-10-14T17:02:54.862 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-14T17:02:55.011 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-14T17:02:55.072 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/5 2023-10-14T17:02:55.078 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-14T17:02:55.226 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : socat-1.7.3.3-2.el8.x86_64 4/5 2023-10-14T17:02:55.277 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : socat-1.7.3.3-2.el8.x86_64 4/5 2023-10-14T17:02:55.355 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 2023-10-14T17:02:55.356 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-14T17:02:55.360 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2023-10-14T17:02:55.447 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2023-10-14T17:02:55.615 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-14T17:02:55.653 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: xmlstarlet-1.6.1-20.el8.x86_64 5/5 2023-10-14T17:02:55.654 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/5 2023-10-14T17:02:55.655 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : jq-1.5-12.el8.x86_64 2/5 2023-10-14T17:02:55.655 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-14T17:02:55.655 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 4/5 2023-10-14T17:02:55.705 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: xmlstarlet-1.6.1-20.el8.x86_64 5/5 2023-10-14T17:02:55.705 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/5 2023-10-14T17:02:55.706 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : jq-1.5-12.el8.x86_64 2/5 2023-10-14T17:02:55.706 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-14T17:02:55.707 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 4/5 2023-10-14T17:02:55.755 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : socat-1.7.3.3-2.el8.x86_64 4/5 2023-10-14T17:02:55.928 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2023-10-14T17:02:56.215 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: xmlstarlet-1.6.1-20.el8.x86_64 5/5 2023-10-14T17:02:56.215 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/5 2023-10-14T17:02:56.216 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.5-12.el8.x86_64 2/5 2023-10-14T17:02:56.216 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-14T17:02:56.216 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 4/5 2023-10-14T17:02:56.766 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2023-10-14T17:02:56.767 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:14:28 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T17:02:56.952 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2023-10-14T17:02:56.952 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:14:13 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T17:02:57.362 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2023-10-14T17:02:57.363 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:14:27 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T17:03:02.331 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T17:03:02.337 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:02.338 INFO:teuthology.orchestra.run.smithi008.stdout:Removed: 2023-10-14T17:03:02.338 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 jq-1.5-12.el8.x86_64 2023-10-14T17:03:02.339 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2023-10-14T17:03:02.339 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T17:03:02.339 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:02.339 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:03:02.521 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T17:03:02.525 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:02.525 INFO:teuthology.orchestra.run.smithi158.stdout:Removed: 2023-10-14T17:03:02.526 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 jq-1.5-12.el8.x86_64 2023-10-14T17:03:02.526 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2023-10-14T17:03:02.526 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T17:03:02.527 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:02.527 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:03:02.844 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:03:03.042 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:03:03.569 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T17:03:03.575 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:03.576 INFO:teuthology.orchestra.run.smithi155.stdout:Removed: 2023-10-14T17:03:03.576 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 jq-1.5-12.el8.x86_64 2023-10-14T17:03:03.577 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2023-10-14T17:03:03.577 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T17:03:03.578 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:03.578 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:03:04.084 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:03:04.168 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:03:04.169 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T17:03:04.170 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T17:03:04.170 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T17:03:04.170 INFO:teuthology.orchestra.run.smithi008.stdout:Removing: 2023-10-14T17:03:04.171 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 0 2023-10-14T17:03:04.171 INFO:teuthology.orchestra.run.smithi008.stdout:Removing unused dependencies: 2023-10-14T17:03:04.171 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 7.9 M 2023-10-14T17:03:04.172 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 17 M 2023-10-14T17:03:04.172 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:04.172 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T17:03:04.172 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T17:03:04.173 INFO:teuthology.orchestra.run.smithi008.stdout:Remove 3 Packages 2023-10-14T17:03:04.173 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:04.173 INFO:teuthology.orchestra.run.smithi008.stdout:Freed space: 25 M 2023-10-14T17:03:04.174 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T17:03:04.174 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T17:03:04.175 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T17:03:04.206 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T17:03:04.207 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T17:03:04.289 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T17:03:04.296 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:03:04.399 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/3 2023-10-14T17:03:04.422 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:03:04.423 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:03:04.558 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:03:04.559 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T17:03:04.560 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T17:03:04.560 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T17:03:04.560 INFO:teuthology.orchestra.run.smithi158.stdout:Removing: 2023-10-14T17:03:04.560 INFO:teuthology.orchestra.run.smithi158.stdout: ceph x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 0 2023-10-14T17:03:04.561 INFO:teuthology.orchestra.run.smithi158.stdout:Removing unused dependencies: 2023-10-14T17:03:04.561 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 7.9 M 2023-10-14T17:03:04.561 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 17 M 2023-10-14T17:03:04.562 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:04.562 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T17:03:04.562 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T17:03:04.562 INFO:teuthology.orchestra.run.smithi158.stdout:Remove 3 Packages 2023-10-14T17:03:04.563 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:04.563 INFO:teuthology.orchestra.run.smithi158.stdout:Freed space: 25 M 2023-10-14T17:03:04.564 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T17:03:04.564 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T17:03:04.564 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T17:03:04.592 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T17:03:04.593 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T17:03:04.670 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T17:03:04.677 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:03:04.775 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/3 2023-10-14T17:03:04.795 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:03:04.796 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:03:04.820 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:03:04.846 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:03:04.846 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:03:05.142 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:03:05.164 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:03:05.165 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:03:05.323 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:03:05.324 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T17:03:05.325 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T17:03:05.325 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T17:03:05.325 INFO:teuthology.orchestra.run.smithi155.stdout:Removing: 2023-10-14T17:03:05.326 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 0 2023-10-14T17:03:05.326 INFO:teuthology.orchestra.run.smithi155.stdout:Removing unused dependencies: 2023-10-14T17:03:05.326 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 7.9 M 2023-10-14T17:03:05.326 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 17 M 2023-10-14T17:03:05.327 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:05.327 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T17:03:05.327 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T17:03:05.328 INFO:teuthology.orchestra.run.smithi155.stdout:Remove 3 Packages 2023-10-14T17:03:05.328 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:05.328 INFO:teuthology.orchestra.run.smithi155.stdout:Freed space: 25 M 2023-10-14T17:03:05.329 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T17:03:05.329 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T17:03:05.329 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T17:03:05.359 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T17:03:05.359 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T17:03:05.444 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T17:03:05.452 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:03:05.512 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:03:05.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/3 2023-10-14T17:03:05.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:03:05.533 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/3 2023-10-14T17:03:05.554 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:03:05.555 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:03:05.620 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:03:05.621 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/3 2023-10-14T17:03:05.621 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:03:05.842 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:03:05.865 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:03:05.866 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:03:06.272 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:03:06.273 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/3 2023-10-14T17:03:06.273 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:03:06.687 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:03:06.687 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:14:38 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T17:03:06.764 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:03:06.764 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:14:36 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T17:03:07.448 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:03:07.449 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:14:24 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T17:03:12.132 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T17:03:12.138 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:12.138 INFO:teuthology.orchestra.run.smithi158.stdout:Removed: 2023-10-14T17:03:12.138 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:12.139 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:12.139 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:12.139 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:12.140 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:03:12.659 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:03:13.327 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T17:03:13.333 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:13.334 INFO:teuthology.orchestra.run.smithi008.stdout:Removed: 2023-10-14T17:03:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:13.334 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:13.335 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:13.335 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:03:13.439 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T17:03:13.445 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:13.445 INFO:teuthology.orchestra.run.smithi155.stdout:Removed: 2023-10-14T17:03:13.446 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:13.446 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:13.446 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:13.447 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:13.447 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:03:13.862 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:03:13.946 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:03:14.269 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:03:14.282 INFO:teuthology.orchestra.run.smithi158.stdout:======================================================================================================================= 2023-10-14T17:03:14.283 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T17:03:14.283 INFO:teuthology.orchestra.run.smithi158.stdout:======================================================================================================================= 2023-10-14T17:03:14.283 INFO:teuthology.orchestra.run.smithi158.stdout:Removing: 2023-10-14T17:03:14.284 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 26 M 2023-10-14T17:03:14.284 INFO:teuthology.orchestra.run.smithi158.stdout:Removing dependent packages: 2023-10-14T17:03:14.284 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 490 k 2023-10-14T17:03:14.285 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 619 k 2023-10-14T17:03:14.285 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 7.1 M 2023-10-14T17:03:14.285 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 66 M 2023-10-14T17:03:14.286 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 566 k 2023-10-14T17:03:14.286 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 63 M 2023-10-14T17:03:14.286 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-volume noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 1.3 M 2023-10-14T17:03:14.287 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 16 M 2023-10-14T17:03:14.287 INFO:teuthology.orchestra.run.smithi158.stdout:Removing unused dependencies: 2023-10-14T17:03:14.287 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 100 M 2023-10-14T17:03:14.287 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 319 k 2023-10-14T17:03:14.288 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 5.4 M 2023-10-14T17:03:14.288 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 1.4 M 2023-10-14T17:03:14.288 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 39 k 2023-10-14T17:03:14.289 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 135 k 2023-10-14T17:03:14.289 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs x86_64 1:2.7-9.el8 @epel 1.5 M 2023-10-14T17:03:14.289 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 521 k 2023-10-14T17:03:14.290 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran x86_64 8.4.1-1.el8 @rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-10-14T17:03:14.290 INFO:teuthology.orchestra.run.smithi158.stdout: liboath x86_64 2.6.2-3.el8 @epel 125 k 2023-10-14T17:03:14.290 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath x86_64 8.4.1-1.el8 @rhel-8-for-x86_64-baseos-rpms 298 k 2023-10-14T17:03:14.290 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq x86_64 0.9.0-3.el8 @rhel-8-for-x86_64-baseos-rpms 91 k 2023-10-14T17:03:14.291 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 1.8 M 2023-10-14T17:03:14.291 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka x86_64 0.11.4-1.el8 @rhel-8-for-x86_64-appstream-rpms 1.1 M 2023-10-14T17:03:14.291 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 22 M 2023-10-14T17:03:14.292 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind x86_64 1.3.1-3.el8 @epel 205 k 2023-10-14T17:03:14.292 INFO:teuthology.orchestra.run.smithi158.stdout: openblas x86_64 0.3.12-1.el8 @rhel-8-for-x86_64-appstream-rpms 28 M 2023-10-14T17:03:14.292 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads x86_64 0.3.12-1.el8 @rhel-8-for-x86_64-appstream-rpms 29 M 2023-10-14T17:03:14.292 INFO:teuthology.orchestra.run.smithi158.stdout: python3-asyncssh noarch 2.7.0-2.el8 @epel 2.4 M 2023-10-14T17:03:14.293 INFO:teuthology.orchestra.run.smithi158.stdout: python3-babel noarch 2.5.1-5.el8 @rhel-8-for-x86_64-appstream-rpms 20 M 2023-10-14T17:03:14.293 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 @epel 78 k 2023-10-14T17:03:14.293 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools noarch 3.1.1-4.el8 @epel 71 k 2023-10-14T17:03:14.294 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 187 k 2023-10-14T17:03:14.294 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 552 k 2023-10-14T17:03:14.294 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 608 k 2023-10-14T17:03:14.295 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi noarch 2018.10.15-7.el8 @epel 8.2 k 2023-10-14T17:03:14.295 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot noarch 8.5.2-1.el8 @epel 646 k 2023-10-14T17:03:14.295 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy noarch 18.4.0-1.el8 @epel 1.1 M 2023-10-14T17:03:14.295 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth noarch 1:1.1.1-10.el8 @epel 306 k 2023-10-14T17:03:14.296 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco noarch 6.2-6.el8 @epel 4.0 k 2023-10-14T17:03:14.296 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools noarch 2.0-4.el8 @epel 28 k 2023-10-14T17:03:14.296 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 @rhel-8-for-x86_64-appstream-rpms 2.5 M 2023-10-14T17:03:14.296 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch noarch 1.21-2.el8 @rhel-8-for-x86_64-appstream-rpms 55 k 2023-10-14T17:03:14.297 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer noarch 1.10-11.el8 @rhel-8-for-x86_64-appstream-rpms 32 k 2023-10-14T17:03:14.297 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt noarch 1.6.1-2.el8 @rhel-8-for-x86_64-baseos-rpms 88 k 2023-10-14T17:03:14.297 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 @epel 21 M 2023-10-14T17:03:14.298 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils noarch 0.3.5-11.el8 @epel 126 k 2023-10-14T17:03:14.298 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako noarch 1.0.6-13.el8 @rhel-8-for-x86_64-appstream-rpms 540 k 2023-10-14T17:03:14.298 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe x86_64 0.23-19.el8 @rhel-8-for-x86_64-appstream-rpms 76 k 2023-10-14T17:03:14.299 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools noarch 7.2.0-3.el8 @epel 302 k 2023-10-14T17:03:14.299 INFO:teuthology.orchestra.run.smithi158.stdout: python3-natsort noarch 7.1.1-2.el8 @epel 227 k 2023-10-14T17:03:14.299 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy x86_64 1:1.14.3-9.el8 @rhel-8-for-x86_64-appstream-rpms 16 M 2023-10-14T17:03:14.299 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 @rhel-8-for-x86_64-appstream-rpms 946 k 2023-10-14T17:03:14.300 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib noarch 2.1.0-1.el8 @rhel-8-for-x86_64-baseos-rpms 737 k 2023-10-14T17:03:14.300 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan noarch 1.3.2-9.el8 @epel 1.3 M 2023-10-14T17:03:14.300 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend noarch 2.6-1.el8 @epel 19 k 2023-10-14T17:03:14.301 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable noarch 0.7.2-14.el8 @rhel-8-for-x86_64-appstream-rpms 167 k 2023-10-14T17:03:14.301 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1 noarch 0.3.7-6.el8 @rhel-8-for-x86_64-appstream-rpms 522 k 2023-10-14T17:03:14.301 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 @rhel-8-for-x86_64-appstream-rpms 603 k 2023-10-14T17:03:14.301 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz noarch 2017.2-9.el8 @rhel-8-for-x86_64-appstream-rpms 175 k 2023-10-14T17:03:14.302 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 1.3 M 2023-10-14T17:03:14.302 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 1.3 M 2023-10-14T17:03:14.302 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru noarch 0.7-6.el8 @epel 84 k 2023-10-14T17:03:14.303 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 @rhel-8-for-x86_64-baseos-rpms 107 k 2023-10-14T17:03:14.303 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 297 k 2023-10-14T17:03:14.303 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes noarch 2.4.1-12.el8 @epel 454 k 2023-10-14T17:03:14.304 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa noarch 4.9-2.el8 @epel 194 k 2023-10-14T17:03:14.304 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 @rhel-8-for-x86_64-appstream-rpms 56 M 2023-10-14T17:03:14.304 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric noarch 0.8.1-17.el8 @epel 24 k 2023-10-14T17:03:14.304 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 @epel 43 k 2023-10-14T17:03:14.305 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora noarch 1.14.1-5.el8 @epel 82 k 2023-10-14T17:03:14.305 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme noarch 0.6.0-4.el8 @epel 54 k 2023-10-14T17:03:14.305 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress noarch 1.4.3-1.el8 @epel 1.1 M 2023-10-14T17:03:14.306 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob noarch 1.8.5-1.el8.1 @epel 1.2 M 2023-10-14T17:03:14.306 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client noarch 0.56.0-5.el8 @epel 180 k 2023-10-14T17:03:14.306 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest noarch 2.0.33-1.el8 @epel 289 k 2023-10-14T17:03:14.307 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug noarch 0.12.2-4.el8 @rhel-8-for-x86_64-appstream-rpms 2.0 M 2023-10-14T17:03:14.307 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile noarch 2.0-2.el8 @epel 35 k 2023-10-14T17:03:14.307 INFO:teuthology.orchestra.run.smithi158.stdout: thrift x86_64 0.13.0-2.el8 @epel 6.3 M 2023-10-14T17:03:14.307 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:14.308 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T17:03:14.308 INFO:teuthology.orchestra.run.smithi158.stdout:======================================================================================================================= 2023-10-14T17:03:14.308 INFO:teuthology.orchestra.run.smithi158.stdout:Remove 78 Packages 2023-10-14T17:03:14.309 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:14.309 INFO:teuthology.orchestra.run.smithi158.stdout:Freed space: 518 M 2023-10-14T17:03:14.310 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T17:03:14.316 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T17:03:14.317 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T17:03:14.421 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T17:03:14.422 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T17:03:15.332 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:03:15.338 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T17:03:15.346 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================================================= 2023-10-14T17:03:15.346 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T17:03:15.346 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================================================= 2023-10-14T17:03:15.347 INFO:teuthology.orchestra.run.smithi008.stdout:Removing: 2023-10-14T17:03:15.347 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 26 M 2023-10-14T17:03:15.347 INFO:teuthology.orchestra.run.smithi008.stdout:Removing dependent packages: 2023-10-14T17:03:15.347 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 490 k 2023-10-14T17:03:15.348 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 619 k 2023-10-14T17:03:15.348 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 7.1 M 2023-10-14T17:03:15.348 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 66 M 2023-10-14T17:03:15.348 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 566 k 2023-10-14T17:03:15.349 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 63 M 2023-10-14T17:03:15.349 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 1.3 M 2023-10-14T17:03:15.349 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 16 M 2023-10-14T17:03:15.349 INFO:teuthology.orchestra.run.smithi008.stdout:Removing unused dependencies: 2023-10-14T17:03:15.350 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 100 M 2023-10-14T17:03:15.350 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 319 k 2023-10-14T17:03:15.350 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 5.4 M 2023-10-14T17:03:15.351 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 1.4 M 2023-10-14T17:03:15.351 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 39 k 2023-10-14T17:03:15.351 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 135 k 2023-10-14T17:03:15.351 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 1:2.7-9.el8 @epel 1.5 M 2023-10-14T17:03:15.352 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 521 k 2023-10-14T17:03:15.352 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 8.4.1-1.el8 @rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-10-14T17:03:15.352 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.2-3.el8 @epel 125 k 2023-10-14T17:03:15.352 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 8.4.1-1.el8 @rhel-8-for-x86_64-baseos-rpms 298 k 2023-10-14T17:03:15.353 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.9.0-3.el8 @rhel-8-for-x86_64-baseos-rpms 91 k 2023-10-14T17:03:15.353 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 1.8 M 2023-10-14T17:03:15.353 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 0.11.4-1.el8 @rhel-8-for-x86_64-appstream-rpms 1.1 M 2023-10-14T17:03:15.353 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 22 M 2023-10-14T17:03:15.354 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.3.1-3.el8 @epel 205 k 2023-10-14T17:03:15.354 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.12-1.el8 @rhel-8-for-x86_64-appstream-rpms 28 M 2023-10-14T17:03:15.354 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads x86_64 0.3.12-1.el8 @rhel-8-for-x86_64-appstream-rpms 29 M 2023-10-14T17:03:15.355 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.7.0-2.el8 @epel 2.4 M 2023-10-14T17:03:15.355 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.5.1-5.el8 @rhel-8-for-x86_64-appstream-rpms 20 M 2023-10-14T17:03:15.355 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 @epel 78 k 2023-10-14T17:03:15.355 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 3.1.1-4.el8 @epel 71 k 2023-10-14T17:03:15.357 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 187 k 2023-10-14T17:03:15.357 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 552 k 2023-10-14T17:03:15.358 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 608 k 2023-10-14T17:03:15.358 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2018.10.15-7.el8 @epel 8.2 k 2023-10-14T17:03:15.358 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.5.2-1.el8 @epel 646 k 2023-10-14T17:03:15.359 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.4.0-1.el8 @epel 1.1 M 2023-10-14T17:03:15.359 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:1.1.1-10.el8 @epel 306 k 2023-10-14T17:03:15.359 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 6.2-6.el8 @epel 4.0 k 2023-10-14T17:03:15.359 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 2.0-4.el8 @epel 28 k 2023-10-14T17:03:15.360 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 @rhel-8-for-x86_64-appstream-rpms 2.5 M 2023-10-14T17:03:15.360 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-2.el8 @rhel-8-for-x86_64-appstream-rpms 55 k 2023-10-14T17:03:15.360 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 1.10-11.el8 @rhel-8-for-x86_64-appstream-rpms 32 k 2023-10-14T17:03:15.361 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 1.6.1-2.el8 @rhel-8-for-x86_64-baseos-rpms 88 k 2023-10-14T17:03:15.361 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 @epel 21 M 2023-10-14T17:03:15.361 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-11.el8 @epel 126 k 2023-10-14T17:03:15.361 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.0.6-13.el8 @rhel-8-for-x86_64-appstream-rpms 540 k 2023-10-14T17:03:15.362 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 0.23-19.el8 @rhel-8-for-x86_64-appstream-rpms 76 k 2023-10-14T17:03:15.362 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 7.2.0-3.el8 @epel 302 k 2023-10-14T17:03:15.362 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-2.el8 @epel 227 k 2023-10-14T17:03:15.363 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.14.3-9.el8 @rhel-8-for-x86_64-appstream-rpms 16 M 2023-10-14T17:03:15.363 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 @rhel-8-for-x86_64-appstream-rpms 946 k 2023-10-14T17:03:15.363 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 2.1.0-1.el8 @rhel-8-for-x86_64-baseos-rpms 737 k 2023-10-14T17:03:15.363 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.3.2-9.el8 @epel 1.3 M 2023-10-14T17:03:15.364 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 2.6-1.el8 @epel 19 k 2023-10-14T17:03:15.364 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-14.el8 @rhel-8-for-x86_64-appstream-rpms 167 k 2023-10-14T17:03:15.364 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.3.7-6.el8 @rhel-8-for-x86_64-appstream-rpms 522 k 2023-10-14T17:03:15.365 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 @rhel-8-for-x86_64-appstream-rpms 603 k 2023-10-14T17:03:15.365 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2017.2-9.el8 @rhel-8-for-x86_64-appstream-rpms 175 k 2023-10-14T17:03:15.365 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 1.3 M 2023-10-14T17:03:15.365 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 1.3 M 2023-10-14T17:03:15.366 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-6.el8 @epel 84 k 2023-10-14T17:03:15.366 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 @rhel-8-for-x86_64-baseos-rpms 107 k 2023-10-14T17:03:15.366 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 297 k 2023-10-14T17:03:15.366 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.4.1-12.el8 @epel 454 k 2023-10-14T17:03:15.367 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el8 @epel 194 k 2023-10-14T17:03:15.367 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 @rhel-8-for-x86_64-appstream-rpms 56 M 2023-10-14T17:03:15.367 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric noarch 0.8.1-17.el8 @epel 24 k 2023-10-14T17:03:15.368 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 @epel 43 k 2023-10-14T17:03:15.368 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 1.14.1-5.el8 @epel 82 k 2023-10-14T17:03:15.368 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme noarch 0.6.0-4.el8 @epel 54 k 2023-10-14T17:03:15.369 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress noarch 1.4.3-1.el8 @epel 1.1 M 2023-10-14T17:03:15.369 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.5-1.el8.1 @epel 1.2 M 2023-10-14T17:03:15.369 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 0.56.0-5.el8 @epel 180 k 2023-10-14T17:03:15.369 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest noarch 2.0.33-1.el8 @epel 289 k 2023-10-14T17:03:15.370 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 0.12.2-4.el8 @rhel-8-for-x86_64-appstream-rpms 2.0 M 2023-10-14T17:03:15.370 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-2.el8 @epel 35 k 2023-10-14T17:03:15.370 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.13.0-2.el8 @epel 6.3 M 2023-10-14T17:03:15.371 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:15.371 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T17:03:15.371 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================================================= 2023-10-14T17:03:15.371 INFO:teuthology.orchestra.run.smithi008.stdout:Remove 78 Packages 2023-10-14T17:03:15.372 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:15.373 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T17:03:15.373 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/78 2023-10-14T17:03:15.373 INFO:teuthology.orchestra.run.smithi008.stdout:Freed space: 518 M 2023-10-14T17:03:15.374 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T17:03:15.382 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T17:03:15.383 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T17:03:15.480 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:03:15.491 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T17:03:15.491 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T17:03:15.493 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================================================= 2023-10-14T17:03:15.494 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T17:03:15.494 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================================================= 2023-10-14T17:03:15.494 INFO:teuthology.orchestra.run.smithi155.stdout:Removing: 2023-10-14T17:03:15.494 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 26 M 2023-10-14T17:03:15.495 INFO:teuthology.orchestra.run.smithi155.stdout:Removing dependent packages: 2023-10-14T17:03:15.495 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 490 k 2023-10-14T17:03:15.495 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 619 k 2023-10-14T17:03:15.496 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 7.1 M 2023-10-14T17:03:15.496 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 66 M 2023-10-14T17:03:15.496 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 566 k 2023-10-14T17:03:15.496 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 63 M 2023-10-14T17:03:15.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 1.3 M 2023-10-14T17:03:15.497 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 16 M 2023-10-14T17:03:15.497 INFO:teuthology.orchestra.run.smithi155.stdout:Removing unused dependencies: 2023-10-14T17:03:15.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 100 M 2023-10-14T17:03:15.498 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 319 k 2023-10-14T17:03:15.498 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 5.4 M 2023-10-14T17:03:15.498 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 1.4 M 2023-10-14T17:03:15.499 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 39 k 2023-10-14T17:03:15.499 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 135 k 2023-10-14T17:03:15.499 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 1:2.7-9.el8 @epel 1.5 M 2023-10-14T17:03:15.499 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 521 k 2023-10-14T17:03:15.500 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 8.4.1-1.el8 @rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-10-14T17:03:15.500 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.2-3.el8 @epel 125 k 2023-10-14T17:03:15.500 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 8.4.1-1.el8 @rhel-8-for-x86_64-baseos-rpms 298 k 2023-10-14T17:03:15.500 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.9.0-3.el8 @rhel-8-for-x86_64-baseos-rpms 91 k 2023-10-14T17:03:15.501 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 1.8 M 2023-10-14T17:03:15.501 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 0.11.4-1.el8 @rhel-8-for-x86_64-appstream-rpms 1.1 M 2023-10-14T17:03:15.501 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 22 M 2023-10-14T17:03:15.502 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.3.1-3.el8 @epel 205 k 2023-10-14T17:03:15.502 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.12-1.el8 @rhel-8-for-x86_64-appstream-rpms 28 M 2023-10-14T17:03:15.502 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads x86_64 0.3.12-1.el8 @rhel-8-for-x86_64-appstream-rpms 29 M 2023-10-14T17:03:15.502 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.7.0-2.el8 @epel 2.4 M 2023-10-14T17:03:15.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.5.1-5.el8 @rhel-8-for-x86_64-appstream-rpms 20 M 2023-10-14T17:03:15.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 @epel 78 k 2023-10-14T17:03:15.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 3.1.1-4.el8 @epel 71 k 2023-10-14T17:03:15.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 187 k 2023-10-14T17:03:15.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 552 k 2023-10-14T17:03:15.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 608 k 2023-10-14T17:03:15.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2018.10.15-7.el8 @epel 8.2 k 2023-10-14T17:03:15.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.5.2-1.el8 @epel 646 k 2023-10-14T17:03:15.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.4.0-1.el8 @epel 1.1 M 2023-10-14T17:03:15.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:1.1.1-10.el8 @epel 306 k 2023-10-14T17:03:15.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 6.2-6.el8 @epel 4.0 k 2023-10-14T17:03:15.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 2.0-4.el8 @epel 28 k 2023-10-14T17:03:15.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 @rhel-8-for-x86_64-appstream-rpms 2.5 M 2023-10-14T17:03:15.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-2.el8 @rhel-8-for-x86_64-appstream-rpms 55 k 2023-10-14T17:03:15.507 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 1.10-11.el8 @rhel-8-for-x86_64-appstream-rpms 32 k 2023-10-14T17:03:15.507 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt noarch 1.6.1-2.el8 @rhel-8-for-x86_64-baseos-rpms 88 k 2023-10-14T17:03:15.507 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 @epel 21 M 2023-10-14T17:03:15.507 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-11.el8 @epel 126 k 2023-10-14T17:03:15.508 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.0.6-13.el8 @rhel-8-for-x86_64-appstream-rpms 540 k 2023-10-14T17:03:15.508 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 0.23-19.el8 @rhel-8-for-x86_64-appstream-rpms 76 k 2023-10-14T17:03:15.508 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 7.2.0-3.el8 @epel 302 k 2023-10-14T17:03:15.509 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-2.el8 @epel 227 k 2023-10-14T17:03:15.509 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.14.3-9.el8 @rhel-8-for-x86_64-appstream-rpms 16 M 2023-10-14T17:03:15.509 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 @rhel-8-for-x86_64-appstream-rpms 946 k 2023-10-14T17:03:15.509 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 2.1.0-1.el8 @rhel-8-for-x86_64-baseos-rpms 737 k 2023-10-14T17:03:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.3.2-9.el8 @epel 1.3 M 2023-10-14T17:03:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 2.6-1.el8 @epel 19 k 2023-10-14T17:03:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-14.el8 @rhel-8-for-x86_64-appstream-rpms 167 k 2023-10-14T17:03:15.510 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.3.7-6.el8 @rhel-8-for-x86_64-appstream-rpms 522 k 2023-10-14T17:03:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 @rhel-8-for-x86_64-appstream-rpms 603 k 2023-10-14T17:03:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2017.2-9.el8 @rhel-8-for-x86_64-appstream-rpms 175 k 2023-10-14T17:03:15.511 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 1.3 M 2023-10-14T17:03:15.512 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 1.3 M 2023-10-14T17:03:15.512 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-6.el8 @epel 84 k 2023-10-14T17:03:15.512 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 @rhel-8-for-x86_64-baseos-rpms 107 k 2023-10-14T17:03:15.512 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 297 k 2023-10-14T17:03:15.513 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.4.1-12.el8 @epel 454 k 2023-10-14T17:03:15.513 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el8 @epel 194 k 2023-10-14T17:03:15.513 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 @rhel-8-for-x86_64-appstream-rpms 56 M 2023-10-14T17:03:15.514 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric noarch 0.8.1-17.el8 @epel 24 k 2023-10-14T17:03:15.514 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 @epel 43 k 2023-10-14T17:03:15.514 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 1.14.1-5.el8 @epel 82 k 2023-10-14T17:03:15.514 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme noarch 0.6.0-4.el8 @epel 54 k 2023-10-14T17:03:15.515 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress noarch 1.4.3-1.el8 @epel 1.1 M 2023-10-14T17:03:15.515 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.5-1.el8.1 @epel 1.2 M 2023-10-14T17:03:15.515 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 0.56.0-5.el8 @epel 180 k 2023-10-14T17:03:15.516 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest noarch 2.0.33-1.el8 @epel 289 k 2023-10-14T17:03:15.516 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 0.12.2-4.el8 @rhel-8-for-x86_64-appstream-rpms 2.0 M 2023-10-14T17:03:15.516 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-2.el8 @epel 35 k 2023-10-14T17:03:15.516 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.13.0-2.el8 @epel 6.3 M 2023-10-14T17:03:15.517 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:15.517 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T17:03:15.517 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================================================= 2023-10-14T17:03:15.517 INFO:teuthology.orchestra.run.smithi155.stdout:Remove 78 Packages 2023-10-14T17:03:15.518 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:15.518 INFO:teuthology.orchestra.run.smithi155.stdout:Freed space: 518 M 2023-10-14T17:03:15.519 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T17:03:15.527 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T17:03:15.527 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T17:03:15.628 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T17:03:15.629 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T17:03:15.641 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/78 2023-10-14T17:03:15.662 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/78 2023-10-14T17:03:15.663 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/78 2023-10-14T17:03:15.914 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/78 2023-10-14T17:03:16.136 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8. 3/78 2023-10-14T17:03:16.339 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-pecan-1.3.2-9.el8.noarch 4/78 2023-10-14T17:03:16.339 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noa 5/78 2023-10-14T17:03:16.453 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T17:03:16.483 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T17:03:16.483 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/78 2023-10-14T17:03:16.497 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T17:03:16.527 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T17:03:16.528 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/78 2023-10-14T17:03:16.558 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noa 5/78 2023-10-14T17:03:16.559 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/78 2023-10-14T17:03:16.645 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/78 2023-10-14T17:03:16.658 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/78 2023-10-14T17:03:16.668 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/78 2023-10-14T17:03:16.668 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/78 2023-10-14T17:03:16.679 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/78 2023-10-14T17:03:16.681 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/78 2023-10-14T17:03:16.772 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/78 2023-10-14T17:03:16.938 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/78 2023-10-14T17:03:16.944 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-cherrypy-18.4.0-1.el8.noarch 7/78 2023-10-14T17:03:16.994 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/78 2023-10-14T17:03:17.158 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8. 3/78 2023-10-14T17:03:17.208 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8. 3/78 2023-10-14T17:03:17.237 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-cheroot-8.5.2-1.el8.noarch 8/78 2023-10-14T17:03:17.355 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-pecan-1.3.2-9.el8.noarch 4/78 2023-10-14T17:03:17.356 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noa 5/78 2023-10-14T17:03:17.435 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-pecan-1.3.2-9.el8.noarch 4/78 2023-10-14T17:03:17.436 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noa 5/78 2023-10-14T17:03:17.469 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-kubernetes-1:11.0.0-6.el8.noarch 9/78 2023-10-14T17:03:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noa 5/78 2023-10-14T17:03:17.541 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/78 2023-10-14T17:03:17.663 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noa 5/78 2023-10-14T17:03:17.663 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/78 2023-10-14T17:03:17.664 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-google-auth-1:1.1.1-10.el8.noarch 10/78 2023-10-14T17:03:17.692 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/78 2023-10-14T17:03:17.692 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/78 2023-10-14T17:03:17.748 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/78 2023-10-14T17:03:17.842 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/78 2023-10-14T17:03:17.873 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/78 2023-10-14T17:03:17.913 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-cherrypy-18.4.0-1.el8.noarch 7/78 2023-10-14T17:03:18.047 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-rsa-4.9-2.el8.noarch 12/78 2023-10-14T17:03:18.100 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-cherrypy-18.4.0-1.el8.noarch 7/78 2023-10-14T17:03:18.165 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-cheroot-8.5.2-1.el8.noarch 8/78 2023-10-14T17:03:18.224 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-jinja2-2.10.1-2.el8_0.noarch 13/78 2023-10-14T17:03:18.370 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-cheroot-8.5.2-1.el8.noarch 8/78 2023-10-14T17:03:18.411 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-kubernetes-1:11.0.0-6.el8.noarch 9/78 2023-10-14T17:03:18.433 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-routes-2.4.1-12.el8.noarch 14/78 2023-10-14T17:03:18.573 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-google-auth-1:1.1.1-10.el8.noarch 10/78 2023-10-14T17:03:18.594 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-kubernetes-1:11.0.0-6.el8.noarch 9/78 2023-10-14T17:03:18.602 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/78 2023-10-14T17:03:18.603 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/78 2023-10-14T17:03:18.650 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-webtest-2.0.33-1.el8.noarch 15/78 2023-10-14T17:03:18.650 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d3 16/78 2023-10-14T17:03:18.744 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-google-auth-1:1.1.1-10.el8.noarch 10/78 2023-10-14T17:03:18.766 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/78 2023-10-14T17:03:18.779 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/78 2023-10-14T17:03:18.780 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/78 2023-10-14T17:03:18.877 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d3 16/78 2023-10-14T17:03:18.972 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/78 2023-10-14T17:03:19.007 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-rsa-4.9-2.el8.noarch 12/78 2023-10-14T17:03:19.123 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d 17/78 2023-10-14T17:03:19.147 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 18/78 2023-10-14T17:03:19.148 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 18/78 2023-10-14T17:03:19.188 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-rsa-4.9-2.el8.noarch 12/78 2023-10-14T17:03:19.209 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-jinja2-2.10.1-2.el8_0.noarch 13/78 2023-10-14T17:03:19.328 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 18/78 2023-10-14T17:03:19.329 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 19/78 2023-10-14T17:03:19.393 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-routes-2.4.1-12.el8.noarch 14/78 2023-10-14T17:03:19.413 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-jinja2-2.10.1-2.el8_0.noarch 13/78 2023-10-14T17:03:19.572 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-routes-2.4.1-12.el8.noarch 14/78 2023-10-14T17:03:19.575 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 19/78 2023-10-14T17:03:19.619 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-webtest-2.0.33-1.el8.noarch 15/78 2023-10-14T17:03:19.619 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d3 16/78 2023-10-14T17:03:19.790 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-webtest-2.0.33-1.el8.noarch 15/78 2023-10-14T17:03:19.790 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d3 16/78 2023-10-14T17:03:19.806 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-babel-2.5.1-5.el8.noarch 20/78 2023-10-14T17:03:19.835 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 21/78 2023-10-14T17:03:19.836 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 21/78 2023-10-14T17:03:19.896 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d3 16/78 2023-10-14T17:03:20.027 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 21/78 2023-10-14T17:03:20.107 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d3 16/78 2023-10-14T17:03:20.190 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d 17/78 2023-10-14T17:03:20.208 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-pyasn1-modules-0.3.7-6.el8.noarch 22/78 2023-10-14T17:03:20.215 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 18/78 2023-10-14T17:03:20.215 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 18/78 2023-10-14T17:03:20.362 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 18/78 2023-10-14T17:03:20.363 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 19/78 2023-10-14T17:03:20.379 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-requests-oauthlib-1.0.0-1.el8.noarch 23/78 2023-10-14T17:03:20.385 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d 17/78 2023-10-14T17:03:20.415 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 18/78 2023-10-14T17:03:20.416 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 18/78 2023-10-14T17:03:20.574 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 19/78 2023-10-14T17:03:20.593 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 18/78 2023-10-14T17:03:20.593 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 19/78 2023-10-14T17:03:20.597 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/78 2023-10-14T17:03:20.756 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-portend-2.6-1.el8.noarch 25/78 2023-10-14T17:03:20.782 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-babel-2.5.1-5.el8.noarch 20/78 2023-10-14T17:03:20.809 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 21/78 2023-10-14T17:03:20.810 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 21/78 2023-10-14T17:03:20.870 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 19/78 2023-10-14T17:03:20.897 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-tempora-1.14.1-5.el8.noarch 26/78 2023-10-14T17:03:20.986 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 21/78 2023-10-14T17:03:21.086 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-jaraco-functools-2.0-4.el8.noarch 27/78 2023-10-14T17:03:21.093 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-babel-2.5.1-5.el8.noarch 20/78 2023-10-14T17:03:21.126 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 21/78 2023-10-14T17:03:21.127 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 21/78 2023-10-14T17:03:21.142 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-pyasn1-modules-0.3.7-6.el8.noarch 22/78 2023-10-14T17:03:21.281 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-mako-1.0.6-13.el8.noarch 28/78 2023-10-14T17:03:21.349 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 21/78 2023-10-14T17:03:21.363 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-requests-oauthlib-1.0.0-1.el8.noarch 23/78 2023-10-14T17:03:21.479 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-jsonpatch-1.21-2.el8.noarch 29/78 2023-10-14T17:03:21.488 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-pyasn1-modules-0.3.7-6.el8.noarch 22/78 2023-10-14T17:03:21.548 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/78 2023-10-14T17:03:21.683 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-portend-2.6-1.el8.noarch 25/78 2023-10-14T17:03:21.703 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-requests-oauthlib-1.0.0-1.el8.noarch 23/78 2023-10-14T17:03:21.723 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-numpy-1:1.14.3-9.el8.x86_64 30/78 2023-10-14T17:03:21.723 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : openblas-0.3.12-1.el8.x86_64 31/78 2023-10-14T17:03:21.856 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-tempora-1.14.1-5.el8.noarch 26/78 2023-10-14T17:03:21.911 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 24/78 2023-10-14T17:03:22.000 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 31/78 2023-10-14T17:03:22.001 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : openblas-threads-0.3.12-1.el8.x86_64 32/78 2023-10-14T17:03:22.030 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-jaraco-functools-2.0-4.el8.noarch 27/78 2023-10-14T17:03:22.036 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-portend-2.6-1.el8.noarch 25/78 2023-10-14T17:03:22.197 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 32/78 2023-10-14T17:03:22.198 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : libgfortran-8.4.1-1.el8.x86_64 33/78 2023-10-14T17:03:22.227 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-tempora-1.14.1-5.el8.noarch 26/78 2023-10-14T17:03:22.239 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-mako-1.0.6-13.el8.noarch 28/78 2023-10-14T17:03:22.401 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-jaraco-functools-2.0-4.el8.noarch 27/78 2023-10-14T17:03:22.430 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 33/78 2023-10-14T17:03:22.442 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-jsonpatch-1.21-2.el8.noarch 29/78 2023-10-14T17:03:22.463 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32b 34/78 2023-10-14T17:03:22.464 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32b 34/78 2023-10-14T17:03:22.643 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-numpy-1:1.14.3-9.el8.x86_64 30/78 2023-10-14T17:03:22.644 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : openblas-0.3.12-1.el8.x86_64 31/78 2023-10-14T17:03:22.651 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-mako-1.0.6-13.el8.noarch 28/78 2023-10-14T17:03:22.656 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32b 34/78 2023-10-14T17:03:22.788 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-jsonpointer-1.10-11.el8.noarch 35/78 2023-10-14T17:03:22.864 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-jsonpatch-1.21-2.el8.noarch 29/78 2023-10-14T17:03:22.876 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 31/78 2023-10-14T17:03:22.877 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : openblas-threads-0.3.12-1.el8.x86_64 32/78 2023-10-14T17:03:22.947 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-jaraco-6.2-6.el8.noarch 36/78 2023-10-14T17:03:23.066 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-numpy-1:1.14.3-9.el8.x86_64 30/78 2023-10-14T17:03:23.067 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : openblas-0.3.12-1.el8.x86_64 31/78 2023-10-14T17:03:23.070 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-more-itertools-7.2.0-3.el8.noarch 37/78 2023-10-14T17:03:23.132 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 32/78 2023-10-14T17:03:23.133 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : libgfortran-8.4.1-1.el8.x86_64 33/78 2023-10-14T17:03:23.248 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-pytz-2017.2-9.el8.noarch 38/78 2023-10-14T17:03:23.349 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 33/78 2023-10-14T17:03:23.364 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 31/78 2023-10-14T17:03:23.364 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : openblas-threads-0.3.12-1.el8.x86_64 32/78 2023-10-14T17:03:23.383 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32b 34/78 2023-10-14T17:03:23.384 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32b 34/78 2023-10-14T17:03:23.419 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-jwt-1.6.1-2.el8.noarch 39/78 2023-10-14T17:03:23.549 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32b 34/78 2023-10-14T17:03:23.602 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 32/78 2023-10-14T17:03:23.603 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : libgfortran-8.4.1-1.el8.x86_64 33/78 2023-10-14T17:03:23.612 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-pyasn1-0.3.7-6.el8.noarch 40/78 2023-10-14T17:03:23.714 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-jsonpointer-1.10-11.el8.noarch 35/78 2023-10-14T17:03:23.785 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-waitress-1.4.3-1.el8.noarch 41/78 2023-10-14T17:03:23.836 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 33/78 2023-10-14T17:03:23.848 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-jaraco-6.2-6.el8.noarch 36/78 2023-10-14T17:03:23.876 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32b 34/78 2023-10-14T17:03:23.877 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32b 34/78 2023-10-14T17:03:24.014 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-webob-1.8.5-1.el8.1.noarch 42/78 2023-10-14T17:03:24.015 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-more-itertools-7.2.0-3.el8.noarch 37/78 2023-10-14T17:03:24.044 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32b 34/78 2023-10-14T17:03:24.190 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-repoze-lru-0.7-6.el8.noarch 43/78 2023-10-14T17:03:24.217 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-pytz-2017.2-9.el8.noarch 38/78 2023-10-14T17:03:24.218 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-jsonpointer-1.10-11.el8.noarch 35/78 2023-10-14T17:03:24.322 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-cachetools-3.1.1-4.el8.noarch 44/78 2023-10-14T17:03:24.338 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-jaraco-6.2-6.el8.noarch 36/78 2023-10-14T17:03:24.396 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-jwt-1.6.1-2.el8.noarch 39/78 2023-10-14T17:03:24.499 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-certifi-2018.10.15-7.el8.noarch 45/78 2023-10-14T17:03:24.530 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-more-itertools-7.2.0-3.el8.noarch 37/78 2023-10-14T17:03:24.564 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-pyasn1-0.3.7-6.el8.noarch 40/78 2023-10-14T17:03:24.664 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-websocket-client-0.56.0-5.el8.noarch 46/78 2023-10-14T17:03:24.682 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-pytz-2017.2-9.el8.noarch 38/78 2023-10-14T17:03:24.778 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-waitress-1.4.3-1.el8.noarch 41/78 2023-10-14T17:03:24.848 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-trustme-0.6.0-4.el8.noarch 47/78 2023-10-14T17:03:24.892 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-jwt-1.6.1-2.el8.noarch 39/78 2023-10-14T17:03:24.940 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-webob-1.8.5-1.el8.1.noarch 42/78 2023-10-14T17:03:25.010 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-zc-lockfile-2.0-2.el8.noarch 48/78 2023-10-14T17:03:25.102 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-pyasn1-0.3.7-6.el8.noarch 40/78 2023-10-14T17:03:25.107 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-repoze-lru-0.7-6.el8.noarch 43/78 2023-10-14T17:03:25.207 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-asyncssh-2.7.0-2.el8.noarch 49/78 2023-10-14T17:03:25.273 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-cachetools-3.1.1-4.el8.noarch 44/78 2023-10-14T17:03:25.308 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-waitress-1.4.3-1.el8.noarch 41/78 2023-10-14T17:03:25.394 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-natsort-7.1.1-2.el8.noarch 50/78 2023-10-14T17:03:25.475 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-certifi-2018.10.15-7.el8.noarch 45/78 2023-10-14T17:03:25.477 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-webob-1.8.5-1.el8.1.noarch 42/78 2023-10-14T17:03:25.513 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el 51/78 2023-10-14T17:03:25.629 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8 52/78 2023-10-14T17:03:25.640 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-websocket-client-0.56.0-5.el8.noarch 46/78 2023-10-14T17:03:25.662 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-repoze-lru-0.7-6.el8.noarch 43/78 2023-10-14T17:03:25.798 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-trustme-0.6.0-4.el8.noarch 47/78 2023-10-14T17:03:25.844 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-cachetools-3.1.1-4.el8.noarch 44/78 2023-10-14T17:03:25.857 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-werkzeug-0.12.2-4.el8.noarch 53/78 2023-10-14T17:03:25.971 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-certifi-2018.10.15-7.el8.noarch 45/78 2023-10-14T17:03:26.002 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-zc-lockfile-2.0-2.el8.noarch 48/78 2023-10-14T17:03:26.030 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-logutils-0.3.5-11.el8.noarch 54/78 2023-10-14T17:03:26.147 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 55/78 2023-10-14T17:03:26.167 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-asyncssh-2.7.0-2.el8.noarch 49/78 2023-10-14T17:03:26.177 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-websocket-client-0.56.0-5.el8.noarch 46/78 2023-10-14T17:03:26.302 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-trustme-0.6.0-4.el8.noarch 47/78 2023-10-14T17:03:26.322 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-singledispatch-3.4.0.3-18.el8.noarch 56/78 2023-10-14T17:03:26.323 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-natsort-7.1.1-2.el8.noarch 50/78 2023-10-14T17:03:26.359 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 57/78 2023-10-14T17:03:26.359 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 57/78 2023-10-14T17:03:26.360 INFO:teuthology.orchestra.run.smithi158.stdout:warning: file /etc/logrotate.d/ceph: remove failed: No such file or directory 2023-10-14T17:03:26.360 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:26.468 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el 51/78 2023-10-14T17:03:26.499 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-zc-lockfile-2.0-2.el8.noarch 48/78 2023-10-14T17:03:26.613 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8 52/78 2023-10-14T17:03:26.697 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 57/78 2023-10-14T17:03:26.697 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 58/78 2023-10-14T17:03:26.729 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-asyncssh-2.7.0-2.el8.noarch 49/78 2023-10-14T17:03:26.799 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-werkzeug-0.12.2-4.el8.noarch 53/78 2023-10-14T17:03:26.927 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-natsort-7.1.1-2.el8.noarch 50/78 2023-10-14T17:03:26.964 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-logutils-0.3.5-11.el8.noarch 54/78 2023-10-14T17:03:27.018 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el 51/78 2023-10-14T17:03:27.143 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8 52/78 2023-10-14T17:03:27.148 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 55/78 2023-10-14T17:03:27.289 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-singledispatch-3.4.0.3-18.el8.noarch 56/78 2023-10-14T17:03:27.326 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 57/78 2023-10-14T17:03:27.326 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 57/78 2023-10-14T17:03:27.327 INFO:teuthology.orchestra.run.smithi155.stdout:warning: file /etc/logrotate.d/ceph: remove failed: No such file or directory 2023-10-14T17:03:27.327 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:27.370 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-werkzeug-0.12.2-4.el8.noarch 53/78 2023-10-14T17:03:27.543 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-logutils-0.3.5-11.el8.noarch 54/78 2023-10-14T17:03:27.638 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 57/78 2023-10-14T17:03:27.638 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 58/78 2023-10-14T17:03:27.652 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 55/78 2023-10-14T17:03:27.809 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-singledispatch-3.4.0.3-18.el8.noarch 56/78 2023-10-14T17:03:27.848 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 57/78 2023-10-14T17:03:27.848 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 57/78 2023-10-14T17:03:27.849 INFO:teuthology.orchestra.run.smithi008.stdout:warning: file /etc/logrotate.d/ceph: remove failed: No such file or directory 2023-10-14T17:03:27.849 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:28.142 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 57/78 2023-10-14T17:03:28.143 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 58/78 2023-10-14T17:03:42.206 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 58/78 2023-10-14T17:03:42.207 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /sys 2023-10-14T17:03:42.207 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /proc 2023-10-14T17:03:42.207 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-10-14T17:03:42.208 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /run 2023-10-14T17:03:42.208 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /mnt 2023-10-14T17:03:42.208 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /var/tmp 2023-10-14T17:03:42.209 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /home 2023-10-14T17:03:42.209 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /tmp 2023-10-14T17:03:42.209 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-10-14T17:03:42.209 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:42.384 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 59/78 2023-10-14T17:03:42.384 INFO:teuthology.orchestra.run.smithi158.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy 2023-10-14T17:03:42.384 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:42.552 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 59/78 2023-10-14T17:03:42.737 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 60/78 2023-10-14T17:03:42.738 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 61/78 2023-10-14T17:03:42.977 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 61/78 2023-10-14T17:03:43.102 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 62/78 2023-10-14T17:03:43.310 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : gperftools-libs-1:2.7-9.el8.x86_64 63/78 2023-10-14T17:03:43.451 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 64/78 2023-10-14T17:03:43.555 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8. 65/78 2023-10-14T17:03:43.735 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x8 66/78 2023-10-14T17:03:43.860 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-prettytable-0.7.2-14.el8.noarch 67/78 2023-10-14T17:03:44.061 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 68/78 2023-10-14T17:03:44.075 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 58/78 2023-10-14T17:03:44.076 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2023-10-14T17:03:44.076 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2023-10-14T17:03:44.076 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2023-10-14T17:03:44.076 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /run 2023-10-14T17:03:44.077 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2023-10-14T17:03:44.077 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2023-10-14T17:03:44.077 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2023-10-14T17:03:44.078 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2023-10-14T17:03:44.078 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2023-10-14T17:03:44.078 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:44.209 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 59/78 2023-10-14T17:03:44.210 INFO:teuthology.orchestra.run.smithi155.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy 2023-10-14T17:03:44.210 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:44.251 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : libunwind-1.3.1-3.el8.x86_64 69/78 2023-10-14T17:03:44.376 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : liboath-2.6.2-3.el8.x86_64 70/78 2023-10-14T17:03:44.470 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 59/78 2023-10-14T17:03:44.552 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : librabbitmq-0.9.0-3.el8.x86_64 71/78 2023-10-14T17:03:44.552 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : librdkafka-0.11.4-1.el8.x86_64 72/78 2023-10-14T17:03:44.638 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 60/78 2023-10-14T17:03:44.639 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 61/78 2023-10-14T17:03:44.778 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 72/78 2023-10-14T17:03:44.861 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 61/78 2023-10-14T17:03:44.968 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : thrift-0.13.0-2.el8.x86_64 73/78 2023-10-14T17:03:44.969 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 74/78 2023-10-14T17:03:45.053 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 62/78 2023-10-14T17:03:45.210 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 74/78 2023-10-14T17:03:45.211 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : gperftools-libs-1:2.7-9.el8.x86_64 63/78 2023-10-14T17:03:45.218 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 75/78 2023-10-14T17:03:45.218 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : libquadmath-8.4.1-1.el8.x86_64 75/78 2023-10-14T17:03:45.358 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 58/78 2023-10-14T17:03:45.359 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2023-10-14T17:03:45.359 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2023-10-14T17:03:45.359 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-10-14T17:03:45.360 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /run 2023-10-14T17:03:45.360 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2023-10-14T17:03:45.361 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2023-10-14T17:03:45.361 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2023-10-14T17:03:45.362 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2023-10-14T17:03:45.362 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-10-14T17:03:45.362 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:45.363 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 64/78 2023-10-14T17:03:45.465 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 59/78 2023-10-14T17:03:45.465 INFO:teuthology.orchestra.run.smithi008.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy 2023-10-14T17:03:45.466 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:45.469 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 75/78 2023-10-14T17:03:45.481 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8. 65/78 2023-10-14T17:03:45.658 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-markupsafe-0.23-19.el8.x86_64 76/78 2023-10-14T17:03:45.686 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x8 66/78 2023-10-14T17:03:45.724 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 59/78 2023-10-14T17:03:45.844 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-prettytable-0.7.2-14.el8.noarch 67/78 2023-10-14T17:03:45.868 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : python3-bcrypt-3.1.6-2.el8.1.x86_64 77/78 2023-10-14T17:03:45.868 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 78/78 2023-10-14T17:03:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 60/78 2023-10-14T17:03:45.910 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 61/78 2023-10-14T17:03:46.011 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 68/78 2023-10-14T17:03:46.157 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 61/78 2023-10-14T17:03:46.177 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : libunwind-1.3.1-3.el8.x86_64 69/78 2023-10-14T17:03:46.291 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 62/78 2023-10-14T17:03:46.319 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : liboath-2.6.2-3.el8.x86_64 70/78 2023-10-14T17:03:46.390 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 78/78 2023-10-14T17:03:46.391 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/78 2023-10-14T17:03:46.391 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/78 2023-10-14T17:03:46.391 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el 3/78 2023-10-14T17:03:46.392 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32b 4/78 2023-10-14T17:03:46.392 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/78 2023-10-14T17:03:46.392 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/78 2023-10-14T17:03:46.393 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noa 7/78 2023-10-14T17:03:46.393 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d3 8/78 2023-10-14T17:03:46.393 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8. 9/78 2023-10-14T17:03:46.393 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 10/78 2023-10-14T17:03:46.394 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/78 2023-10-14T17:03:46.394 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8 12/78 2023-10-14T17:03:46.394 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/78 2023-10-14T17:03:46.395 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 14/78 2023-10-14T17:03:46.395 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 15/78 2023-10-14T17:03:46.395 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 16/78 2023-10-14T17:03:46.395 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 17/78 2023-10-14T17:03:46.396 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 18/78 2023-10-14T17:03:46.396 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 19/78 2023-10-14T17:03:46.396 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 20/78 2023-10-14T17:03:46.397 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 21/78 2023-10-14T17:03:46.397 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 22/78 2023-10-14T17:03:46.397 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/78 2023-10-14T17:03:46.397 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 24/78 2023-10-14T17:03:46.398 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 25/78 2023-10-14T17:03:46.398 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 26/78 2023-10-14T17:03:46.398 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 27/78 2023-10-14T17:03:46.398 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 28/78 2023-10-14T17:03:46.399 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 29/78 2023-10-14T17:03:46.399 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 30/78 2023-10-14T17:03:46.399 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8. 31/78 2023-10-14T17:03:46.400 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x8 32/78 2023-10-14T17:03:46.400 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 33/78 2023-10-14T17:03:46.400 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 34/78 2023-10-14T17:03:46.400 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 35/78 2023-10-14T17:03:46.401 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 36/78 2023-10-14T17:03:46.401 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 37/78 2023-10-14T17:03:46.401 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 38/78 2023-10-14T17:03:46.401 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 39/78 2023-10-14T17:03:46.402 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 40/78 2023-10-14T17:03:46.402 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/78 2023-10-14T17:03:46.402 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/78 2023-10-14T17:03:46.403 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 43/78 2023-10-14T17:03:46.403 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 44/78 2023-10-14T17:03:46.403 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 45/78 2023-10-14T17:03:46.403 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 46/78 2023-10-14T17:03:46.404 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 47/78 2023-10-14T17:03:46.404 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 48/78 2023-10-14T17:03:46.404 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 49/78 2023-10-14T17:03:46.404 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 50/78 2023-10-14T17:03:46.405 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 51/78 2023-10-14T17:03:46.405 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 52/78 2023-10-14T17:03:46.405 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 53/78 2023-10-14T17:03:46.406 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-portend-2.6-1.el8.noarch 54/78 2023-10-14T17:03:46.406 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/78 2023-10-14T17:03:46.406 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 56/78 2023-10-14T17:03:46.406 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 57/78 2023-10-14T17:03:46.407 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 58/78 2023-10-14T17:03:46.407 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 59/78 2023-10-14T17:03:46.407 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 60/78 2023-10-14T17:03:46.408 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 61/78 2023-10-14T17:03:46.408 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 62/78 2023-10-14T17:03:46.408 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 63/78 2023-10-14T17:03:46.408 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 64/78 2023-10-14T17:03:46.409 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 65/78 2023-10-14T17:03:46.409 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d 66/78 2023-10-14T17:03:46.409 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 67/78 2023-10-14T17:03:46.409 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 68/78 2023-10-14T17:03:46.410 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 69/78 2023-10-14T17:03:46.410 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 70/78 2023-10-14T17:03:46.410 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 71/78 2023-10-14T17:03:46.411 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 72/78 2023-10-14T17:03:46.411 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 73/78 2023-10-14T17:03:46.411 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 74/78 2023-10-14T17:03:46.411 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 75/78 2023-10-14T17:03:46.412 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 76/78 2023-10-14T17:03:46.412 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 77/78 2023-10-14T17:03:46.461 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : librabbitmq-0.9.0-3.el8.x86_64 71/78 2023-10-14T17:03:46.462 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : librdkafka-0.11.4-1.el8.x86_64 72/78 2023-10-14T17:03:46.474 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : gperftools-libs-1:2.7-9.el8.x86_64 63/78 2023-10-14T17:03:46.657 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 64/78 2023-10-14T17:03:46.704 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 72/78 2023-10-14T17:03:46.763 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8. 65/78 2023-10-14T17:03:46.894 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : thrift-0.13.0-2.el8.x86_64 73/78 2023-10-14T17:03:46.895 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 74/78 2023-10-14T17:03:46.957 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x8 66/78 2023-10-14T17:03:47.090 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-prettytable-0.7.2-14.el8.noarch 67/78 2023-10-14T17:03:47.111 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 74/78 2023-10-14T17:03:47.118 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 75/78 2023-10-14T17:03:47.118 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : libquadmath-8.4.1-1.el8.x86_64 75/78 2023-10-14T17:03:47.283 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 68/78 2023-10-14T17:03:47.362 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 75/78 2023-10-14T17:03:47.473 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : libunwind-1.3.1-3.el8.x86_64 69/78 2023-10-14T17:03:47.520 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-markupsafe-0.23-19.el8.x86_64 76/78 2023-10-14T17:03:47.623 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : liboath-2.6.2-3.el8.x86_64 70/78 2023-10-14T17:03:47.719 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : python3-bcrypt-3.1.6-2.el8.1.x86_64 77/78 2023-10-14T17:03:47.719 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 78/78 2023-10-14T17:03:47.799 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : librabbitmq-0.9.0-3.el8.x86_64 71/78 2023-10-14T17:03:47.799 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : librdkafka-0.11.4-1.el8.x86_64 72/78 2023-10-14T17:03:48.059 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 72/78 2023-10-14T17:03:48.190 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : thrift-0.13.0-2.el8.x86_64 73/78 2023-10-14T17:03:48.191 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 74/78 2023-10-14T17:03:48.258 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 78/78 2023-10-14T17:03:48.258 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/78 2023-10-14T17:03:48.259 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/78 2023-10-14T17:03:48.259 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el 3/78 2023-10-14T17:03:48.259 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32b 4/78 2023-10-14T17:03:48.260 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/78 2023-10-14T17:03:48.260 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/78 2023-10-14T17:03:48.260 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noa 7/78 2023-10-14T17:03:48.261 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d3 8/78 2023-10-14T17:03:48.261 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8. 9/78 2023-10-14T17:03:48.261 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 10/78 2023-10-14T17:03:48.261 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/78 2023-10-14T17:03:48.262 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8 12/78 2023-10-14T17:03:48.262 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/78 2023-10-14T17:03:48.263 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 14/78 2023-10-14T17:03:48.263 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 15/78 2023-10-14T17:03:48.263 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 16/78 2023-10-14T17:03:48.263 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 17/78 2023-10-14T17:03:48.264 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 18/78 2023-10-14T17:03:48.264 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 19/78 2023-10-14T17:03:48.265 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 20/78 2023-10-14T17:03:48.265 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 21/78 2023-10-14T17:03:48.265 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 22/78 2023-10-14T17:03:48.266 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/78 2023-10-14T17:03:48.266 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 24/78 2023-10-14T17:03:48.266 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 25/78 2023-10-14T17:03:48.271 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 26/78 2023-10-14T17:03:48.271 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 27/78 2023-10-14T17:03:48.272 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 28/78 2023-10-14T17:03:48.272 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 29/78 2023-10-14T17:03:48.272 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 30/78 2023-10-14T17:03:48.273 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8. 31/78 2023-10-14T17:03:48.273 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x8 32/78 2023-10-14T17:03:48.273 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 33/78 2023-10-14T17:03:48.273 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 34/78 2023-10-14T17:03:48.274 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 35/78 2023-10-14T17:03:48.274 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 36/78 2023-10-14T17:03:48.274 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 37/78 2023-10-14T17:03:48.275 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 38/78 2023-10-14T17:03:48.275 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 39/78 2023-10-14T17:03:48.275 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 40/78 2023-10-14T17:03:48.275 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/78 2023-10-14T17:03:48.276 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/78 2023-10-14T17:03:48.276 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 43/78 2023-10-14T17:03:48.276 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 44/78 2023-10-14T17:03:48.276 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 45/78 2023-10-14T17:03:48.277 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 46/78 2023-10-14T17:03:48.277 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 47/78 2023-10-14T17:03:48.277 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 48/78 2023-10-14T17:03:48.277 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 49/78 2023-10-14T17:03:48.278 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 50/78 2023-10-14T17:03:48.278 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 51/78 2023-10-14T17:03:48.278 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 52/78 2023-10-14T17:03:48.279 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 53/78 2023-10-14T17:03:48.279 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-2.6-1.el8.noarch 54/78 2023-10-14T17:03:48.279 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/78 2023-10-14T17:03:48.279 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 56/78 2023-10-14T17:03:48.280 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 57/78 2023-10-14T17:03:48.280 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 58/78 2023-10-14T17:03:48.280 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 59/78 2023-10-14T17:03:48.280 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 60/78 2023-10-14T17:03:48.281 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 61/78 2023-10-14T17:03:48.281 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 62/78 2023-10-14T17:03:48.282 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 63/78 2023-10-14T17:03:48.282 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 64/78 2023-10-14T17:03:48.283 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 65/78 2023-10-14T17:03:48.283 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d 66/78 2023-10-14T17:03:48.283 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 67/78 2023-10-14T17:03:48.283 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 68/78 2023-10-14T17:03:48.284 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 69/78 2023-10-14T17:03:48.284 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 70/78 2023-10-14T17:03:48.284 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 71/78 2023-10-14T17:03:48.285 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 72/78 2023-10-14T17:03:48.285 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 73/78 2023-10-14T17:03:48.285 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 74/78 2023-10-14T17:03:48.285 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 75/78 2023-10-14T17:03:48.286 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 76/78 2023-10-14T17:03:48.286 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 77/78 2023-10-14T17:03:48.424 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 74/78 2023-10-14T17:03:48.432 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 75/78 2023-10-14T17:03:48.433 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : libquadmath-8.4.1-1.el8.x86_64 75/78 2023-10-14T17:03:48.647 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 78/78 2023-10-14T17:03:48.647 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:15:20 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T17:03:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 75/78 2023-10-14T17:03:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-markupsafe-0.23-19.el8.x86_64 76/78 2023-10-14T17:03:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : python3-bcrypt-3.1.6-2.el8.1.x86_64 77/78 2023-10-14T17:03:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 78/78 2023-10-14T17:03:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 78/78 2023-10-14T17:03:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/78 2023-10-14T17:03:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/78 2023-10-14T17:03:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el 3/78 2023-10-14T17:03:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32b 4/78 2023-10-14T17:03:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/78 2023-10-14T17:03:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarc 6/78 2023-10-14T17:03:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noa 7/78 2023-10-14T17:03:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d3 8/78 2023-10-14T17:03:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8. 9/78 2023-10-14T17:03:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 10/78 2023-10-14T17:03:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/78 2023-10-14T17:03:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8 12/78 2023-10-14T17:03:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/78 2023-10-14T17:03:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 14/78 2023-10-14T17:03:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 15/78 2023-10-14T17:03:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 16/78 2023-10-14T17:03:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 17/78 2023-10-14T17:03:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 18/78 2023-10-14T17:03:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 19/78 2023-10-14T17:03:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 20/78 2023-10-14T17:03:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_6 21/78 2023-10-14T17:03:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 22/78 2023-10-14T17:03:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/78 2023-10-14T17:03:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 24/78 2023-10-14T17:03:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 25/78 2023-10-14T17:03:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 26/78 2023-10-14T17:03:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 27/78 2023-10-14T17:03:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 28/78 2023-10-14T17:03:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 29/78 2023-10-14T17:03:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 30/78 2023-10-14T17:03:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8. 31/78 2023-10-14T17:03:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x8 32/78 2023-10-14T17:03:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 33/78 2023-10-14T17:03:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 34/78 2023-10-14T17:03:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 35/78 2023-10-14T17:03:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 36/78 2023-10-14T17:03:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 37/78 2023-10-14T17:03:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 38/78 2023-10-14T17:03:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 39/78 2023-10-14T17:03:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 40/78 2023-10-14T17:03:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/78 2023-10-14T17:03:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/78 2023-10-14T17:03:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 43/78 2023-10-14T17:03:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 44/78 2023-10-14T17:03:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 45/78 2023-10-14T17:03:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 46/78 2023-10-14T17:03:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 47/78 2023-10-14T17:03:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 48/78 2023-10-14T17:03:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 49/78 2023-10-14T17:03:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 50/78 2023-10-14T17:03:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 51/78 2023-10-14T17:03:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 52/78 2023-10-14T17:03:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 53/78 2023-10-14T17:03:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-2.6-1.el8.noarch 54/78 2023-10-14T17:03:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/78 2023-10-14T17:03:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 56/78 2023-10-14T17:03:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 57/78 2023-10-14T17:03:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 58/78 2023-10-14T17:03:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 59/78 2023-10-14T17:03:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 60/78 2023-10-14T17:03:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 61/78 2023-10-14T17:03:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 62/78 2023-10-14T17:03:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 63/78 2023-10-14T17:03:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 64/78 2023-10-14T17:03:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 65/78 2023-10-14T17:03:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d 66/78 2023-10-14T17:03:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 67/78 2023-10-14T17:03:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 68/78 2023-10-14T17:03:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 69/78 2023-10-14T17:03:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 70/78 2023-10-14T17:03:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 71/78 2023-10-14T17:03:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 72/78 2023-10-14T17:03:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 73/78 2023-10-14T17:03:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 74/78 2023-10-14T17:03:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 75/78 2023-10-14T17:03:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 76/78 2023-10-14T17:03:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 77/78 2023-10-14T17:03:50.637 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 78/78 2023-10-14T17:03:50.637 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:15:07 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T17:03:52.318 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 78/78 2023-10-14T17:03:52.318 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:15:22 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T17:03:52.859 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T17:03:52.877 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:52.877 INFO:teuthology.orchestra.run.smithi158.stdout:Removed: 2023-10-14T17:03:52.878 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.878 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.878 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:52.879 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.879 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.879 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:52.880 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:52.880 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:52.880 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:52.881 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:52.881 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.881 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:52.882 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.882 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:52.882 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T17:03:52.883 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.883 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-14T17:03:52.883 INFO:teuthology.orchestra.run.smithi158.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T17:03:52.884 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-14T17:03:52.884 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T17:03:52.884 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.885 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-14T17:03:52.885 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.886 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T17:03:52.886 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-14T17:03:52.886 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-14T17:03:52.887 INFO:teuthology.orchestra.run.smithi158.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T17:03:52.887 INFO:teuthology.orchestra.run.smithi158.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-14T17:03:52.887 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T17:03:52.888 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T17:03:52.888 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.888 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.889 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.889 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T17:03:52.890 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T17:03:52.890 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T17:03:52.890 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T17:03:52.891 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T17:03:52.891 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T17:03:52.891 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-14T17:03:52.892 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T17:03:52.892 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T17:03:52.892 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T17:03:52.893 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T17:03:52.893 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T17:03:52.893 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T17:03:52.893 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T17:03:52.894 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T17:03:52.894 INFO:teuthology.orchestra.run.smithi158.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T17:03:52.894 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-14T17:03:52.894 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-14T17:03:52.895 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T17:03:52.895 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T17:03:52.895 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T17:03:52.896 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T17:03:52.896 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T17:03:52.896 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T17:03:52.896 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T17:03:52.897 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.897 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.897 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T17:03:52.898 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T17:03:52.898 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.898 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T17:03:52.899 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T17:03:52.899 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-14T17:03:52.899 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T17:03:52.899 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T17:03:52.900 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T17:03:52.900 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T17:03:52.900 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T17:03:52.901 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T17:03:52.901 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T17:03:52.901 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T17:03:52.901 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T17:03:52.902 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T17:03:52.902 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:52.902 INFO:teuthology.orchestra.run.smithi158.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T17:03:52.903 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:52.903 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:03:53.428 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:03:54.887 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:03:54.888 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T17:03:54.888 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T17:03:54.889 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T17:03:54.889 INFO:teuthology.orchestra.run.smithi158.stdout:Removing: 2023-10-14T17:03:54.889 INFO:teuthology.orchestra.run.smithi158.stdout: cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 364 k 2023-10-14T17:03:54.890 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:54.890 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T17:03:54.890 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T17:03:54.890 INFO:teuthology.orchestra.run.smithi158.stdout:Remove 1 Package 2023-10-14T17:03:54.891 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:03:54.891 INFO:teuthology.orchestra.run.smithi158.stdout:Freed space: 364 k 2023-10-14T17:03:54.891 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T17:03:54.892 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T17:03:54.892 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T17:03:54.893 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T17:03:54.893 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T17:03:54.916 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T17:03:54.916 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T17:03:54.965 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T17:03:54.982 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:54.983 INFO:teuthology.orchestra.run.smithi155.stdout:Removed: 2023-10-14T17:03:54.983 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:54.983 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:54.984 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:54.984 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:54.984 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:54.984 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:54.985 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:54.985 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:54.985 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:54.986 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:54.986 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:54.986 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:54.986 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:54.987 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:54.987 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T17:03:54.987 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:54.988 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-14T17:03:54.988 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T17:03:54.988 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-14T17:03:54.988 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T17:03:54.989 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:54.989 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-14T17:03:54.989 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:54.990 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T17:03:54.990 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-14T17:03:54.990 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-14T17:03:54.990 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T17:03:54.991 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-14T17:03:54.991 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T17:03:54.991 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T17:03:54.992 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:54.992 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:54.992 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:54.992 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T17:03:54.993 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T17:03:54.993 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T17:03:54.993 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T17:03:54.994 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T17:03:54.994 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T17:03:54.994 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-14T17:03:54.995 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T17:03:54.995 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T17:03:54.995 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T17:03:54.995 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T17:03:54.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T17:03:54.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T17:03:54.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T17:03:54.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T17:03:54.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T17:03:54.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-14T17:03:54.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-14T17:03:54.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T17:03:54.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T17:03:54.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T17:03:54.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T17:03:54.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T17:03:54.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T17:03:54.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T17:03:55.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:55.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:55.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T17:03:55.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T17:03:55.001 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:55.001 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T17:03:55.001 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T17:03:55.002 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-14T17:03:55.002 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T17:03:55.002 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T17:03:55.002 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T17:03:55.003 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T17:03:55.003 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T17:03:55.003 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T17:03:55.003 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T17:03:55.004 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T17:03:55.004 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T17:03:55.004 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T17:03:55.005 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:55.005 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T17:03:55.005 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:55.005 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:03:55.544 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:03:56.965 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:03:56.966 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T17:03:56.967 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T17:03:56.967 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T17:03:56.968 INFO:teuthology.orchestra.run.smithi155.stdout:Removing: 2023-10-14T17:03:56.968 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 364 k 2023-10-14T17:03:56.968 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:56.969 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T17:03:56.969 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T17:03:56.970 INFO:teuthology.orchestra.run.smithi155.stdout:Remove 1 Package 2023-10-14T17:03:56.970 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:03:56.971 INFO:teuthology.orchestra.run.smithi155.stdout:Freed space: 364 k 2023-10-14T17:03:56.971 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T17:03:56.972 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T17:03:56.972 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T17:03:56.973 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T17:03:56.973 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T17:03:57.007 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T17:03:57.007 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T17:03:57.033 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T17:03:58.011 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T17:03:58.012 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:15:30 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T17:03:59.017 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T17:03:59.036 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:59.036 INFO:teuthology.orchestra.run.smithi008.stdout:Removed: 2023-10-14T17:03:59.037 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.037 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.037 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:59.037 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.038 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.038 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:59.038 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:59.038 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.039 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:59.040 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.040 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:03:59.040 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T17:03:59.040 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.041 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-14T17:03:59.041 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T17:03:59.041 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-14T17:03:59.042 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T17:03:59.042 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.042 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-14T17:03:59.043 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.043 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T17:03:59.043 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-14T17:03:59.044 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-14T17:03:59.044 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T17:03:59.044 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-14T17:03:59.044 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T17:03:59.045 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T17:03:59.045 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.045 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.046 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.046 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T17:03:59.046 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T17:03:59.047 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T17:03:59.047 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T17:03:59.047 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T17:03:59.047 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T17:03:59.048 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-14T17:03:59.048 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T17:03:59.048 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T17:03:59.049 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T17:03:59.049 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T17:03:59.049 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T17:03:59.049 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T17:03:59.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T17:03:59.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T17:03:59.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T17:03:59.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-14T17:03:59.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-14T17:03:59.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T17:03:59.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T17:03:59.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T17:03:59.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T17:03:59.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T17:03:59.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T17:03:59.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T17:03:59.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T17:03:59.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T17:03:59.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T17:03:59.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T17:03:59.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-14T17:03:59.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T17:03:59.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T17:03:59.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T17:03:59.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T17:03:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T17:03:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T17:03:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T17:03:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T17:03:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T17:03:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T17:03:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:03:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T17:03:59.059 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:03:59.059 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:03:59.060 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T17:03:59.617 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:00.120 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T17:04:00.121 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:15:17 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T17:04:00.989 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:00.990 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T17:04:00.990 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T17:04:00.990 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T17:04:00.991 INFO:teuthology.orchestra.run.smithi008.stdout:Removing: 2023-10-14T17:04:00.991 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 @ceph-noarch 364 k 2023-10-14T17:04:00.991 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:00.992 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T17:04:00.992 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T17:04:00.992 INFO:teuthology.orchestra.run.smithi008.stdout:Remove 1 Package 2023-10-14T17:04:00.992 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:00.993 INFO:teuthology.orchestra.run.smithi008.stdout:Freed space: 364 k 2023-10-14T17:04:00.993 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T17:04:00.994 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T17:04:00.994 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T17:04:00.995 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T17:04:00.995 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T17:04:01.026 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T17:04:01.026 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T17:04:03.316 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T17:04:03.411 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T17:04:03.416 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:03.416 INFO:teuthology.orchestra.run.smithi158.stdout:Removed: 2023-10-14T17:04:03.416 INFO:teuthology.orchestra.run.smithi158.stdout: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:04:03.417 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:03.417 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:03.943 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:04.458 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 1/1 2023-10-14T17:04:04.458 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:15:34 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T17:04:05.552 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: ceph-immutable-object-cache 2023-10-14T17:04:05.552 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:05.557 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:05.559 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:05.559 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:05.978 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:06.242 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T17:04:06.247 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:06.248 INFO:teuthology.orchestra.run.smithi155.stdout:Removed: 2023-10-14T17:04:06.248 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:04:06.248 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:06.249 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:06.807 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:07.298 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: ceph-mgr 2023-10-14T17:04:07.299 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:07.304 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:07.305 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:07.306 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:07.740 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:08.267 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: ceph-immutable-object-cache 2023-10-14T17:04:08.268 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:04:08.273 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:08.274 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:04:08.274 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:08.722 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:09.277 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: ceph-mgr-dashboard 2023-10-14T17:04:09.278 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:09.283 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:09.285 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:09.285 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:09.710 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:10.111 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: ceph-mgr 2023-10-14T17:04:10.111 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:04:10.126 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:10.126 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:04:10.127 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:10.547 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:10.593 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T17:04:10.599 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:10.599 INFO:teuthology.orchestra.run.smithi008.stdout:Removed: 2023-10-14T17:04:10.600 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T17:04:10.600 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:10.600 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:11.028 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: ceph-mgr-diskprediction-local 2023-10-14T17:04:11.029 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:11.034 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:11.035 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:11.035 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:11.143 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:11.473 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:12.127 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: ceph-mgr-dashboard 2023-10-14T17:04:12.127 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:04:12.133 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:12.134 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:04:12.134 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:12.574 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:12.705 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: ceph-immutable-object-cache 2023-10-14T17:04:12.705 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:04:12.711 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:12.712 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:04:12.713 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:12.954 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: ceph-mgr-rook 2023-10-14T17:04:12.955 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:12.960 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:12.962 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:12.962 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:13.155 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:13.394 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:13.899 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: ceph-mgr-diskprediction-local 2023-10-14T17:04:13.899 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:04:13.905 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:13.906 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:04:13.906 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:14.337 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:14.636 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: ceph-mgr 2023-10-14T17:04:14.637 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:04:14.642 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:14.643 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:04:14.644 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:14.885 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: ceph-mgr-cephadm 2023-10-14T17:04:14.886 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:14.891 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:14.892 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:14.893 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:15.163 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:15.345 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:15.849 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: ceph-mgr-rook 2023-10-14T17:04:15.850 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:04:15.855 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:15.856 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:04:15.857 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:16.293 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:16.638 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: ceph-mgr-dashboard 2023-10-14T17:04:16.639 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:04:16.644 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:16.645 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:04:16.646 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:16.884 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:16.885 INFO:teuthology.orchestra.run.smithi158.stdout:====================================================================================== 2023-10-14T17:04:16.885 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T17:04:16.886 INFO:teuthology.orchestra.run.smithi158.stdout:====================================================================================== 2023-10-14T17:04:16.886 INFO:teuthology.orchestra.run.smithi158.stdout:Removing: 2023-10-14T17:04:16.886 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 2.9 M 2023-10-14T17:04:16.887 INFO:teuthology.orchestra.run.smithi158.stdout:Removing unused dependencies: 2023-10-14T17:04:16.887 INFO:teuthology.orchestra.run.smithi158.stdout: fuse x86_64 2.9.7-12.el8 @rhel-8-for-x86_64-baseos-rpms 206 k 2023-10-14T17:04:16.887 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:16.887 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T17:04:16.888 INFO:teuthology.orchestra.run.smithi158.stdout:====================================================================================== 2023-10-14T17:04:16.888 INFO:teuthology.orchestra.run.smithi158.stdout:Remove 2 Packages 2023-10-14T17:04:16.888 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:16.888 INFO:teuthology.orchestra.run.smithi158.stdout:Freed space: 3.1 M 2023-10-14T17:04:16.889 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T17:04:16.889 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T17:04:16.890 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T17:04:16.962 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T17:04:16.963 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T17:04:17.089 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:17.155 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T17:04:17.166 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:04:17.166 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/2 2023-10-14T17:04:17.471 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/2 2023-10-14T17:04:17.632 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : fuse-2.9.7-12.el8.x86_64 2/2 2023-10-14T17:04:17.685 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: ceph-mgr-cephadm 2023-10-14T17:04:17.686 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:04:17.691 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:17.692 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:04:17.693 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:17.925 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: fuse-2.9.7-12.el8.x86_64 2/2 2023-10-14T17:04:17.926 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/2 2023-10-14T17:04:18.126 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:18.472 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: ceph-mgr-diskprediction-local 2023-10-14T17:04:18.473 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:04:18.478 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:18.480 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:04:18.480 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:18.956 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:18.965 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2023-10-14T17:04:18.965 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:15:50 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T17:04:19.660 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:19.661 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2023-10-14T17:04:19.662 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T17:04:19.662 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2023-10-14T17:04:19.663 INFO:teuthology.orchestra.run.smithi155.stdout:Removing: 2023-10-14T17:04:19.663 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 2.9 M 2023-10-14T17:04:19.664 INFO:teuthology.orchestra.run.smithi155.stdout:Removing unused dependencies: 2023-10-14T17:04:19.664 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.7-12.el8 @rhel-8-for-x86_64-baseos-rpms 206 k 2023-10-14T17:04:19.664 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:19.665 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T17:04:19.665 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2023-10-14T17:04:19.665 INFO:teuthology.orchestra.run.smithi155.stdout:Remove 2 Packages 2023-10-14T17:04:19.666 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:19.666 INFO:teuthology.orchestra.run.smithi155.stdout:Freed space: 3.1 M 2023-10-14T17:04:19.668 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T17:04:19.668 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T17:04:19.669 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T17:04:19.717 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T17:04:19.717 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T17:04:19.813 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T17:04:19.822 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:04:19.823 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/2 2023-10-14T17:04:20.073 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/2 2023-10-14T17:04:20.275 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : fuse-2.9.7-12.el8.x86_64 2/2 2023-10-14T17:04:20.357 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: ceph-mgr-rook 2023-10-14T17:04:20.357 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:04:20.363 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:20.364 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:04:20.365 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:20.508 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: fuse-2.9.7-12.el8.x86_64 2/2 2023-10-14T17:04:20.509 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/2 2023-10-14T17:04:20.793 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:21.580 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2023-10-14T17:04:21.581 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:15:38 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T17:04:22.275 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: ceph-mgr-cephadm 2023-10-14T17:04:22.276 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:04:22.281 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:22.282 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:04:22.283 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:22.749 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:24.314 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:24.315 INFO:teuthology.orchestra.run.smithi008.stdout:====================================================================================== 2023-10-14T17:04:24.315 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T17:04:24.315 INFO:teuthology.orchestra.run.smithi008.stdout:====================================================================================== 2023-10-14T17:04:24.316 INFO:teuthology.orchestra.run.smithi008.stdout:Removing: 2023-10-14T17:04:24.316 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 2.9 M 2023-10-14T17:04:24.316 INFO:teuthology.orchestra.run.smithi008.stdout:Removing unused dependencies: 2023-10-14T17:04:24.316 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.7-12.el8 @rhel-8-for-x86_64-baseos-rpms 206 k 2023-10-14T17:04:24.317 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:24.317 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T17:04:24.317 INFO:teuthology.orchestra.run.smithi008.stdout:====================================================================================== 2023-10-14T17:04:24.318 INFO:teuthology.orchestra.run.smithi008.stdout:Remove 2 Packages 2023-10-14T17:04:24.318 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:24.318 INFO:teuthology.orchestra.run.smithi008.stdout:Freed space: 3.1 M 2023-10-14T17:04:24.318 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T17:04:24.319 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T17:04:24.319 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T17:04:24.342 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T17:04:24.347 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:24.348 INFO:teuthology.orchestra.run.smithi158.stdout:Removed: 2023-10-14T17:04:24.348 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2023-10-14T17:04:24.348 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:24.348 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:24.375 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T17:04:24.375 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T17:04:24.477 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T17:04:24.487 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/1 2023-10-14T17:04:24.488 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/2 2023-10-14T17:04:24.778 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/2 2023-10-14T17:04:24.847 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:24.963 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : fuse-2.9.7-12.el8.x86_64 2/2 2023-10-14T17:04:25.226 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: fuse-2.9.7-12.el8.x86_64 2/2 2023-10-14T17:04:25.227 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/2 2023-10-14T17:04:26.316 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T17:04:26.322 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:26.322 INFO:teuthology.orchestra.run.smithi155.stdout:Removed: 2023-10-14T17:04:26.322 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2023-10-14T17:04:26.323 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:26.323 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:26.408 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2023-10-14T17:04:26.408 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:15:56 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T17:04:26.510 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: ceph-volume 2023-10-14T17:04:26.511 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:26.516 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:26.518 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:26.518 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:26.801 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:26.954 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:28.278 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: ceph-volume 2023-10-14T17:04:28.279 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:04:28.284 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:28.286 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:04:28.286 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:28.503 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:28.504 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T17:04:28.505 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repo Size 2023-10-14T17:04:28.505 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T17:04:28.505 INFO:teuthology.orchestra.run.smithi158.stdout:Removing: 2023-10-14T17:04:28.506 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 464 k 2023-10-14T17:04:28.506 INFO:teuthology.orchestra.run.smithi158.stdout:Removing dependent packages: 2023-10-14T17:04:28.506 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 109 k 2023-10-14T17:04:28.507 INFO:teuthology.orchestra.run.smithi158.stdout:Removing unused dependencies: 2023-10-14T17:04:28.507 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 2.4 M 2023-10-14T17:04:28.507 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:28.507 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T17:04:28.508 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-10-14T17:04:28.508 INFO:teuthology.orchestra.run.smithi158.stdout:Remove 3 Packages 2023-10-14T17:04:28.508 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:28.509 INFO:teuthology.orchestra.run.smithi158.stdout:Freed space: 3.0 M 2023-10-14T17:04:28.509 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T17:04:28.510 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T17:04:28.510 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T17:04:28.559 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T17:04:28.560 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T17:04:28.658 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T17:04:28.716 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:28.843 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/3 2023-10-14T17:04:28.844 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:04:29.102 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:04:29.246 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:04:29.498 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:04:29.499 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/3 2023-10-14T17:04:29.499 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:04:30.189 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:30.190 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T17:04:30.190 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repo Size 2023-10-14T17:04:30.191 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T17:04:30.191 INFO:teuthology.orchestra.run.smithi155.stdout:Removing: 2023-10-14T17:04:30.191 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 464 k 2023-10-14T17:04:30.192 INFO:teuthology.orchestra.run.smithi155.stdout:Removing dependent packages: 2023-10-14T17:04:30.192 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 109 k 2023-10-14T17:04:30.192 INFO:teuthology.orchestra.run.smithi155.stdout:Removing unused dependencies: 2023-10-14T17:04:30.192 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 2.4 M 2023-10-14T17:04:30.193 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:30.193 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T17:04:30.194 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-14T17:04:30.194 INFO:teuthology.orchestra.run.smithi155.stdout:Remove 3 Packages 2023-10-14T17:04:30.194 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:30.195 INFO:teuthology.orchestra.run.smithi155.stdout:Freed space: 3.0 M 2023-10-14T17:04:30.195 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T17:04:30.196 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T17:04:30.196 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T17:04:30.242 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T17:04:30.242 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T17:04:30.334 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T17:04:30.479 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/3 2023-10-14T17:04:30.479 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:04:30.527 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:04:30.528 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:16:02 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T17:04:30.723 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:04:30.857 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:04:31.122 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:04:31.122 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/3 2023-10-14T17:04:31.123 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:04:32.248 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:04:32.248 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:15:49 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T17:04:33.102 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T17:04:33.108 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:33.108 INFO:teuthology.orchestra.run.smithi008.stdout:Removed: 2023-10-14T17:04:33.108 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2023-10-14T17:04:33.109 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:33.109 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:33.629 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:35.145 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: ceph-volume 2023-10-14T17:04:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:04:35.151 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:35.153 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:04:35.153 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:35.591 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:36.825 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:36.826 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T17:04:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repo Size 2023-10-14T17:04:36.827 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T17:04:36.827 INFO:teuthology.orchestra.run.smithi008.stdout:Removing: 2023-10-14T17:04:36.827 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 464 k 2023-10-14T17:04:36.828 INFO:teuthology.orchestra.run.smithi008.stdout:Removing dependent packages: 2023-10-14T17:04:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 109 k 2023-10-14T17:04:36.828 INFO:teuthology.orchestra.run.smithi008.stdout:Removing unused dependencies: 2023-10-14T17:04:36.828 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 2.4 M 2023-10-14T17:04:36.829 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:36.829 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T17:04:36.829 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-14T17:04:36.830 INFO:teuthology.orchestra.run.smithi008.stdout:Remove 3 Packages 2023-10-14T17:04:36.830 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:36.830 INFO:teuthology.orchestra.run.smithi008.stdout:Freed space: 3.0 M 2023-10-14T17:04:36.831 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T17:04:36.831 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T17:04:36.832 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T17:04:36.881 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T17:04:36.882 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T17:04:36.897 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T17:04:36.903 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:36.903 INFO:teuthology.orchestra.run.smithi158.stdout:Removed: 2023-10-14T17:04:36.903 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:36.904 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:36.904 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:36.904 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:36.904 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:36.990 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T17:04:37.141 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/3 2023-10-14T17:04:37.142 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:04:37.392 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:04:37.394 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:37.520 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:04:37.785 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:04:37.785 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/3 2023-10-14T17:04:37.786 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/3 2023-10-14T17:04:38.255 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T17:04:38.261 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:38.261 INFO:teuthology.orchestra.run.smithi155.stdout:Removed: 2023-10-14T17:04:38.262 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:38.262 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:38.262 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:38.263 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:38.263 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:38.742 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: libcephfs2 2023-10-14T17:04:38.743 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:38.748 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:38.750 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:38.750 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:38.766 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:38.926 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/3 2023-10-14T17:04:38.927 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:16:08 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T17:04:39.185 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:40.198 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: libcephfs2 2023-10-14T17:04:40.199 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:04:40.204 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:40.206 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:04:40.206 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:40.601 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: libcephfs-devel 2023-10-14T17:04:40.601 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:40.607 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:40.608 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:40.608 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:40.650 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:41.034 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:41.851 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: libcephfs-devel 2023-10-14T17:04:41.851 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:04:41.857 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:41.858 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:04:41.858 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:42.292 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:42.446 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:42.448 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================================================== 2023-10-14T17:04:42.448 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-10-14T17:04:42.449 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================================================== 2023-10-14T17:04:42.449 INFO:teuthology.orchestra.run.smithi158.stdout:Removing: 2023-10-14T17:04:42.449 INFO:teuthology.orchestra.run.smithi158.stdout: librados2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 14 M 2023-10-14T17:04:42.449 INFO:teuthology.orchestra.run.smithi158.stdout:Removing dependent packages: 2023-10-14T17:04:42.450 INFO:teuthology.orchestra.run.smithi158.stdout: qemu-kvm-block-rbd x86_64 15:4.2.0-48.module+el8.4.0+11909+3300d70f.3 @rhel-8-for-x86_64-appstream-rpms 33 k 2023-10-14T17:04:42.450 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 264 k 2023-10-14T17:04:42.450 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 552 k 2023-10-14T17:04:42.451 INFO:teuthology.orchestra.run.smithi158.stdout:Removing unused dependencies: 2023-10-14T17:04:42.451 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 16 M 2023-10-14T17:04:42.451 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust x86_64 2.8.1-11.el8 @rhel-8-for-x86_64-appstream-rpms 1.1 M 2023-10-14T17:04:42.451 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:42.452 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-10-14T17:04:42.452 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================================================== 2023-10-14T17:04:42.452 INFO:teuthology.orchestra.run.smithi158.stdout:Remove 6 Packages 2023-10-14T17:04:42.453 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:42.453 INFO:teuthology.orchestra.run.smithi158.stdout:Freed space: 33 M 2023-10-14T17:04:42.454 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-10-14T17:04:42.454 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-10-14T17:04:42.454 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-10-14T17:04:42.501 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-10-14T17:04:42.502 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-10-14T17:04:42.666 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-10-14T17:04:42.824 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/6 2023-10-14T17:04:43.024 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/6 2023-10-14T17:04:43.476 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+11909+ 3/6 2023-10-14T17:04:43.477 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/6 2023-10-14T17:04:43.710 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/6 2023-10-14T17:04:43.710 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T17:04:43.710 INFO:teuthology.orchestra.run.smithi158.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2023-10-14T17:04:43.711 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:43.888 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:43.890 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================================================== 2023-10-14T17:04:43.890 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-14T17:04:43.890 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================================================== 2023-10-14T17:04:43.891 INFO:teuthology.orchestra.run.smithi155.stdout:Removing: 2023-10-14T17:04:43.891 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 14 M 2023-10-14T17:04:43.891 INFO:teuthology.orchestra.run.smithi155.stdout:Removing dependent packages: 2023-10-14T17:04:43.891 INFO:teuthology.orchestra.run.smithi155.stdout: qemu-kvm-block-rbd x86_64 15:4.2.0-48.module+el8.4.0+11909+3300d70f.3 @rhel-8-for-x86_64-appstream-rpms 33 k 2023-10-14T17:04:43.892 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 264 k 2023-10-14T17:04:43.892 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 552 k 2023-10-14T17:04:43.892 INFO:teuthology.orchestra.run.smithi155.stdout:Removing unused dependencies: 2023-10-14T17:04:43.893 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 16 M 2023-10-14T17:04:43.893 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.8.1-11.el8 @rhel-8-for-x86_64-appstream-rpms 1.1 M 2023-10-14T17:04:43.893 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:43.894 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-14T17:04:43.894 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================================================== 2023-10-14T17:04:43.894 INFO:teuthology.orchestra.run.smithi155.stdout:Remove 6 Packages 2023-10-14T17:04:43.894 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:43.895 INFO:teuthology.orchestra.run.smithi155.stdout:Freed space: 33 M 2023-10-14T17:04:43.895 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-14T17:04:43.896 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-14T17:04:43.896 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-14T17:04:43.943 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-14T17:04:43.944 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-14T17:04:43.951 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T17:04:43.951 INFO:teuthology.orchestra.run.smithi158.stdout: Erasing : lttng-ust-2.8.1-11.el8.x86_64 6/6 2023-10-14T17:04:44.035 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T17:04:44.041 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:44.042 INFO:teuthology.orchestra.run.smithi008.stdout:Removed: 2023-10-14T17:04:44.042 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:44.042 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:44.043 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:44.043 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:44.043 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:44.066 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-14T17:04:44.235 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/6 2023-10-14T17:04:44.410 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/6 2023-10-14T17:04:44.449 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/6 2023-10-14T17:04:44.449 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/6 2023-10-14T17:04:44.450 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/6 2023-10-14T17:04:44.450 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 3/6 2023-10-14T17:04:44.450 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+11909+ 4/6 2023-10-14T17:04:44.451 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T17:04:44.570 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+11909+ 3/6 2023-10-14T17:04:44.571 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/6 2023-10-14T17:04:44.630 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:44.787 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/6 2023-10-14T17:04:44.788 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T17:04:44.788 INFO:teuthology.orchestra.run.smithi155.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2023-10-14T17:04:44.788 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:45.012 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T17:04:45.012 INFO:teuthology.orchestra.run.smithi155.stdout: Erasing : lttng-ust-2.8.1-11.el8.x86_64 6/6 2023-10-14T17:04:45.480 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/6 2023-10-14T17:04:45.481 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/6 2023-10-14T17:04:45.481 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/6 2023-10-14T17:04:45.481 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 3/6 2023-10-14T17:04:45.481 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+11909+ 4/6 2023-10-14T17:04:45.482 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T17:04:45.623 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/6 2023-10-14T17:04:45.624 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:16:17 ago on Sat 14 Oct 2023 04:48:28 PM UTC. 2023-10-14T17:04:46.233 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: libcephfs2 2023-10-14T17:04:46.234 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:04:46.239 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:46.241 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:04:46.241 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:46.629 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/6 2023-10-14T17:04:46.630 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:16:03 ago on Sat 14 Oct 2023 04:48:43 PM UTC. 2023-10-14T17:04:46.785 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:48.309 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: libcephfs-devel 2023-10-14T17:04:48.310 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:04:48.316 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:48.317 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:04:48.317 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:48.762 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:50.066 INFO:teuthology.orchestra.run.smithi158.stdout:Installed products updated. 2023-10-14T17:04:50.072 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:50.072 INFO:teuthology.orchestra.run.smithi158.stdout:Removed: 2023-10-14T17:04:50.073 INFO:teuthology.orchestra.run.smithi158.stdout: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:50.073 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:50.073 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T17:04:50.074 INFO:teuthology.orchestra.run.smithi158.stdout: qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+11909+3300d70f.3.x86_64 2023-10-14T17:04:50.074 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:50.074 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:50.075 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-10-14T17:04:50.075 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:50.371 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:04:50.373 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================================================== 2023-10-14T17:04:50.373 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-14T17:04:50.374 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================================================== 2023-10-14T17:04:50.374 INFO:teuthology.orchestra.run.smithi008.stdout:Removing: 2023-10-14T17:04:50.374 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 14 M 2023-10-14T17:04:50.375 INFO:teuthology.orchestra.run.smithi008.stdout:Removing dependent packages: 2023-10-14T17:04:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: qemu-kvm-block-rbd x86_64 15:4.2.0-48.module+el8.4.0+11909+3300d70f.3 @rhel-8-for-x86_64-appstream-rpms 33 k 2023-10-14T17:04:50.375 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 264 k 2023-10-14T17:04:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 552 k 2023-10-14T17:04:50.376 INFO:teuthology.orchestra.run.smithi008.stdout:Removing unused dependencies: 2023-10-14T17:04:50.376 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 @ceph 16 M 2023-10-14T17:04:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.8.1-11.el8 @rhel-8-for-x86_64-appstream-rpms 1.1 M 2023-10-14T17:04:50.377 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:50.377 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-14T17:04:50.378 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================================================== 2023-10-14T17:04:50.378 INFO:teuthology.orchestra.run.smithi008.stdout:Remove 6 Packages 2023-10-14T17:04:50.378 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:50.379 INFO:teuthology.orchestra.run.smithi008.stdout:Freed space: 33 M 2023-10-14T17:04:50.380 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-14T17:04:50.380 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-14T17:04:50.380 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-14T17:04:50.431 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-14T17:04:50.432 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-14T17:04:50.517 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:50.566 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-14T17:04:50.748 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/6 2023-10-14T17:04:50.856 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/6 2023-10-14T17:04:51.083 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+11909+ 3/6 2023-10-14T17:04:51.084 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/6 2023-10-14T17:04:51.426 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/6 2023-10-14T17:04:51.426 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T17:04:51.427 INFO:teuthology.orchestra.run.smithi008.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2023-10-14T17:04:51.427 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:51.676 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T17:04:51.677 INFO:teuthology.orchestra.run.smithi008.stdout: Erasing : lttng-ust-2.8.1-11.el8.x86_64 6/6 2023-10-14T17:04:51.908 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: librbd1 2023-10-14T17:04:51.909 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:51.914 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:51.915 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:51.916 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:52.192 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/6 2023-10-14T17:04:52.193 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/6 2023-10-14T17:04:52.193 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/6 2023-10-14T17:04:52.193 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 3/6 2023-10-14T17:04:52.194 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+11909+ 4/6 2023-10-14T17:04:52.194 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/6 2023-10-14T17:04:52.358 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:53.084 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-14T17:04:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:53.090 INFO:teuthology.orchestra.run.smithi155.stdout:Removed: 2023-10-14T17:04:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T17:04:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+11909+3300d70f.3.x86_64 2023-10-14T17:04:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-14T17:04:53.092 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:53.359 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/6 2023-10-14T17:04:53.360 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:16:23 ago on Sat 14 Oct 2023 04:48:30 PM UTC. 2023-10-14T17:04:53.596 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:53.765 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: python3-rados 2023-10-14T17:04:53.766 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:53.771 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:53.772 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:53.773 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:54.192 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:55.401 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: librbd1 2023-10-14T17:04:55.402 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:04:55.407 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:55.408 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:04:55.408 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:55.834 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:55.940 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: python3-rgw 2023-10-14T17:04:55.941 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:55.946 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:55.948 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:55.948 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:56.370 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:57.175 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: python3-rados 2023-10-14T17:04:57.176 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:04:57.181 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:57.182 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:04:57.182 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:57.617 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:57.914 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: python3-cephfs 2023-10-14T17:04:57.914 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:57.920 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:57.921 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:57.921 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:04:58.351 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:58.626 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-14T17:04:58.632 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:58.633 INFO:teuthology.orchestra.run.smithi008.stdout:Removed: 2023-10-14T17:04:58.633 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:58.633 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:58.633 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T17:04:58.634 INFO:teuthology.orchestra.run.smithi008.stdout: qemu-kvm-block-rbd-15:4.2.0-48.module+el8.4.0+11909+3300d70f.3.x86_64 2023-10-14T17:04:58.634 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:58.634 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T17:04:58.635 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-14T17:04:58.635 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:04:58.998 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: python3-rgw 2023-10-14T17:04:58.999 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:04:59.004 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:04:59.006 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:04:59.006 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:04:59.098 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:59.449 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:04:59.748 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: python3-rbd 2023-10-14T17:04:59.749 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:04:59.754 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:04:59.755 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:04:59.756 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:05:00.189 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:00.527 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: librbd1 2023-10-14T17:05:00.528 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:05:00.534 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:05:00.535 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:05:00.535 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:05:00.903 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: python3-cephfs 2023-10-14T17:05:00.903 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:05:00.909 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:05:00.910 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:05:00.911 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:05:00.977 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:01.345 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:01.606 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: rbd-fuse 2023-10-14T17:05:01.607 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:05:01.612 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:05:01.613 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:05:01.614 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:05:02.044 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:02.422 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: python3-rados 2023-10-14T17:05:02.422 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:05:02.428 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:05:02.430 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:05:02.430 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:05:02.697 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: python3-rbd 2023-10-14T17:05:02.698 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:05:02.703 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:05:02.705 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:05:02.705 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:05:02.882 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:03.138 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:03.474 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: rbd-mirror 2023-10-14T17:05:03.474 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:05:03.480 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:05:03.481 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:05:03.481 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:05:03.912 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:04.335 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: python3-rgw 2023-10-14T17:05:04.336 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:05:04.341 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:05:04.343 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:05:04.343 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:05:04.527 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: rbd-fuse 2023-10-14T17:05:04.527 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:05:04.533 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:05:04.534 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:05:04.534 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:05:04.797 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:04.963 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:05.286 INFO:teuthology.orchestra.run.smithi158.stdout:No match for argument: rbd-nbd 2023-10-14T17:05:05.286 INFO:teuthology.orchestra.run.smithi158.stderr:No packages marked for removal. 2023-10-14T17:05:05.292 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-10-14T17:05:05.293 INFO:teuthology.orchestra.run.smithi158.stdout:Nothing to do. 2023-10-14T17:05:05.293 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-10-14T17:05:05.388 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum clean all 2023-10-14T17:05:05.741 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:06.343 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: python3-cephfs 2023-10-14T17:05:06.344 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:05:06.349 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:05:06.350 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:05:06.351 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:05:06.676 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: rbd-mirror 2023-10-14T17:05:06.677 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:05:06.682 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:05:06.683 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:05:06.683 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:05:06.783 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:07.105 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:07.172 INFO:teuthology.orchestra.run.smithi158.stdout:53 files removed 2023-10-14T17:05:07.227 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-14T17:05:07.251 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum clean expire-cache 2023-10-14T17:05:07.641 INFO:teuthology.orchestra.run.smithi158.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:08.298 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: python3-rbd 2023-10-14T17:05:08.298 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:05:08.304 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:05:08.305 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:05:08.306 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:05:08.540 INFO:teuthology.orchestra.run.smithi155.stdout:No match for argument: rbd-nbd 2023-10-14T17:05:08.540 INFO:teuthology.orchestra.run.smithi155.stderr:No packages marked for removal. 2023-10-14T17:05:08.546 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-14T17:05:08.547 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2023-10-14T17:05:08.547 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-14T17:05:08.649 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2023-10-14T17:05:08.747 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:08.997 INFO:teuthology.orchestra.run.smithi158.stdout:Cache was expired 2023-10-14T17:05:08.998 INFO:teuthology.orchestra.run.smithi158.stdout:0 files removed 2023-10-14T17:05:08.999 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:09.051 DEBUG:teuthology.parallel:result is None 2023-10-14T17:05:10.144 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: rbd-fuse 2023-10-14T17:05:10.145 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:05:10.151 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:05:10.152 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:05:10.153 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:05:10.194 INFO:teuthology.orchestra.run.smithi155.stdout:53 files removed 2023-10-14T17:05:10.252 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-14T17:05:10.277 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean expire-cache 2023-10-14T17:05:10.580 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:10.669 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:11.905 INFO:teuthology.orchestra.run.smithi155.stdout:Cache was expired 2023-10-14T17:05:11.906 INFO:teuthology.orchestra.run.smithi155.stdout:0 files removed 2023-10-14T17:05:11.965 DEBUG:teuthology.parallel:result is None 2023-10-14T17:05:11.996 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: rbd-mirror 2023-10-14T17:05:11.996 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:05:12.002 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:05:12.003 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:05:12.004 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:05:12.456 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:13.874 INFO:teuthology.orchestra.run.smithi008.stdout:No match for argument: rbd-nbd 2023-10-14T17:05:13.875 INFO:teuthology.orchestra.run.smithi008.stderr:No packages marked for removal. 2023-10-14T17:05:13.881 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-14T17:05:13.882 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-14T17:05:13.882 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-14T17:05:13.974 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2023-10-14T17:05:14.349 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:15.532 INFO:teuthology.orchestra.run.smithi008.stdout:53 files removed 2023-10-14T17:05:15.598 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-14T17:05:15.624 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean expire-cache 2023-10-14T17:05:16.039 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-14T17:05:17.163 INFO:teuthology.orchestra.run.smithi008.stdout:Cache was expired 2023-10-14T17:05:17.163 INFO:teuthology.orchestra.run.smithi008.stdout:0 files removed 2023-10-14T17:05:17.227 DEBUG:teuthology.parallel:result is None 2023-10-14T17:05:17.227 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T17:05:17.228 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@smithi155.front.sepia.ceph.com 2023-10-14T17:05:17.228 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@smithi158.front.sepia.ceph.com 2023-10-14T17:05:17.229 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-14T17:05:17.229 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-14T17:05:17.230 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-14T17:05:17.257 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2023-10-14T17:05:17.258 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2023-10-14T17:05:17.260 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2023-10-14T17:05:17.324 DEBUG:teuthology.parallel:result is None 2023-10-14T17:05:17.326 DEBUG:teuthology.parallel:result is None 2023-10-14T17:05:17.328 DEBUG:teuthology.parallel:result is None 2023-10-14T17:05:17.328 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T17:05:17.341 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T17:05:17.342 DEBUG:teuthology.orchestra.run.smithi008:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T17:05:17.367 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T17:05:17.369 DEBUG:teuthology.orchestra.run.smithi158:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T17:05:17.379 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-10-14T17:05:17.381 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2023-10-14T17:05:17.382 INFO:teuthology.orchestra.run.smithi008.stdout:210 Number of sources = 4 2023-10-14T17:05:17.383 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T17:05:17.383 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-10-14T17:05:17.383 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 47 +877us[ +877us] +/- 81ms 2023-10-14T17:05:17.383 INFO:teuthology.orchestra.run.smithi008.stdout:^* hv02.front.sepia.ceph.com 3 7 377 49 -939us[ -946us] +/- 69ms 2023-10-14T17:05:17.384 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +390us[ +390us] +/- 88ms 2023-10-14T17:05:17.384 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T17:05:17.385 INFO:teuthology.orchestra.run.smithi158.stderr:bash: ntpq: command not found 2023-10-14T17:05:17.386 INFO:teuthology.orchestra.run.smithi155.stdout:210 Number of sources = 4 2023-10-14T17:05:17.387 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T17:05:17.387 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2023-10-14T17:05:17.387 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 47 +853us[ +853us] +/- 81ms 2023-10-14T17:05:17.387 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv02.front.sepia.ceph.com 3 6 377 47 -970us[ -963us] +/- 69ms 2023-10-14T17:05:17.388 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +356us[ +364us] +/- 88ms 2023-10-14T17:05:17.388 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T17:05:17.389 INFO:teuthology.orchestra.run.smithi158.stdout:210 Number of sources = 4 2023-10-14T17:05:17.389 INFO:teuthology.orchestra.run.smithi158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T17:05:17.390 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================== 2023-10-14T17:05:17.390 INFO:teuthology.orchestra.run.smithi158.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 47 +809us[ +809us] +/- 81ms 2023-10-14T17:05:17.390 INFO:teuthology.orchestra.run.smithi158.stdout:^* hv02.front.sepia.ceph.com 3 6 377 48 -996us[ -937us] +/- 69ms 2023-10-14T17:05:17.390 INFO:teuthology.orchestra.run.smithi158.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +328us[ +328us] +/- 88ms 2023-10-14T17:05:17.391 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T17:05:17.391 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T17:05:17.400 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T17:05:17.401 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T17:05:17.410 DEBUG:teuthology.orchestra.run.smithi008:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T17:05:17.521 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T17:05:17.614 DEBUG:teuthology.orchestra.run.smithi158:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T17:05:17.707 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T17:05:17.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T17:05:17.738 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T17:05:17.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T17:05:17.769 DEBUG:teuthology.orchestra.run.smithi158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T17:05:17.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T17:05:17.799 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T17:05:17.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T17:05:17.818 INFO:teuthology.task.internal:Duration was 1617.511744 seconds 2023-10-14T17:05:17.819 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T17:05:17.828 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T17:05:17.829 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T17:05:17.831 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T17:05:17.833 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T17:05:17.874 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T17:05:17.875 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T17:05:17.885 INFO:teuthology.orchestra.run.smithi158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T17:05:18.147 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T17:05:18.148 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi008.front.sepia.ceph.com 2023-10-14T17:05:18.148 DEBUG:teuthology.orchestra.run.smithi008:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T17:05:18.169 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2023-10-14T17:05:18.169 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T17:05:18.206 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi158.front.sepia.ceph.com 2023-10-14T17:05:18.207 DEBUG:teuthology.orchestra.run.smithi158:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T17:05:18.226 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T17:05:18.227 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T17:05:18.229 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T17:05:18.249 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T17:05:18.306 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T17:05:18.306 DEBUG:teuthology.orchestra.run.smithi008:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T17:05:18.309 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T17:05:18.326 DEBUG:teuthology.orchestra.run.smithi158:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T17:05:18.419 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T17:05:18.429 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T17:05:18.430 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T17:05:18.455 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T17:05:18.480 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T17:05:18.504 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T17:05:18.515 DEBUG:teuthology.orchestra.run.smithi008:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T17:05:18.518 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T17:05:18.523 DEBUG:teuthology.orchestra.run.smithi158:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T17:05:18.539 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = core 2023-10-14T17:05:18.544 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2023-10-14T17:05:18.568 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = core 2023-10-14T17:05:18.582 DEBUG:teuthology.orchestra.run.smithi008:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T17:05:18.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T17:05:18.608 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T17:05:18.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T17:05:18.622 DEBUG:teuthology.orchestra.run.smithi158:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T17:05:18.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T17:05:18.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T17:05:18.647 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T17:05:18.648 DEBUG:teuthology.misc:Transferring archived files from smithi008:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/remote/smithi008 2023-10-14T17:05:18.649 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T17:05:18.686 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/remote/smithi155 2023-10-14T17:05:18.687 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T17:05:18.722 DEBUG:teuthology.misc:Transferring archived files from smithi158:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843/remote/smithi158 2023-10-14T17:05:18.722 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T17:05:18.756 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T17:05:18.757 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T17:05:18.759 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T17:05:18.761 DEBUG:teuthology.orchestra.run.smithi158:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T17:05:18.805 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T17:05:18.817 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T17:05:18.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T17:05:18.828 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T17:05:18.828 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T17:05:18.830 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T17:05:18.833 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T17:05:18.843 INFO:teuthology.orchestra.run.smithi008.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 17:05 /home/ubuntu/cephtest 2023-10-14T17:05:18.845 INFO:teuthology.orchestra.run.smithi155.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 17:05 /home/ubuntu/cephtest 2023-10-14T17:05:18.859 INFO:teuthology.orchestra.run.smithi158.stdout: 262183 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 17:05 /home/ubuntu/cephtest 2023-10-14T17:05:18.860 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T17:05:18.875 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T17:05:18.900 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T17:05:18.926 DEBUG:teuthology.nuke:shortname: smithi008 2023-10-14T17:05:18.927 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T17:05:18.951 DEBUG:teuthology.nuke:shortname: smithi155 2023-10-14T17:05:18.951 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T17:05:18.957 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 16:30:10.585897', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD2V1pydE/Nblj3F4zQzonPePLslsJxTqHZe77IvppnxXBBQTRtAw4C/kCVRrQ5GV1qjj48Pi6CWkzVdTuZmKxE='} 2023-10-14T17:05:18.978 DEBUG:teuthology.nuke:shortname: smithi158 2023-10-14T17:05:18.979 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T17:05:18.985 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 16:30:10.584614', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNaUt6XRwPyW83NOO/DkbIe/LUU6Y2Cn96Nv3CIAiYNCssmdJz9Js0dvmPROFs6P2o6JmTgg2g2gCpslr8k39SI='} 2023-10-14T17:05:19.014 INFO:teuthology.orchestra.console.smithi008:Power off 2023-10-14T17:05:19.015 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T17:05:19.029 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-14_16:11:58-smoke-quincy-release-distro-default-smithi/7427843', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 16:30:10.583130', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwgx9MI7rNF66HyQBifvvzkRYTwdRRWRfiNkc1T8eFE2sG5claga68c6UZUAR8BcwSDUK0UWyjKdviBBBruHlU='} 2023-10-14T17:05:19.045 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-10-14T17:05:19.046 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T17:05:19.061 INFO:teuthology.orchestra.console.smithi155:Power off 2023-10-14T17:05:19.062 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T17:05:19.075 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-10-14T17:05:19.084 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-10-14T17:05:19.085 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T17:05:19.106 INFO:teuthology.orchestra.console.smithi158:Power off 2023-10-14T17:05:19.106 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T17:05:19.115 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-10-14T17:05:19.129 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-10-14T17:05:19.129 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T17:05:19.151 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-14T17:05:23.077 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T17:05:23.116 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T17:05:23.152 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T17:05:23.190 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-10-14T17:05:23.227 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-10-14T17:05:23.263 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-14T17:05:27.193 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T17:05:27.229 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T17:05:27.266 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T17:05:27.305 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-10-14T17:05:27.339 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-10-14T17:05:27.376 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-14T17:05:27.406 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-10-14T17:05:27.441 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-10-14T17:05:27.477 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-10-14T17:05:27.582 INFO:teuthology.run:Summary data: description: smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/libcephfs_interface_tests}} duration: 1617.5117435455322 failure_reason: 'Command failed (workunit test libcephfs/test.sh) on smithi158 with status 127: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=57526decaeb6495c9313e3f6fa9d5a4b status: fail success: false 2023-10-14T17:05:27.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T17:05:27.654 INFO:teuthology.run:FAIL